-- Logs begin at Thu 2022-02-10 22:32:18 UTC, end at Thu 2022-02-10 23:40:36 UTC. -- Feb 10 23:02:28.187636 dv-cinder-828805-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 10 23:02:28.194907 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 10 23:02:28.199799 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Feb 10 23:02:28 2022] *** Feb 10 23:02:28.199799 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 10 23:02:28.199799 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 10 23:02:28.199799 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: nodename: dv-cinder-828805-1-iscsi Feb 10 23:02:28.199799 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: machine: x86_64 Feb 10 23:02:28.199799 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: clock source: unix Feb 10 23:02:28.199799 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: pcre jit disabled Feb 10 23:02:28.199799 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: detected number of CPU cores: 4 Feb 10 23:02:28.199799 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: current working directory: / Feb 10 23:02:28.199799 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: detected binary path: /usr/bin/uwsgi-core Feb 10 23:02:28.199799 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: your processes number limit is 47680 Feb 10 23:02:28.199799 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: your memory page size is 4096 bytes Feb 10 23:02:28.199799 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: detected max file descriptor number: 2048 Feb 10 23:02:28.199799 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: lock engine: pthread robust mutexes Feb 10 23:02:28.199799 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: thunder lock: enabled Feb 10 23:02:28.199799 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 10 23:02:28.199799 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 10 23:02:28.245318 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: Python main interpreter initialized at 0x55ff7d2239c0 Feb 10 23:02:28.245318 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: python threads support enabled Feb 10 23:02:28.245318 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: your server socket listen backlog is limited to 100 connections Feb 10 23:02:28.245318 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: your mercy for graceful operations on workers is 90 seconds Feb 10 23:02:28.245694 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: mapped 403077 bytes (393 KB) for 2 cores Feb 10 23:02:28.245758 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: *** Operational MODE: preforking *** Feb 10 23:02:28.246080 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: *** uWSGI is running in multiple interpreter mode *** Feb 10 23:02:28.246080 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: spawned uWSGI master process (pid: 79298) Feb 10 23:02:28.246294 dv-cinder-828805-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 10 23:02:28.248160 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: spawned uWSGI worker 1 (pid: 79312, cores: 1) Feb 10 23:02:28.248160 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: spawned uWSGI worker 2 (pid: 79313, cores: 1) Feb 10 23:02:28.248160 dv-cinder-828805-1-iscsi devstack@keystone.service[79298]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 10 23:02:33.985172 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 10 23:02:33.985172 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: from cryptography.utils import int_from_bytes Feb 10 23:02:33.986223 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 10 23:02:33.986223 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: from cryptography.utils import int_from_bytes Feb 10 23:02:33.986642 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 10 23:02:33.986642 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: from cryptography.utils import int_from_bytes Feb 10 23:02:33.986749 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 10 23:02:33.986749 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: from cryptography.utils import int_from_bytes Feb 10 23:02:34.031130 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 10 23:02:34.031322 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 10 23:02:34.031515 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] command line args: [] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 10 23:02:34.031610 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 10 23:02:34.031781 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 10 23:02:34.031878 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 10 23:02:34.031984 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ================================================================================ {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 10 23:02:34.032067 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] command line args: [] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 10 23:02:34.032243 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] admin_token = **** {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.032328 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 10 23:02:34.032434 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ================================================================================ {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 10 23:02:34.032512 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] config_dir = [] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.032668 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.032749 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] admin_token = **** {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.032853 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] config_source = [] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.032936 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] config_dir = [] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.033035 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] debug = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.033113 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.033235 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.033521 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] config_source = [] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.033521 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] debug = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.033716 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.033827 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.033947 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.034049 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.034142 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.034260 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.034356 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.034455 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.034556 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] list_limit = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.034650 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.034756 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] log_config_append = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.034857 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] list_limit = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.034951 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.035043 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] log_config_append = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.035141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] log_dir = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.035240 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.035342 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] log_file = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.035437 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] log_dir = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.035514 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.035627 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] log_file = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.035627 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.035813 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.035926 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.036004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.036080 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.036202 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.036284 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.036364 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.036495 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.036577 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.036697 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.036777 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.036876 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.036953 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.037123 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.037226 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.037343 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.037416 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.037578 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.037695 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.037812 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.037888 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.038044 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.038122 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.038290 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.038373 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.038536 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.038655 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.038813 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.039042 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.039232 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] publish_errors = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.039348 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.040021 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] publish_errors = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.040168 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.040254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.040365 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.040442 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.040505 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.040649 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.040778 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.040912 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.040992 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.041120 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] standard_threads = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.041203 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.041355 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] standard_threads = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.041431 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.041587 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.041664 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.041767 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.041841 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.041947 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] use_journal = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.042025 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.042127 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] use_json = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.042204 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] use_journal = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.042319 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] use_stderr = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.042393 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] use_json = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.042469 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] use_syslog = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.042541 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] use_stderr = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.042642 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] use_syslog = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.042723 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.042874 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 23:02:34.042950 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.043128 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.043205 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.043366 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.043442 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.043628 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.043706 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.043892 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.043972 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.044135 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.044210 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.044371 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.044455 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.044607 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.044679 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.044851 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.044932 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.045100 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.045175 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.045346 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.045421 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.045581 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.045655 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.045818 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.045900 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.046061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.046136 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.046295 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.046377 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.046542 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.046626 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.046780 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.046855 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.047014 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.047089 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.047269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.047352 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.047517 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.047598 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.047757 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.047852 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.048026 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.048117 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.048282 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.048358 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.048541 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.048615 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.048792 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.048881 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.049024 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.049100 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.049258 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.049334 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.049487 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.049573 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.049717 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.049802 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.049952 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.050034 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.050199 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.050350 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.050428 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.050498 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.050655 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.050737 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.050882 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.050965 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.051126 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.051203 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.051367 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.051441 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.051608 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.051692 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.051860 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.051939 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.052098 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.052172 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.052335 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.052420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.052568 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.052643 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.052795 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.052876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.053024 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.053108 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.053254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.053330 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.053482 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.053559 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.053717 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.053795 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.053951 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.054026 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.054180 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.054254 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.054554 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.054685 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.054685 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.054874 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.054968 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.055106 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.055787 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.055915 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.056048 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.056155 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.056303 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.056407 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.056482 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.056555 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.056679 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.056755 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.056868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.056942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.057063 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.057138 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.057208 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.057328 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.057440 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.057519 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.057690 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.057817 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.057924 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.058009 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.058158 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.058235 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.058388 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.058476 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.058640 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.058717 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.058871 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.058956 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.059102 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.059180 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.059338 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.059419 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.059572 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.059648 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.059863 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.059944 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.060094 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.060212 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.060341 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.060423 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.060585 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.060662 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.060819 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.060900 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.061053 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.061129 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.061287 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.061365 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.061532 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.061610 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.061769 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.061846 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.062004 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.062080 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.062232 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.062306 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.062468 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.062544 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.062705 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.062785 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.062937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.063014 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.063170 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.063252 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.063404 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.063479 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.063659 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.063736 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.063926 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.064005 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.064169 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.064245 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.064411 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.064494 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.064648 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.064723 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.064884 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.064974 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.065119 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.065207 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.065352 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.065429 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.065579 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.065654 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.065808 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.065896 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.066036 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.066112 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.066266 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.066341 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.066493 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.066575 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.066732 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.066809 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.066967 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.067045 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.067214 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.067298 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.067459 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.067536 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.067714 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.067797 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.067979 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.068070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.068216 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] auth.external = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.068293 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.068446 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] auth.external = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.068522 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.068678 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.068761 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.068974 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.069065 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.069206 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] auth.password = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.069282 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.069436 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] auth.password = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.069518 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] auth.token = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.069667 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] auth.token = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.069752 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.069903 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.069979 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.070137 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.070214 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.070373 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.070456 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.070603 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.070741 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.071387 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.071501 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.071631 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.071719 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.071963 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.072044 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] credential.caching = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.072203 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] credential.caching = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.072281 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.072453 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.072564 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.072703 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.072781 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.072952 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.073029 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.073191 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.073271 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.073433 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.073510 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.073668 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.073746 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.073938 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.074017 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.074178 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.074255 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.074433 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.074509 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.074687 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.074766 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.074957 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.075081 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.075207 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.075313 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.075462 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.075568 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.075708 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.075811 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.075973 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] federation.caching = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.076076 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.076212 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] federation.caching = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.076317 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.076452 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.076558 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.076700 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.076802 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.076981 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.077088 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.077185 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.077280 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.077400 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.077509 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.077637 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.077747 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.077885 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.077988 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.078144 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.078249 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.078384 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.078490 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.078636 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.078741 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.078874 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] identity.caching = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.078984 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.079125 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.079237 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] identity.caching = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.079370 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.079473 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.080104 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.080195 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.080271 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.080342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.080342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.080468 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.080538 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.080616 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.080695 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.080775 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.080848 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.080918 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.081013 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.081100 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.081265 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.081371 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.083667 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.083808 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.083808 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.084040 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.084140 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.084245 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.084341 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.084436 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.084532 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.084636 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.084734 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.084830 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.084926 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.085022 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.085125 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.085222 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.085318 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.085413 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.085507 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.085609 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.085713 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.085811 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.085891 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.085963 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.086042 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.086115 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.086192 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.086264 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.086406 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.086489 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.087093 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.087172 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.087253 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.087325 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.087396 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.087466 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.087536 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.087606 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.087688 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.087761 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.087891 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.087967 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.088038 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.088108 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.088190 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.088264 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.088334 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.088334 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.088459 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.088529 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.088607 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.088679 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.088749 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.088824 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.088895 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.088966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.089043 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.089115 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.089185 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.089255 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.089332 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.089403 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.089481 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.089559 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.089631 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.089700 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.089771 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.089900 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.089986 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.090129 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.090207 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.090376 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.090453 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.090623 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.090710 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.090860 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.090938 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.091099 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.091175 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.091335 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.091420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.091566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.user = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.091643 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.user = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.091804 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.091900 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.092087 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.092176 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.092317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.092394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.092566 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.092644 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.092812 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.092896 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.093056 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.093133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.093304 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.093382 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.093535 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.093624 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.093771 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.093849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.094008 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.094085 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.094250 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.094335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.094481 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.094559 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.094727 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.094804 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.094972 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.095059 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.095218 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.095296 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.095466 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.095542 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.095709 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.095793 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.095964 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.096043 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.096211 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.096289 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.096450 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.096529 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.096685 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.096761 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.096922 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.096998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.097153 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.097231 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.097399 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.097475 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.097645 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.097720 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.097884 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.097962 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.098136 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.098212 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.098368 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.098444 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.098609 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.098687 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.098846 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.098924 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.099079 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.099155 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.099316 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.099395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.099563 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.099639 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.099802 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.099897 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.100050 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.100125 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.100284 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.100362 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.100525 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] resource.caching = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.100600 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] resource.caching = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.100774 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.100852 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.101022 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.101098 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.101256 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.101332 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.101507 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.101587 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.101757 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.101833 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.102014 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.102100 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.102261 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.102366 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.102499 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.102617 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.102738 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.102862 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.102973 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] role.caching = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.103102 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] role.caching = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.103220 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] role.driver = sql {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.103352 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] role.driver = sql {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.103450 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.103586 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.103700 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.103856 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.104055 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.104134 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.104307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.104385 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.104557 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.104626 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.104808 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.104897 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.105055 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.105132 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.105301 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.105379 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.105546 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.105622 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.105777 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.105853 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.106023 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.106101 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.106270 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.106347 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.106514 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.106597 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.106764 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.106844 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.107172 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.107248 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.107408 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.107493 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.107660 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.107737 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.107932 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.108013 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.108185 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.108274 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.108432 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.108509 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.108666 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.108742 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.108918 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.109002 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.109172 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.109249 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.109410 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.109486 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.109643 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.109727 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.109875 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.109953 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.110107 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.110183 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.110357 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.110689 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.110866 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.110942 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.111109 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.111185 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.111346 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.111431 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.111580 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.111657 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.111810 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.111907 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.112065 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] token.caching = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.112155 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] token.caching = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.112302 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.112379 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.112547 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.112624 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.112784 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.112869 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.113038 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.113116 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.113287 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.113363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.113519 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.113603 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.113760 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.113838 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.114002 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.114078 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.114250 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.114340 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.114485 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.114562 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.114720 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.114796 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.114953 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.115038 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.115197 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.115275 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.115443 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.115520 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.115671 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.115756 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.115936 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.116016 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.116228 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.116305 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.116488 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] database.connection = **** {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.116577 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] database.connection = **** {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.116734 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.116823 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.116977 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.117055 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.117213 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.117292 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.117453 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.117539 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.117713 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.117792 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.117955 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.118185 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.118185 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.118332 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.118406 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.118478 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.118640 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.118719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.118876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.118960 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.119119 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.119196 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.119354 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.119431 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.119597 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.119752 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.119846 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.119920 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.120085 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.120163 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.120315 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.120405 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.120552 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.120630 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.120786 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.120864 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 23:02:34.120955 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 10 23:02:34.121041 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 10 23:02:34.153587 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.153748 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.153815 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.153887 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.154023 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.154107 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.162563 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.162701 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.191644 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.191895 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.192001 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.192193 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.245585 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.245913 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.296902 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.297127 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.297804 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.298043 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.363594 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.363838 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.364062 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.364152 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.364284 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.364371 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.364505 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.364600 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.364722 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.364807 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.364943 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.365166 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.392102 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.392338 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.392567 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.392795 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.393018 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.393239 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.393511 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.393894 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.394134 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.394356 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.394576 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.394791 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.395004 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.395217 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.405552 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.406023 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.418826 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.419065 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.419156 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.419301 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.419422 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.419531 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.419634 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.419746 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.419845 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.419988 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.420069 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.420200 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.420283 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.420410 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 23:02:34.437514 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.437727 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 10 23:02:34.437973 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.438057 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.438285 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 10 23:02:34.438361 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 10 23:02:34.438495 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.438576 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.438692 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 10 23:02:34.438775 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.438956 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.439036 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.439212 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.439292 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.439467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.439718 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.449854 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.450302 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.450383 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.450573 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.450656 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.450834 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.450915 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.451111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.458792 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.458966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.462649 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.462877 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.462966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.463140 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.463234 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.463425 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.463505 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.463708 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.463788 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.463989 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.464070 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.464259 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.464340 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.464526 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.464613 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.464797 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.464875 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.465068 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.465147 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.465398 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.465485 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.465702 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.491454 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.492319 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.493144 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.493419 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.493919 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.494199 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.498647 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.498876 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.499147 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.499457 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.499735 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.500040 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.506158 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.506438 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.507117 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.507400 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.510903 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.511184 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.511460 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.511737 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.511915 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.512138 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.512220 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.512409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.512501 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.512677 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.512757 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.512943 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.513022 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.513369 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.513644 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.513916 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.531517 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.531803 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.532553 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.532834 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.536351 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.537436 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.540556 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.540838 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.541566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.541861 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.545703 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.546776 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.549203 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.550297 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.552736 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.553028 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.553305 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.553696 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.553970 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.554053 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.554253 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.554335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.554596 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.555006 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.555322 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.555610 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.573336 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.573620 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.573882 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.574137 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.574617 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.574919 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.575186 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.575450 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.581797 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.583258 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.583457 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.583734 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.584955 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.585232 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.587274 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.587624 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.587930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.588217 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.588511 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.588843 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.589123 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.589402 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.589699 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.589986 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.601423 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.601694 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.602127 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.602325 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.602640 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.602917 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.603187 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.603307 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.603588 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.603894 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.604176 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.604456 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.604746 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.605021 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.620708 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.622706 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.623982 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.626033 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.627182 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.628758 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.629267 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.630329 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.630604 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.630840 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.631048 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.632444 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.632726 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.633018 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.639753 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.641345 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.642094 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.643689 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.644480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.644764 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.645047 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.645329 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.646866 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.647143 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.647429 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.647715 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.654826 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.655114 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.655386 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.657149 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.657439 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.657716 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.762736 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.762936 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.763201 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.763469 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.763734 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.764037 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.764317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.764515 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 23:02:34.764600 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.764813 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.764893 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.765098 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.765180 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.765368 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.765499 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.765623 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.765712 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.765882 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.765962 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.766144 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.766223 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.766432 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.766702 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.766988 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.767268 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.767529 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.767792 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.768086 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 23:02:34.803609 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff7d2239c0 pid: 79312 (default app) Feb 10 23:02:34.807061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff7d2239c0 pid: 79313 (default app) Feb 10 23:02:34.807686 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74076f-5718-4d56-9f30-031680ae9c44 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:34.808011 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74076f-5718-4d56-9f30-031680ae9c44 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:34.808286 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74076f-5718-4d56-9f30-031680ae9c44 None None] PATH_INFO: `/v3` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:34.818390 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 791 bytes} [Thu Feb 10 23:02:34 2022] GET /identity/v3/ => generated 255 bytes in 14 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:02:43.037453 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff4bd5-9b17-43f4-8852-a8906c087ba8 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:43.038036 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff4bd5-9b17-43f4-8852-a8906c087ba8 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:43.038036 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff4bd5-9b17-43f4-8852-a8906c087ba8 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:43.043899 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1/2] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:02:43 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:02:43.049459 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cce741-c900-46a0-82bd-06212c12b02c None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:43.049911 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cce741-c900-46a0-82bd-06212c12b02c None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:43.050094 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cce741-c900-46a0-82bd-06212c12b02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:43.080340 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG oslo_db.sqlalchemy.engines [None req-99cce741-c900-46a0-82bd-06212c12b02c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79312) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 23:02:43.266927 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG passlib.handlers.bcrypt [None req-99cce741-c900-46a0-82bd-06212c12b02c None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79312) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 10 23:02:43.267333 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG passlib.handlers.bcrypt [None req-99cce741-c900-46a0-82bd-06212c12b02c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79312) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 10 23:02:43.325243 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-99cce741-c900-46a0-82bd-06212c12b02c None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:02:43.326762 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-99cce741-c900-46a0-82bd-06212c12b02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:02:43.452499 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 2/3] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:02:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:02:43.615765 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff4bd5-9b17-43f4-8852-a8906c087ba8 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:43.648887 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG oslo_db.sqlalchemy.engines [None req-e6ff4bd5-9b17-43f4-8852-a8906c087ba8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 23:02:43.774734 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff4bd5-9b17-43f4-8852-a8906c087ba8 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:43.778968 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c1bfd-ae22-4d1c-bdbe-a3fea8e52efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:43.779613 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c1bfd-ae22-4d1c-bdbe-a3fea8e52efe admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:43.779924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c1bfd-ae22-4d1c-bdbe-a3fea8e52efe admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:43.780203 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c1bfd-ae22-4d1c-bdbe-a3fea8e52efe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:43.788333 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c1bfd-ae22-4d1c-bdbe-a3fea8e52efe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:43.839713 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f25c1bfd-ae22-4d1c-bdbe-a3fea8e52efe admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 10 23:02:43.840071 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c1bfd-ae22-4d1c-bdbe-a3fea8e52efe admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:43.849175 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 2/4] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:02:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:02:43.855294 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cce741-c900-46a0-82bd-06212c12b02c None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:43.869665 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cce741-c900-46a0-82bd-06212c12b02c None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:43.873993 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641693b-f3c1-4557-95c2-3f0a79009cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:43.875074 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641693b-f3c1-4557-95c2-3f0a79009cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:43.875358 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641693b-f3c1-4557-95c2-3f0a79009cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:43.875629 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641693b-f3c1-4557-95c2-3f0a79009cf7 admin admin] PATH_INFO: `/v3/projects/6a8319582f7d4e2b90ad1c11263c01da` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:43.877120 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641693b-f3c1-4557-95c2-3f0a79009cf7 admin admin] RBAC: Authorizing `identity:get_project(project_id=6a8319582f7d4e2b90ad1c11263c01da)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:43.928888 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2641693b-f3c1-4557-95c2-3f0a79009cf7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 10 23:02:43.929224 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641693b-f3c1-4557-95c2-3f0a79009cf7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:43.934328 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 3/5] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:02:43 2022] GET /identity/v3/projects/6a8319582f7d4e2b90ad1c11263c01da => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:02:46.108183 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f3233-876e-4102-b870-02ffacbfc191 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:46.108656 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f3233-876e-4102-b870-02ffacbfc191 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:46.108751 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f3233-876e-4102-b870-02ffacbfc191 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:46.113489 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 3/6] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:02:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:02:46.119548 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92164089-61f7-48d3-b5ca-fdfc32c88526 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:46.120001 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92164089-61f7-48d3-b5ca-fdfc32c88526 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:46.120126 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92164089-61f7-48d3-b5ca-fdfc32c88526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:46.138490 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-92164089-61f7-48d3-b5ca-fdfc32c88526 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:02:46.140028 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-92164089-61f7-48d3-b5ca-fdfc32c88526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:02:46.147609 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 4/7] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:02:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:02:46.170082 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f3233-876e-4102-b870-02ffacbfc191 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:46.182731 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f3233-876e-4102-b870-02ffacbfc191 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:46.187216 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2c01f-e6a8-4c15-a233-fd65f73a75ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:46.187863 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2c01f-e6a8-4c15-a233-fd65f73a75ed admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:46.188154 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2c01f-e6a8-4c15-a233-fd65f73a75ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:46.188432 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2c01f-e6a8-4c15-a233-fd65f73a75ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:46.196196 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2c01f-e6a8-4c15-a233-fd65f73a75ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:46.197948 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2c01f-e6a8-4c15-a233-fd65f73a75ed admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:46.206467 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 4/8] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:02:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:02:46.212266 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92164089-61f7-48d3-b5ca-fdfc32c88526 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:46.220934 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92164089-61f7-48d3-b5ca-fdfc32c88526 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:46.225219 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51495aed-57f7-46f2-851f-2085bbd1cc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:46.226059 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51495aed-57f7-46f2-851f-2085bbd1cc47 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:46.226337 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51495aed-57f7-46f2-851f-2085bbd1cc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:46.227240 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51495aed-57f7-46f2-851f-2085bbd1cc47 admin admin] PATH_INFO: `/v3/users/93804c035bb74a079b9cb29e5d154621` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:46.228664 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51495aed-57f7-46f2-851f-2085bbd1cc47 admin admin] RBAC: Authorizing `identity:get_user(user_id=93804c035bb74a079b9cb29e5d154621)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:46.230445 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51495aed-57f7-46f2-851f-2085bbd1cc47 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:46.232016 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 5/9] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:02:46 2022] GET /identity/v3/users/93804c035bb74a079b9cb29e5d154621 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:02:48.498012 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c224694-6238-4e01-bcda-0f50d79dd448 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:48.498545 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c224694-6238-4e01-bcda-0f50d79dd448 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:48.498632 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c224694-6238-4e01-bcda-0f50d79dd448 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:48.500428 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 5/10] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:02:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:02:48.505729 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d15dd9-7376-41fc-ab87-8418ba9c6175 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:48.510115 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d15dd9-7376-41fc-ab87-8418ba9c6175 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:48.510115 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d15dd9-7376-41fc-ab87-8418ba9c6175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:48.524353 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-d5d15dd9-7376-41fc-ab87-8418ba9c6175 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:02:48.525538 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-d5d15dd9-7376-41fc-ab87-8418ba9c6175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:02:48.533152 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 6/11] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:02:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:02:48.540912 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611dc48-2f63-4610-9f6c-d8d9a827d739 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:48.541198 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611dc48-2f63-4610-9f6c-d8d9a827d739 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:48.541477 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611dc48-2f63-4610-9f6c-d8d9a827d739 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:48.543208 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 6/12] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:02:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:02:48.548300 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139eb49-7daf-4a9a-8e4a-ed1160438ebf None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:48.548583 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139eb49-7daf-4a9a-8e4a-ed1160438ebf None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:48.548854 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139eb49-7daf-4a9a-8e4a-ed1160438ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:48.556773 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611dc48-2f63-4610-9f6c-d8d9a827d739 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:48.566207 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-8139eb49-7daf-4a9a-8e4a-ed1160438ebf None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:02:48.567383 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-8139eb49-7daf-4a9a-8e4a-ed1160438ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:02:48.568065 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611dc48-2f63-4610-9f6c-d8d9a827d739 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:48.572201 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5033f5c-c421-4343-89b5-17462657a486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:48.572949 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5033f5c-c421-4343-89b5-17462657a486 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:48.573228 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5033f5c-c421-4343-89b5-17462657a486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:48.573494 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5033f5c-c421-4343-89b5-17462657a486 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:48.575157 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 7/13] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:02:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:02:48.589458 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5033f5c-c421-4343-89b5-17462657a486 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:02:48.596244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-b5033f5c-c421-4343-89b5-17462657a486 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:02:48.597405 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 7/14] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:02:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:02:48.598170 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139eb49-7daf-4a9a-8e4a-ed1160438ebf None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:48.603849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5033f5c-c421-4343-89b5-17462657a486 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:48.607883 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139eb49-7daf-4a9a-8e4a-ed1160438ebf None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:48.612904 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903adbe9-6afa-4fcd-a15c-45e2036b308d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:48.613538 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903adbe9-6afa-4fcd-a15c-45e2036b308d admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:48.613627 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5033f5c-c421-4343-89b5-17462657a486 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:48.613823 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903adbe9-6afa-4fcd-a15c-45e2036b308d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:48.614101 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903adbe9-6afa-4fcd-a15c-45e2036b308d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:48.618727 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e1bcf-d2ae-43ed-a40a-cba6336b3eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:48.619342 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e1bcf-d2ae-43ed-a40a-cba6336b3eda admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:48.619624 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e1bcf-d2ae-43ed-a40a-cba6336b3eda admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:48.619923 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e1bcf-d2ae-43ed-a40a-cba6336b3eda admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:48.620681 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e1bcf-d2ae-43ed-a40a-cba6336b3eda admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:02:48.620978 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e1bcf-d2ae-43ed-a40a-cba6336b3eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:48.622692 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903adbe9-6afa-4fcd-a15c-45e2036b308d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:48.622805 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING py.warnings [None req-6c5e1bcf-d2ae-43ed-a40a-cba6336b3eda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:02:48.622805 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: warnings.warn(msg) Feb 10 23:02:48.622805 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: Feb 10 23:02:48.623600 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e1bcf-d2ae-43ed-a40a-cba6336b3eda admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:48.624499 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903adbe9-6afa-4fcd-a15c-45e2036b308d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:48.633777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 8/15] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:02:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 23:02:48.637839 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 8/16] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:02:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:02:48.639226 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903adbe9-6afa-4fcd-a15c-45e2036b308d admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:48.642960 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e1bcf-d2ae-43ed-a40a-cba6336b3eda admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:48.647655 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903adbe9-6afa-4fcd-a15c-45e2036b308d admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:48.652292 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c942b-cab8-4a72-ac10-b61848ee6a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:48.652670 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e1bcf-d2ae-43ed-a40a-cba6336b3eda admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:48.653053 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c942b-cab8-4a72-ac10-b61848ee6a97 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:48.653337 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c942b-cab8-4a72-ac10-b61848ee6a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:48.653613 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c942b-cab8-4a72-ac10-b61848ee6a97 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:48.654785 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c942b-cab8-4a72-ac10-b61848ee6a97 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:48.656512 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c942b-cab8-4a72-ac10-b61848ee6a97 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:48.657065 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3381a7-07d4-41b7-b508-491611bea941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:48.657889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3381a7-07d4-41b7-b508-491611bea941 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:48.658173 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3381a7-07d4-41b7-b508-491611bea941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:48.658339 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 9/17] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:02:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:02:48.658511 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3381a7-07d4-41b7-b508-491611bea941 admin admin] PATH_INFO: `/v3/users/93804c035bb74a079b9cb29e5d154621` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:48.660266 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3381a7-07d4-41b7-b508-491611bea941 admin admin] RBAC: Authorizing `identity:get_user(user_id=93804c035bb74a079b9cb29e5d154621)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:48.662081 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3381a7-07d4-41b7-b508-491611bea941 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:48.663711 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 9/18] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:02:48 2022] GET /identity/v3/users/93804c035bb74a079b9cb29e5d154621 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:02:48.669625 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c942b-cab8-4a72-ac10-b61848ee6a97 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:48.680301 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c942b-cab8-4a72-ac10-b61848ee6a97 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:48.684930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94ae0d-ace0-4247-a33b-726a084c9ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:48.685749 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94ae0d-ace0-4247-a33b-726a084c9ffc admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:48.686035 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94ae0d-ace0-4247-a33b-726a084c9ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:48.686313 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94ae0d-ace0-4247-a33b-726a084c9ffc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:48.687568 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94ae0d-ace0-4247-a33b-726a084c9ffc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:48.689339 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94ae0d-ace0-4247-a33b-726a084c9ffc admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:48.691184 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 10/19] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:02:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:02:48.697649 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3381a7-07d4-41b7-b508-491611bea941 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:48.707676 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3381a7-07d4-41b7-b508-491611bea941 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:48.712596 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cf081-19f4-4f5d-8d96-87e7124a4a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:48.713301 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cf081-19f4-4f5d-8d96-87e7124a4a38 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:48.713582 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cf081-19f4-4f5d-8d96-87e7124a4a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:48.713853 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cf081-19f4-4f5d-8d96-87e7124a4a38 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:48.714712 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cf081-19f4-4f5d-8d96-87e7124a4a38 admin admin] RBAC: Adding query filter params (role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f, scope.domain.id=default, user.id=93804c035bb74a079b9cb29e5d154621) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:02:48.715019 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cf081-19f4-4f5d-8d96-87e7124a4a38 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:48.716084 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING py.warnings [None req-6e7cf081-19f4-4f5d-8d96-87e7124a4a38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:02:48.716084 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: warnings.warn(msg) Feb 10 23:02:48.716084 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: Feb 10 23:02:48.717276 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cf081-19f4-4f5d-8d96-87e7124a4a38 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:48.728460 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 10/20] 10.222.0.77 () {56 vars in 1343 bytes} [Thu Feb 10 23:02:48 2022] GET /identity/v3/role_assignments?user.id=93804c035bb74a079b9cb29e5d154621&scope.domain.id=default&role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 233 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:02:51.372769 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcd57d-86c5-424d-bad9-08a557e5e3dc None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:51.373802 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcd57d-86c5-424d-bad9-08a557e5e3dc None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:51.374290 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcd57d-86c5-424d-bad9-08a557e5e3dc None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:51.380137 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 11/21] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:02:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:02:51.382729 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167c496-f753-4bab-87c7-b8bec60760f8 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:51.383560 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167c496-f753-4bab-87c7-b8bec60760f8 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:51.384065 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167c496-f753-4bab-87c7-b8bec60760f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:51.405728 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c0787-2d35-4fe3-b240-6489183ab23b None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:51.406375 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c0787-2d35-4fe3-b240-6489183ab23b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:51.406864 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c0787-2d35-4fe3-b240-6489183ab23b None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:51.409104 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 12/22] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:02:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:02:51.414613 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157ffc6-329a-485f-adbf-1f2b881391cd None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:51.415450 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157ffc6-329a-485f-adbf-1f2b881391cd None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:51.416023 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157ffc6-329a-485f-adbf-1f2b881391cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:51.428119 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG passlib.handlers.bcrypt [None req-0167c496-f753-4bab-87c7-b8bec60760f8 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79313) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 10 23:02:51.428537 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG passlib.handlers.bcrypt [None req-0167c496-f753-4bab-87c7-b8bec60760f8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79313) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 10 23:02:51.439257 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-9157ffc6-329a-485f-adbf-1f2b881391cd None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:02:51.444849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-9157ffc6-329a-485f-adbf-1f2b881391cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:02:51.457900 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 13/23] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:02:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:02:51.476178 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-0167c496-f753-4bab-87c7-b8bec60760f8 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:02:51.478770 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-0167c496-f753-4bab-87c7-b8bec60760f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:02:51.501456 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157ffc6-329a-485f-adbf-1f2b881391cd None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:51.510115 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 11/24] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:02:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:02:51.517080 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157ffc6-329a-485f-adbf-1f2b881391cd None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:51.527734 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648f28b-4337-43c4-9e73-11a59ff54413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:51.528818 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648f28b-4337-43c4-9e73-11a59ff54413 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:51.529302 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648f28b-4337-43c4-9e73-11a59ff54413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:51.529794 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648f28b-4337-43c4-9e73-11a59ff54413 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:51.545596 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167c496-f753-4bab-87c7-b8bec60760f8 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:51.546158 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648f28b-4337-43c4-9e73-11a59ff54413 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:51.548182 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648f28b-4337-43c4-9e73-11a59ff54413 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:51.560075 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167c496-f753-4bab-87c7-b8bec60760f8 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:51.572465 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-1648f28b-4337-43c4-9e73-11a59ff54413 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:02:51.574518 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 14/25] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:02:51.574828 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486adddd-ddaa-4a47-a833-f102ee9fedc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:51.576273 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486adddd-ddaa-4a47-a833-f102ee9fedc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:51.576718 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486adddd-ddaa-4a47-a833-f102ee9fedc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:51.577146 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486adddd-ddaa-4a47-a833-f102ee9fedc6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:51.580129 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648f28b-4337-43c4-9e73-11a59ff54413 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:51.591002 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648f28b-4337-43c4-9e73-11a59ff54413 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:51.600035 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba722938-c013-4a7f-aa99-d7d4dd6ff223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:51.600893 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba722938-c013-4a7f-aa99-d7d4dd6ff223 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:51.601391 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba722938-c013-4a7f-aa99-d7d4dd6ff223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:51.602275 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486adddd-ddaa-4a47-a833-f102ee9fedc6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:02:51.602732 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba722938-c013-4a7f-aa99-d7d4dd6ff223 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:51.603611 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba722938-c013-4a7f-aa99-d7d4dd6ff223 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:02:51.607849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba722938-c013-4a7f-aa99-d7d4dd6ff223 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:51.607849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING py.warnings [None req-ba722938-c013-4a7f-aa99-d7d4dd6ff223 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:02:51.607849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: warnings.warn(msg) Feb 10 23:02:51.607849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: Feb 10 23:02:51.607849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba722938-c013-4a7f-aa99-d7d4dd6ff223 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:51.614461 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-486adddd-ddaa-4a47-a833-f102ee9fedc6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:02:51.616253 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 12/26] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:02:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:02:51.621882 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486adddd-ddaa-4a47-a833-f102ee9fedc6 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:51.637552 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486adddd-ddaa-4a47-a833-f102ee9fedc6 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:51.639303 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 15/27] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:02:51.643772 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12158b-e43b-4f1a-9044-6d9918430618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:51.644614 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba722938-c013-4a7f-aa99-d7d4dd6ff223 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:51.644916 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12158b-e43b-4f1a-9044-6d9918430618 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:51.645538 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12158b-e43b-4f1a-9044-6d9918430618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:51.646020 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12158b-e43b-4f1a-9044-6d9918430618 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:51.647007 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12158b-e43b-4f1a-9044-6d9918430618 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:02:51.647510 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12158b-e43b-4f1a-9044-6d9918430618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:51.650052 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12158b-e43b-4f1a-9044-6d9918430618 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:51.658002 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba722938-c013-4a7f-aa99-d7d4dd6ff223 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:51.660654 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 13/28] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:02:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:02:51.662274 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e823798-52d8-4034-9c59-d3862df4c26b None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:51.662755 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e823798-52d8-4034-9c59-d3862df4c26b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:51.663501 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e823798-52d8-4034-9c59-d3862df4c26b None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:51.666506 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 14/29] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:02:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:02:51.667426 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e823798-52d8-4034-9c59-d3862df4c26b None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:51.668698 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30decb4-5f9b-4123-9f9a-1b249bd9e738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:51.669361 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30decb4-5f9b-4123-9f9a-1b249bd9e738 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:51.669645 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30decb4-5f9b-4123-9f9a-1b249bd9e738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:51.669922 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30decb4-5f9b-4123-9f9a-1b249bd9e738 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:51.670763 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30decb4-5f9b-4123-9f9a-1b249bd9e738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:51.671988 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING py.warnings [None req-e30decb4-5f9b-4123-9f9a-1b249bd9e738 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:02:51.671988 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: warnings.warn(msg) Feb 10 23:02:51.671988 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: Feb 10 23:02:51.676169 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30decb4-5f9b-4123-9f9a-1b249bd9e738 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:51.696323 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e823798-52d8-4034-9c59-d3862df4c26b None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:51.706458 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f73bba-66bc-4ef9-b190-86d209fccbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:51.707609 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f73bba-66bc-4ef9-b190-86d209fccbbb admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:51.707970 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f73bba-66bc-4ef9-b190-86d209fccbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:51.712387 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f73bba-66bc-4ef9-b190-86d209fccbbb admin admin] PATH_INFO: `/v3/users/93804c035bb74a079b9cb29e5d154621` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:51.714299 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f73bba-66bc-4ef9-b190-86d209fccbbb admin admin] RBAC: Authorizing `identity:get_user(user_id=93804c035bb74a079b9cb29e5d154621)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:51.716178 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f73bba-66bc-4ef9-b190-86d209fccbbb admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:51.718423 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 15/30] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:02:51 2022] GET /identity/v3/users/93804c035bb74a079b9cb29e5d154621 => generated 247 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:02:51.719658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219df4d-5a20-43e5-8953-590be97aa3bd None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:51.719956 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219df4d-5a20-43e5-8953-590be97aa3bd None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:51.720244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219df4d-5a20-43e5-8953-590be97aa3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:51.765068 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-a219df4d-5a20-43e5-8953-590be97aa3bd None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:02:51.766270 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a219df4d-5a20-43e5-8953-590be97aa3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:02:51.783991 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 16/31] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:02:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:02:51.784864 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219df4d-5a20-43e5-8953-590be97aa3bd None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:51.797713 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219df4d-5a20-43e5-8953-590be97aa3bd None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:51.814054 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532079fb-083e-4d98-9501-6303134b8a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:51.816432 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532079fb-083e-4d98-9501-6303134b8a54 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:51.816931 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532079fb-083e-4d98-9501-6303134b8a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:51.817940 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532079fb-083e-4d98-9501-6303134b8a54 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:51.820938 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532079fb-083e-4d98-9501-6303134b8a54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:51.827028 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532079fb-083e-4d98-9501-6303134b8a54 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:51.830648 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 17/32] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:02:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:02:51.832332 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532079fb-083e-4d98-9501-6303134b8a54 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:51.852847 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532079fb-083e-4d98-9501-6303134b8a54 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:51.864514 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d2168-b27c-401c-9044-f464baa64ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:51.865400 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d2168-b27c-401c-9044-f464baa64ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:51.865936 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d2168-b27c-401c-9044-f464baa64ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:51.866410 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d2168-b27c-401c-9044-f464baa64ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:51.868458 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d2168-b27c-401c-9044-f464baa64ba2 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:51.870148 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING py.warnings [None req-ca3d2168-b27c-401c-9044-f464baa64ba2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:02:51.870148 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: warnings.warn(msg) Feb 10 23:02:51.870148 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: Feb 10 23:02:51.872796 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d2168-b27c-401c-9044-f464baa64ba2 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:51.881101 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 16/33] 10.222.0.77 () {60 vars in 1162 bytes} [Thu Feb 10 23:02:51 2022] POST /identity/v3/projects => generated 301 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:02:51.882343 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30decb4-5f9b-4123-9f9a-1b249bd9e738 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:51.992824 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30decb4-5f9b-4123-9f9a-1b249bd9e738 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:51.998474 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dd839-ae25-415c-848b-d992541e6e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:51.999733 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dd839-ae25-415c-848b-d992541e6e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:52.000265 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dd839-ae25-415c-848b-d992541e6e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:52.000871 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dd839-ae25-415c-848b-d992541e6e86 admin admin] PATH_INFO: `/v3/domains/default/users/93804c035bb74a079b9cb29e5d154621/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:52.006915 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dd839-ae25-415c-848b-d992541e6e86 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=93804c035bb74a079b9cb29e5d154621, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:52.013400 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING py.warnings [None req-181dd839-ae25-415c-848b-d992541e6e86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:02:52.013400 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: warnings.warn(msg) Feb 10 23:02:52.013400 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: Feb 10 23:02:52.019002 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dd839-ae25-415c-848b-d992541e6e86 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:52.057980 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 17/34] 10.222.0.77 () {58 vars in 1382 bytes} [Thu Feb 10 23:02:51 2022] PUT /identity/v3/domains/default/users/93804c035bb74a079b9cb29e5d154621/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:02:52.082633 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 18/35] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:02:51 2022] POST /identity/v3/roles => generated 219 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:02:52.111092 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b775cd8-9e30-470a-819d-e4ced5d264b6 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:52.111643 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b775cd8-9e30-470a-819d-e4ced5d264b6 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:52.112108 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b775cd8-9e30-470a-819d-e4ced5d264b6 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:52.114166 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 18/36] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:02:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:02:52.121056 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc0599-7045-4c32-a335-782fcff3fd86 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:52.121394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc0599-7045-4c32-a335-782fcff3fd86 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:52.121616 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc0599-7045-4c32-a335-782fcff3fd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:52.150758 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-24dc0599-7045-4c32-a335-782fcff3fd86 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:02:52.152427 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-24dc0599-7045-4c32-a335-782fcff3fd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:02:52.246762 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 19/37] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:02:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:02:52.292664 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b775cd8-9e30-470a-819d-e4ced5d264b6 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:52.313830 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b775cd8-9e30-470a-819d-e4ced5d264b6 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:52.325333 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50575ed0-7237-4c4a-a15f-1743ce0c8871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:52.326304 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50575ed0-7237-4c4a-a15f-1743ce0c8871 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:52.326738 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50575ed0-7237-4c4a-a15f-1743ce0c8871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:52.327163 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50575ed0-7237-4c4a-a15f-1743ce0c8871 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:52.328144 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50575ed0-7237-4c4a-a15f-1743ce0c8871 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:52.329461 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING py.warnings [None req-50575ed0-7237-4c4a-a15f-1743ce0c8871 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:02:52.329461 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: warnings.warn(msg) Feb 10 23:02:52.329461 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: Feb 10 23:02:52.330708 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50575ed0-7237-4c4a-a15f-1743ce0c8871 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:52.360098 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 19/38] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:02:52 2022] POST /identity/v3/roles => generated 225 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:02:52.916652 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08282f-41b7-4964-9863-d5eb7a494f71 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:52.917202 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08282f-41b7-4964-9863-d5eb7a494f71 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:52.917202 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08282f-41b7-4964-9863-d5eb7a494f71 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:52.919018 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 20/39] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:02:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:02:52.924377 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd227f-88d4-4428-b669-2609ad4c37e4 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:52.924755 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd227f-88d4-4428-b669-2609ad4c37e4 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:52.924947 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd227f-88d4-4428-b669-2609ad4c37e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:52.943424 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-1cbd227f-88d4-4428-b669-2609ad4c37e4 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:02:52.944984 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-1cbd227f-88d4-4428-b669-2609ad4c37e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:02:52.953358 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 20/40] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:02:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:02:52.976470 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08282f-41b7-4964-9863-d5eb7a494f71 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:52.990076 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08282f-41b7-4964-9863-d5eb7a494f71 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:52.995245 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbbb62-ba67-4121-9b7b-76d9b2527260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:52.995970 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbbb62-ba67-4121-9b7b-76d9b2527260 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:52.996266 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbbb62-ba67-4121-9b7b-76d9b2527260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:52.996540 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbbb62-ba67-4121-9b7b-76d9b2527260 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:52.997328 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbbb62-ba67-4121-9b7b-76d9b2527260 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:52.999161 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbbb62-ba67-4121-9b7b-76d9b2527260 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:53.014508 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 21/41] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:02:52 2022] POST /identity/v3/roles => generated 223 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:02:53.173601 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d150ad-919e-46d6-b39a-1b8f46341a4d None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:53.173901 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d150ad-919e-46d6-b39a-1b8f46341a4d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:53.174090 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d150ad-919e-46d6-b39a-1b8f46341a4d None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:53.175884 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 21/42] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:02:53.182234 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddc74a-d11d-4d42-9f6a-a44c63293207 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:53.182528 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddc74a-d11d-4d42-9f6a-a44c63293207 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:53.182887 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddc74a-d11d-4d42-9f6a-a44c63293207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:53.201800 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-71ddc74a-d11d-4d42-9f6a-a44c63293207 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:02:53.202983 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-71ddc74a-d11d-4d42-9f6a-a44c63293207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:02:53.211256 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 22/43] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:02:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:02:53.235947 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d150ad-919e-46d6-b39a-1b8f46341a4d None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:53.248966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d150ad-919e-46d6-b39a-1b8f46341a4d None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:53.253095 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e55057-39d1-4e6d-ad7b-f27c650fd00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:53.253871 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e55057-39d1-4e6d-ad7b-f27c650fd00e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:53.254153 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e55057-39d1-4e6d-ad7b-f27c650fd00e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:53.254424 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e55057-39d1-4e6d-ad7b-f27c650fd00e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:53.255589 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e55057-39d1-4e6d-ad7b-f27c650fd00e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:53.257341 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e55057-39d1-4e6d-ad7b-f27c650fd00e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:53.258950 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 22/44] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:02:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:02:53.264570 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddc74a-d11d-4d42-9f6a-a44c63293207 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:53.274112 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddc74a-d11d-4d42-9f6a-a44c63293207 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:53.278570 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d08a02-1a23-4c6a-95cc-e35e2ec1a12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:53.279219 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d08a02-1a23-4c6a-95cc-e35e2ec1a12c admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:53.279502 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d08a02-1a23-4c6a-95cc-e35e2ec1a12c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:53.279777 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d08a02-1a23-4c6a-95cc-e35e2ec1a12c admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:53.280538 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d08a02-1a23-4c6a-95cc-e35e2ec1a12c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:53.281537 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING py.warnings [None req-d1d08a02-1a23-4c6a-95cc-e35e2ec1a12c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:02:53.281537 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: warnings.warn(msg) Feb 10 23:02:53.281537 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: Feb 10 23:02:53.282744 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d08a02-1a23-4c6a-95cc-e35e2ec1a12c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:53.309266 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 23/45] 10.222.0.77 () {60 vars in 1162 bytes} [Thu Feb 10 23:02:53 2022] POST /identity/v3/projects => generated 312 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:02:54.533011 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fcf7d-bf89-45b3-b64f-2619ce78a9f1 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:54.533565 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fcf7d-bf89-45b3-b64f-2619ce78a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:54.533565 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fcf7d-bf89-45b3-b64f-2619ce78a9f1 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:54.535323 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 23/46] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:02:54.541576 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058f67a-8f8c-4e33-8cc4-755d41424b5a None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:54.542010 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058f67a-8f8c-4e33-8cc4-755d41424b5a None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:54.542125 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058f67a-8f8c-4e33-8cc4-755d41424b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:54.559349 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-a058f67a-8f8c-4e33-8cc4-755d41424b5a None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:02:54.560547 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a058f67a-8f8c-4e33-8cc4-755d41424b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:02:54.615167 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 24/47] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:02:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:02:54.637680 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fcf7d-bf89-45b3-b64f-2619ce78a9f1 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:54.650179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fcf7d-bf89-45b3-b64f-2619ce78a9f1 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:54.654348 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c659c3e-9ec4-4ada-a01b-944a451fc3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:54.655124 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c659c3e-9ec4-4ada-a01b-944a451fc3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:54.655412 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c659c3e-9ec4-4ada-a01b-944a451fc3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:54.655692 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c659c3e-9ec4-4ada-a01b-944a451fc3d2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:54.668717 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c659c3e-9ec4-4ada-a01b-944a451fc3d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:02:54.675511 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-6c659c3e-9ec4-4ada-a01b-944a451fc3d2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:02:54.676700 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 24/48] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:02:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:02:54.682387 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058f67a-8f8c-4e33-8cc4-755d41424b5a None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:54.690981 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058f67a-8f8c-4e33-8cc4-755d41424b5a None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:54.695286 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73d359-1fe7-4fa2-b2b2-c7971e6de436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:54.695963 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73d359-1fe7-4fa2-b2b2-c7971e6de436 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:54.696248 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73d359-1fe7-4fa2-b2b2-c7971e6de436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:54.696522 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73d359-1fe7-4fa2-b2b2-c7971e6de436 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:54.697278 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73d359-1fe7-4fa2-b2b2-c7971e6de436 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:02:54.697580 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73d359-1fe7-4fa2-b2b2-c7971e6de436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:54.699180 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73d359-1fe7-4fa2-b2b2-c7971e6de436 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:54.707238 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 25/49] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:02:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:02:54.712889 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c659c3e-9ec4-4ada-a01b-944a451fc3d2 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:54.722361 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c659c3e-9ec4-4ada-a01b-944a451fc3d2 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:54.727272 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ac6d6-441b-48fc-9ac7-748d68b33706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:54.728155 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ac6d6-441b-48fc-9ac7-748d68b33706 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:54.728474 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ac6d6-441b-48fc-9ac7-748d68b33706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:54.728757 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ac6d6-441b-48fc-9ac7-748d68b33706 admin admin] PATH_INFO: `/v3/users/93804c035bb74a079b9cb29e5d154621` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:54.729988 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ac6d6-441b-48fc-9ac7-748d68b33706 admin admin] RBAC: Authorizing `identity:get_user(user_id=93804c035bb74a079b9cb29e5d154621)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:54.731809 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ac6d6-441b-48fc-9ac7-748d68b33706 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:54.733390 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 25/50] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:02:54 2022] GET /identity/v3/users/93804c035bb74a079b9cb29e5d154621 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:02:54.738653 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73d359-1fe7-4fa2-b2b2-c7971e6de436 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:54.748669 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73d359-1fe7-4fa2-b2b2-c7971e6de436 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:54.753010 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbaee0c-ed86-4da5-8740-7d3b6ba5ddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:54.753780 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbaee0c-ed86-4da5-8740-7d3b6ba5ddb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:54.754069 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbaee0c-ed86-4da5-8740-7d3b6ba5ddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:54.754349 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbaee0c-ed86-4da5-8740-7d3b6ba5ddb2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:54.755538 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbaee0c-ed86-4da5-8740-7d3b6ba5ddb2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:54.757279 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbaee0c-ed86-4da5-8740-7d3b6ba5ddb2 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:54.759632 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 26/51] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:02:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:02:54.765202 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ac6d6-441b-48fc-9ac7-748d68b33706 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:54.774768 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ac6d6-441b-48fc-9ac7-748d68b33706 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:54.779084 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef7ec3-3bd9-4c33-aff0-50f7b5c34594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:54.779713 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef7ec3-3bd9-4c33-aff0-50f7b5c34594 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:54.780100 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef7ec3-3bd9-4c33-aff0-50f7b5c34594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:54.780385 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef7ec3-3bd9-4c33-aff0-50f7b5c34594 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:54.781219 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef7ec3-3bd9-4c33-aff0-50f7b5c34594 admin admin] RBAC: Adding query filter params (role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f, scope.domain.id=default, user.id=93804c035bb74a079b9cb29e5d154621) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:02:54.781532 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef7ec3-3bd9-4c33-aff0-50f7b5c34594 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:54.782528 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING py.warnings [None req-cbef7ec3-3bd9-4c33-aff0-50f7b5c34594 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:02:54.782528 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: warnings.warn(msg) Feb 10 23:02:54.782528 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: Feb 10 23:02:54.783729 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef7ec3-3bd9-4c33-aff0-50f7b5c34594 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:54.790565 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 26/52] 10.222.0.77 () {56 vars in 1343 bytes} [Thu Feb 10 23:02:54 2022] GET /identity/v3/role_assignments?user.id=93804c035bb74a079b9cb29e5d154621&scope.domain.id=default&role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:02:55.532084 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c83298-4ca3-47e1-8df7-aac10c385ab8 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:55.532373 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c83298-4ca3-47e1-8df7-aac10c385ab8 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:55.532654 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c83298-4ca3-47e1-8df7-aac10c385ab8 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:55.534436 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 27/53] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:02:55.539881 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda4e5-5dee-4e90-a1eb-5ba6ec609b9b None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:55.540356 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda4e5-5dee-4e90-a1eb-5ba6ec609b9b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:55.540447 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda4e5-5dee-4e90-a1eb-5ba6ec609b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:55.558236 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-01fda4e5-5dee-4e90-a1eb-5ba6ec609b9b None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:02:55.559406 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-01fda4e5-5dee-4e90-a1eb-5ba6ec609b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:02:55.566682 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 27/54] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:02:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:02:55.589444 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c83298-4ca3-47e1-8df7-aac10c385ab8 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:55.601156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c83298-4ca3-47e1-8df7-aac10c385ab8 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:55.605954 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c7a53-b1c2-4b02-b296-b9966fe917b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:55.606711 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c7a53-b1c2-4b02-b296-b9966fe917b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:55.606997 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c7a53-b1c2-4b02-b296-b9966fe917b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:55.607274 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c7a53-b1c2-4b02-b296-b9966fe917b5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:55.608494 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c7a53-b1c2-4b02-b296-b9966fe917b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:55.610180 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c7a53-b1c2-4b02-b296-b9966fe917b5 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:55.611999 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 28/55] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:02:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:02:55.617502 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fda4e5-5dee-4e90-a1eb-5ba6ec609b9b None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:55.626077 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fda4e5-5dee-4e90-a1eb-5ba6ec609b9b None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:55.630336 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b34f9-5370-4579-928d-a096ab1d88d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:55.630962 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b34f9-5370-4579-928d-a096ab1d88d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:55.631246 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b34f9-5370-4579-928d-a096ab1d88d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:55.631520 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b34f9-5370-4579-928d-a096ab1d88d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:55.632264 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b34f9-5370-4579-928d-a096ab1d88d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:55.634209 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b34f9-5370-4579-928d-a096ab1d88d0 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:55.657387 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 28/56] 10.222.0.77 () {60 vars in 1161 bytes} [Thu Feb 10 23:02:55 2022] POST /identity/v3/projects => generated 298 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:02:57.900772 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd5ae7-3b29-4414-9aaf-ef907b0e1e53 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:57.901324 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd5ae7-3b29-4414-9aaf-ef907b0e1e53 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:57.901324 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd5ae7-3b29-4414-9aaf-ef907b0e1e53 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:57.903128 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 29/57] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:02:57.908415 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384bf50-e274-448a-a5ea-22437ef98659 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:57.908812 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384bf50-e274-448a-a5ea-22437ef98659 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:57.908977 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384bf50-e274-448a-a5ea-22437ef98659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:57.926725 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-1384bf50-e274-448a-a5ea-22437ef98659 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:02:57.927936 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-1384bf50-e274-448a-a5ea-22437ef98659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:02:57.982844 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 29/58] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:02:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:02:58.007761 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd5ae7-3b29-4414-9aaf-ef907b0e1e53 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:58.020184 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd5ae7-3b29-4414-9aaf-ef907b0e1e53 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:58.024455 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d80a0-4b27-4c99-97e2-859e39db0072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:58.025229 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d80a0-4b27-4c99-97e2-859e39db0072 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:58.025520 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d80a0-4b27-4c99-97e2-859e39db0072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:58.025801 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d80a0-4b27-4c99-97e2-859e39db0072 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:58.027005 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d80a0-4b27-4c99-97e2-859e39db0072 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:58.028736 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d80a0-4b27-4c99-97e2-859e39db0072 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:58.030307 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 30/59] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:02:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:02:58.035465 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384bf50-e274-448a-a5ea-22437ef98659 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:02:58.044765 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384bf50-e274-448a-a5ea-22437ef98659 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:02:58.049113 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee82e05-3a04-497a-ae39-059aa9fb3edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:02:58.049766 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee82e05-3a04-497a-ae39-059aa9fb3edd admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:02:58.050054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee82e05-3a04-497a-ae39-059aa9fb3edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:02:58.050335 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee82e05-3a04-497a-ae39-059aa9fb3edd admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:02:58.051055 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee82e05-3a04-497a-ae39-059aa9fb3edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:02:58.052095 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING py.warnings [None req-1ee82e05-3a04-497a-ae39-059aa9fb3edd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:02:58.052095 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: warnings.warn(msg) Feb 10 23:02:58.052095 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: Feb 10 23:02:58.053316 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee82e05-3a04-497a-ae39-059aa9fb3edd admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:02:58.078230 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 30/60] 10.222.0.77 () {60 vars in 1153 bytes} [Thu Feb 10 23:02:58 2022] POST /identity/v3/users => generated 275 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:03:01.531011 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4354b-4c1b-494d-ad7c-6aa2c77d871b None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:01.532103 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4354b-4c1b-494d-ad7c-6aa2c77d871b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:01.532624 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4354b-4c1b-494d-ad7c-6aa2c77d871b None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:01.534625 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 31/61] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:01.540737 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015d527-1eac-431f-a874-ed534fb47e84 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:01.541577 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015d527-1eac-431f-a874-ed534fb47e84 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:01.542079 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015d527-1eac-431f-a874-ed534fb47e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:01.545492 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0736ff7-140a-4428-903b-6d218ca15ad0 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:01.546037 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0736ff7-140a-4428-903b-6d218ca15ad0 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:01.547138 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0736ff7-140a-4428-903b-6d218ca15ad0 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:01.551731 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 32/62] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:01.557668 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a58a0-3f16-4ba9-86f0-7d35451aaadb None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:01.558211 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a58a0-3f16-4ba9-86f0-7d35451aaadb None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:01.558715 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a58a0-3f16-4ba9-86f0-7d35451aaadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:01.581258 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-3015d527-1eac-431f-a874-ed534fb47e84 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:01.582856 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-3015d527-1eac-431f-a874-ed534fb47e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:01.592661 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-9c9a58a0-3f16-4ba9-86f0-7d35451aaadb None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:01.593863 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-9c9a58a0-3f16-4ba9-86f0-7d35451aaadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:01.610106 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 31/63] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:01.622287 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 33/64] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:01.648951 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ca092-0625-42ef-a68d-0e7b42b1c516 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:01.649736 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ca092-0625-42ef-a68d-0e7b42b1c516 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:01.650225 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ca092-0625-42ef-a68d-0e7b42b1c516 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:01.652527 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 32/65] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:01.658208 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9a682-cfa2-46ee-aa3c-ea2b28b68e00 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:01.658774 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9a682-cfa2-46ee-aa3c-ea2b28b68e00 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:01.659068 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9a682-cfa2-46ee-aa3c-ea2b28b68e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:01.669631 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ca092-0625-42ef-a68d-0e7b42b1c516 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:01.684722 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ca092-0625-42ef-a68d-0e7b42b1c516 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:01.695620 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99b20e-e708-41b5-8954-4f6f1ac1d6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:01.696813 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99b20e-e708-41b5-8954-4f6f1ac1d6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:01.697309 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99b20e-e708-41b5-8954-4f6f1ac1d6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:01.697792 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99b20e-e708-41b5-8954-4f6f1ac1d6c0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:01.709415 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-a6e9a682-cfa2-46ee-aa3c-ea2b28b68e00 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:01.711368 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a6e9a682-cfa2-46ee-aa3c-ea2b28b68e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:01.712072 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99b20e-e708-41b5-8954-4f6f1ac1d6c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:01.719243 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-1e99b20e-e708-41b5-8954-4f6f1ac1d6c0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:03:01.720822 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 33/66] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:03:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:01.721832 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99b20e-e708-41b5-8954-4f6f1ac1d6c0 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:01.736436 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99b20e-e708-41b5-8954-4f6f1ac1d6c0 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:01.743848 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 34/67] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:01.743848 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9a682-cfa2-46ee-aa3c-ea2b28b68e00 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:01.757038 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da4080-17e8-43ea-a598-4989630a72cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:01.758891 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da4080-17e8-43ea-a598-4989630a72cf admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:01.759401 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da4080-17e8-43ea-a598-4989630a72cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:01.759931 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da4080-17e8-43ea-a598-4989630a72cf admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:01.771999 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9a682-cfa2-46ee-aa3c-ea2b28b68e00 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:01.781569 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da4080-17e8-43ea-a598-4989630a72cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:01.789381 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-f3da4080-17e8-43ea-a598-4989630a72cf admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 23:03:01.791102 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 34/68] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:01.795691 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb68824-c722-4cbf-be65-363cd9afc480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:01.795691 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb68824-c722-4cbf-be65-363cd9afc480 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:01.795691 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb68824-c722-4cbf-be65-363cd9afc480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:01.795691 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb68824-c722-4cbf-be65-363cd9afc480 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:01.796054 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb68824-c722-4cbf-be65-363cd9afc480 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:01.796054 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb68824-c722-4cbf-be65-363cd9afc480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:01.797210 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da4080-17e8-43ea-a598-4989630a72cf admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:01.798706 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb68824-c722-4cbf-be65-363cd9afc480 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:01.813033 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da4080-17e8-43ea-a598-4989630a72cf admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:01.814544 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 35/69] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:01.815610 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb68824-c722-4cbf-be65-363cd9afc480 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:01.829308 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb68824-c722-4cbf-be65-363cd9afc480 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:01.832938 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd76f2-d117-4716-a462-ff2c1319c143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:01.833756 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd76f2-d117-4716-a462-ff2c1319c143 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:01.834026 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd76f2-d117-4716-a462-ff2c1319c143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:01.834302 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd76f2-d117-4716-a462-ff2c1319c143 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:01.836129 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e82ee-52da-4c3d-a5f5-6312eea48bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:01.837266 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e82ee-52da-4c3d-a5f5-6312eea48bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:01.837771 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e82ee-52da-4c3d-a5f5-6312eea48bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:01.838582 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e82ee-52da-4c3d-a5f5-6312eea48bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:01.839559 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e82ee-52da-4c3d-a5f5-6312eea48bc0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:01.840093 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e82ee-52da-4c3d-a5f5-6312eea48bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:01.842251 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e82ee-52da-4c3d-a5f5-6312eea48bc0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:01.857615 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd76f2-d117-4716-a462-ff2c1319c143 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:01.858065 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 36/70] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:01.859145 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e82ee-52da-4c3d-a5f5-6312eea48bc0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:01.864875 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-47dd76f2-d117-4716-a462-ff2c1319c143 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 23:03:01.868636 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 35/71] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:03:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:01.868636 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd76f2-d117-4716-a462-ff2c1319c143 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:01.873039 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e82ee-52da-4c3d-a5f5-6312eea48bc0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:01.877524 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb822bf-f67a-4be9-9f12-09b26daf7f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:01.878387 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb822bf-f67a-4be9-9f12-09b26daf7f37 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:01.878670 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb822bf-f67a-4be9-9f12-09b26daf7f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:01.878965 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb822bf-f67a-4be9-9f12-09b26daf7f37 admin admin] PATH_INFO: `/v3/users/93804c035bb74a079b9cb29e5d154621` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:01.880240 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb822bf-f67a-4be9-9f12-09b26daf7f37 admin admin] RBAC: Authorizing `identity:get_user(user_id=93804c035bb74a079b9cb29e5d154621)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:01.882819 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb822bf-f67a-4be9-9f12-09b26daf7f37 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:01.888849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 37/72] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:01 2022] GET /identity/v3/users/93804c035bb74a079b9cb29e5d154621 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:01.889730 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb822bf-f67a-4be9-9f12-09b26daf7f37 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:01.892519 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd76f2-d117-4716-a462-ff2c1319c143 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:01.899888 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb822bf-f67a-4be9-9f12-09b26daf7f37 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:01.904449 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a201e4-2b37-471e-aa58-7843f9c1c6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:01.905160 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a201e4-2b37-471e-aa58-7843f9c1c6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:01.905450 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a201e4-2b37-471e-aa58-7843f9c1c6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:01.905762 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a201e4-2b37-471e-aa58-7843f9c1c6b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:01.906544 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a201e4-2b37-471e-aa58-7843f9c1c6b8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:01.906843 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a201e4-2b37-471e-aa58-7843f9c1c6b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:01.908476 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a201e4-2b37-471e-aa58-7843f9c1c6b8 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:01.909542 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e64b2-3add-488c-9f57-4288bbf43fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:01.911646 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e64b2-3add-488c-9f57-4288bbf43fae admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:01.914216 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e64b2-3add-488c-9f57-4288bbf43fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:01.916166 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e64b2-3add-488c-9f57-4288bbf43fae admin admin] PATH_INFO: `/v3/users/e90634c2f9fb4792963d0551248329a4` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:01.918874 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 38/73] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:01.919696 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a201e4-2b37-471e-aa58-7843f9c1c6b8 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:01.934764 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a201e4-2b37-471e-aa58-7843f9c1c6b8 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:01.939490 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26571325-2459-43de-b349-52b24faf8060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:01.940169 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26571325-2459-43de-b349-52b24faf8060 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:01.940452 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26571325-2459-43de-b349-52b24faf8060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:01.940728 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26571325-2459-43de-b349-52b24faf8060 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:01.950715 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26571325-2459-43de-b349-52b24faf8060 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:01.952516 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26571325-2459-43de-b349-52b24faf8060 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:01.954688 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e64b2-3add-488c-9f57-4288bbf43fae admin admin] RBAC: Authorizing `identity:get_user(user_id=e90634c2f9fb4792963d0551248329a4)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:01.957100 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e64b2-3add-488c-9f57-4288bbf43fae admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:01.959352 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 36/74] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:01 2022] GET /identity/v3/users/e90634c2f9fb4792963d0551248329a4 => generated 275 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:01.961071 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e64b2-3add-488c-9f57-4288bbf43fae admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:01.962460 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 39/75] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:01.968177 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e16228-d84a-47b6-a2ab-a5b2308f5d3a None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:01.968469 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e16228-d84a-47b6-a2ab-a5b2308f5d3a None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:01.968747 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e16228-d84a-47b6-a2ab-a5b2308f5d3a None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:01.974738 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 40/76] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:01.974738 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e16228-d84a-47b6-a2ab-a5b2308f5d3a None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:01.980934 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e64b2-3add-488c-9f57-4288bbf43fae admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:01.986311 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb517c19-0a0f-4959-9e2c-72af05466398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:01.986827 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e16228-d84a-47b6-a2ab-a5b2308f5d3a None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:01.987852 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb517c19-0a0f-4959-9e2c-72af05466398 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:01.988345 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb517c19-0a0f-4959-9e2c-72af05466398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:01.988823 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb517c19-0a0f-4959-9e2c-72af05466398 admin admin] PATH_INFO: `/v3/users/e90634c2f9fb4792963d0551248329a4` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:01.990300 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb517c19-0a0f-4959-9e2c-72af05466398 admin admin] RBAC: Authorizing `identity:get_user(user_id=e90634c2f9fb4792963d0551248329a4)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:01.992458 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef429b0-b09d-421f-80dc-141fb6d7b414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:01.993235 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef429b0-b09d-421f-80dc-141fb6d7b414 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:01.993515 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef429b0-b09d-421f-80dc-141fb6d7b414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:01.993883 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef429b0-b09d-421f-80dc-141fb6d7b414 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:01.994601 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb517c19-0a0f-4959-9e2c-72af05466398 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:01.996983 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 37/77] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:01 2022] GET /identity/v3/users/e90634c2f9fb4792963d0551248329a4 => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:01.998102 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb517c19-0a0f-4959-9e2c-72af05466398 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:02.008825 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef429b0-b09d-421f-80dc-141fb6d7b414 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:02.009616 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb517c19-0a0f-4959-9e2c-72af05466398 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:02.010576 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef429b0-b09d-421f-80dc-141fb6d7b414 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:02.014565 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710cf2d-7750-4025-a79c-8555967dba8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:02.015652 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710cf2d-7750-4025-a79c-8555967dba8f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:02.016187 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710cf2d-7750-4025-a79c-8555967dba8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:02.016662 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710cf2d-7750-4025-a79c-8555967dba8f admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:02.018053 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710cf2d-7750-4025-a79c-8555967dba8f admin admin] RBAC: Authorizing `identity:get_project(project_id=ff1d62262d6348b39c63a74a5afe64bd)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:02.020365 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 41/78] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:02.020713 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710cf2d-7750-4025-a79c-8555967dba8f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:02.021721 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f4665-88ce-4598-acf6-ec62c8f94aae None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:02.022013 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f4665-88ce-4598-acf6-ec62c8f94aae None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:02.022286 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f4665-88ce-4598-acf6-ec62c8f94aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:02.023522 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 38/79] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:01 2022] GET /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:02.024827 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710cf2d-7750-4025-a79c-8555967dba8f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:02.036758 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710cf2d-7750-4025-a79c-8555967dba8f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:02.043190 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7295301-7a39-488b-8993-ec6972979b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:02.044442 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7295301-7a39-488b-8993-ec6972979b79 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:02.045259 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7295301-7a39-488b-8993-ec6972979b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:02.046091 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7295301-7a39-488b-8993-ec6972979b79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:02.046425 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-3c9f4665-88ce-4598-acf6-ec62c8f94aae None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:02.047604 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-3c9f4665-88ce-4598-acf6-ec62c8f94aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:02.057462 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 42/80] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:02.058335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f4665-88ce-4598-acf6-ec62c8f94aae None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:02.063893 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7295301-7a39-488b-8993-ec6972979b79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:02.063893 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7295301-7a39-488b-8993-ec6972979b79 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:02.067696 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f4665-88ce-4598-acf6-ec62c8f94aae None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:02.074220 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0720758-2a99-46c4-9bc3-d7b37fea4b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:02.075765 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0720758-2a99-46c4-9bc3-d7b37fea4b51 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:02.076084 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0720758-2a99-46c4-9bc3-d7b37fea4b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:02.076360 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0720758-2a99-46c4-9bc3-d7b37fea4b51 admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:02.079146 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0720758-2a99-46c4-9bc3-d7b37fea4b51 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff1d62262d6348b39c63a74a5afe64bd)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:02.081240 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0720758-2a99-46c4-9bc3-d7b37fea4b51 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:02.082118 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 39/81] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:02.083167 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7295301-7a39-488b-8993-ec6972979b79 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:02.088600 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 43/82] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:02 2022] GET /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:02.089692 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0720758-2a99-46c4-9bc3-d7b37fea4b51 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:02.097079 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7295301-7a39-488b-8993-ec6972979b79 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:02.102819 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e64faf-71b2-41e1-9248-248d2f660e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:02.102955 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0720758-2a99-46c4-9bc3-d7b37fea4b51 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:02.103956 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e64faf-71b2-41e1-9248-248d2f660e0f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:02.104442 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e64faf-71b2-41e1-9248-248d2f660e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:02.104906 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e64faf-71b2-41e1-9248-248d2f660e0f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:02.105919 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e64faf-71b2-41e1-9248-248d2f660e0f admin admin] RBAC: Adding query filter params (role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f, scope.project.id=ff1d62262d6348b39c63a74a5afe64bd, user.id=93804c035bb74a079b9cb29e5d154621) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:02.106416 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e64faf-71b2-41e1-9248-248d2f660e0f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:02.107335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4dfc9-b788-4390-b48e-1069fdc26095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:02.108149 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4dfc9-b788-4390-b48e-1069fdc26095 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:02.108438 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4dfc9-b788-4390-b48e-1069fdc26095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:02.108714 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4dfc9-b788-4390-b48e-1069fdc26095 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:02.109252 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e64faf-71b2-41e1-9248-248d2f660e0f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:02.115389 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 40/83] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:02 2022] GET /identity/v3/role_assignments?user.id=93804c035bb74a079b9cb29e5d154621&scope.project.id=ff1d62262d6348b39c63a74a5afe64bd&role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:02.116479 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e64faf-71b2-41e1-9248-248d2f660e0f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:02.119737 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4dfc9-b788-4390-b48e-1069fdc26095 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:02.126862 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-e8c4dfc9-b788-4390-b48e-1069fdc26095 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 23:03:02.132874 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 44/84] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:02.132874 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4dfc9-b788-4390-b48e-1069fdc26095 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:02.139622 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e64faf-71b2-41e1-9248-248d2f660e0f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:02.140047 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4dfc9-b788-4390-b48e-1069fdc26095 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:02.144684 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7168126-93c0-46ee-ba7c-5977133490e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:02.145054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca6044-e591-4984-b7b0-f75233e9b0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:02.145358 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7168126-93c0-46ee-ba7c-5977133490e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:02.145646 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7168126-93c0-46ee-ba7c-5977133490e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:02.145923 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7168126-93c0-46ee-ba7c-5977133490e3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:02.146701 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca6044-e591-4984-b7b0-f75233e9b0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:02.146807 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7168126-93c0-46ee-ba7c-5977133490e3 admin admin] RBAC: Adding query filter params (role.id=419ebcf5b1d8470394e463c9f01cb154, scope.project.id=ff1d62262d6348b39c63a74a5afe64bd, user.id=e90634c2f9fb4792963d0551248329a4) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:02.147092 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7168126-93c0-46ee-ba7c-5977133490e3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:02.147445 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca6044-e591-4984-b7b0-f75233e9b0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:02.148595 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca6044-e591-4984-b7b0-f75233e9b0d6 admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:02.149654 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7168126-93c0-46ee-ba7c-5977133490e3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:02.150820 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca6044-e591-4984-b7b0-f75233e9b0d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff1d62262d6348b39c63a74a5afe64bd)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:02.153256 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca6044-e591-4984-b7b0-f75233e9b0d6 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:02.155783 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 41/85] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:02 2022] GET /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:02.156039 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 45/86] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:02 2022] GET /identity/v3/role_assignments?user.id=e90634c2f9fb4792963d0551248329a4&scope.project.id=ff1d62262d6348b39c63a74a5afe64bd&role.id=419ebcf5b1d8470394e463c9f01cb154 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:02.157200 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca6044-e591-4984-b7b0-f75233e9b0d6 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:02.165334 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7168126-93c0-46ee-ba7c-5977133490e3 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:02.169418 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca6044-e591-4984-b7b0-f75233e9b0d6 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:02.174829 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432038e-740d-455e-b790-8895267d946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:02.175888 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432038e-740d-455e-b790-8895267d946c admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:02.176405 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432038e-740d-455e-b790-8895267d946c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:02.176857 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432038e-740d-455e-b790-8895267d946c admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:02.177894 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432038e-740d-455e-b790-8895267d946c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:02.178386 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432038e-740d-455e-b790-8895267d946c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:02.180477 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING py.warnings [None req-5432038e-740d-455e-b790-8895267d946c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:03:02.180477 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: warnings.warn(msg) Feb 10 23:03:02.180477 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: Feb 10 23:03:02.181811 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7168126-93c0-46ee-ba7c-5977133490e3 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:02.182125 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432038e-740d-455e-b790-8895267d946c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:02.197246 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba93bae-3c83-4fbd-9407-c85ad3129c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:02.197930 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba93bae-3c83-4fbd-9407-c85ad3129c81 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:02.198218 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba93bae-3c83-4fbd-9407-c85ad3129c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:02.198497 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba93bae-3c83-4fbd-9407-c85ad3129c81 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:02.199354 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba93bae-3c83-4fbd-9407-c85ad3129c81 admin admin] RBAC: Adding query filter params (role.id=7f727831e261404999a27a5a15b515b1, scope.project.id=ff1d62262d6348b39c63a74a5afe64bd, user.id=e90634c2f9fb4792963d0551248329a4) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:02.199670 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba93bae-3c83-4fbd-9407-c85ad3129c81 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:02.200482 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 42/87] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:02.205095 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba93bae-3c83-4fbd-9407-c85ad3129c81 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:02.206973 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432038e-740d-455e-b790-8895267d946c admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:02.216800 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 46/88] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:02 2022] GET /identity/v3/role_assignments?user.id=e90634c2f9fb4792963d0551248329a4&scope.project.id=ff1d62262d6348b39c63a74a5afe64bd&role.id=7f727831e261404999a27a5a15b515b1 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:02.218829 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432038e-740d-455e-b790-8895267d946c admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:02.224174 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d23c0f-5b49-4b68-861f-3fea869cbcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:02.225472 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d23c0f-5b49-4b68-861f-3fea869cbcb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:02.225945 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d23c0f-5b49-4b68-861f-3fea869cbcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:02.226679 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d23c0f-5b49-4b68-861f-3fea869cbcb4 admin admin] PATH_INFO: `/v3/users/e90634c2f9fb4792963d0551248329a4` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:02.228583 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d23c0f-5b49-4b68-861f-3fea869cbcb4 admin admin] RBAC: Authorizing `identity:get_user(user_id=e90634c2f9fb4792963d0551248329a4)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:02.231160 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d23c0f-5b49-4b68-861f-3fea869cbcb4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:02.238257 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 43/89] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:02 2022] GET /identity/v3/users/e90634c2f9fb4792963d0551248329a4 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:02.240085 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba93bae-3c83-4fbd-9407-c85ad3129c81 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:02.252953 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba93bae-3c83-4fbd-9407-c85ad3129c81 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:02.259398 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bfde2-1bb8-4267-a1e1-d3ac4d5029e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:02.260493 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bfde2-1bb8-4267-a1e1-d3ac4d5029e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:02.260961 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bfde2-1bb8-4267-a1e1-d3ac4d5029e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:02.261453 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bfde2-1bb8-4267-a1e1-d3ac4d5029e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:02.272673 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bfde2-1bb8-4267-a1e1-d3ac4d5029e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:02.273731 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda737c-bad7-48e5-9074-094b955426ac None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:02.274363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda737c-bad7-48e5-9074-094b955426ac None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:02.274808 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bfde2-1bb8-4267-a1e1-d3ac4d5029e6 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:02.274995 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda737c-bad7-48e5-9074-094b955426ac None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:02.277101 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 44/90] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:03:02.286188 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f158e-c848-472e-a87a-5bccebeaefc8 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:02.287006 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f158e-c848-472e-a87a-5bccebeaefc8 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:02.287517 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f158e-c848-472e-a87a-5bccebeaefc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:02.292489 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 47/91] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:02.301666 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bfde2-1bb8-4267-a1e1-d3ac4d5029e6 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:02.310313 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-985f158e-c848-472e-a87a-5bccebeaefc8 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:02.312189 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-985f158e-c848-472e-a87a-5bccebeaefc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:02.323144 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 45/92] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:02.327542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bfde2-1bb8-4267-a1e1-d3ac4d5029e6 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:02.342276 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65779bf8-303d-4f5d-a72a-b75c83e65123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:02.343186 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65779bf8-303d-4f5d-a72a-b75c83e65123 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:02.343479 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65779bf8-303d-4f5d-a72a-b75c83e65123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:02.343752 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65779bf8-303d-4f5d-a72a-b75c83e65123 admin admin] PATH_INFO: `/v3/projects/66788b3f0330483e8a610768f0864423` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:02.348904 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65779bf8-303d-4f5d-a72a-b75c83e65123 admin admin] RBAC: Authorizing `identity:get_project(project_id=66788b3f0330483e8a610768f0864423)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:02.351695 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65779bf8-303d-4f5d-a72a-b75c83e65123 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:02.354208 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 48/93] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:02 2022] GET /identity/v3/projects/66788b3f0330483e8a610768f0864423 => generated 312 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:02.360202 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f158e-c848-472e-a87a-5bccebeaefc8 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:02.367484 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65779bf8-303d-4f5d-a72a-b75c83e65123 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:02.380309 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f158e-c848-472e-a87a-5bccebeaefc8 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:02.386763 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65779bf8-303d-4f5d-a72a-b75c83e65123 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:02.391351 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26a3d4-4c4e-43ac-b057-959416705f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:02.392056 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26a3d4-4c4e-43ac-b057-959416705f12 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:02.392346 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26a3d4-4c4e-43ac-b057-959416705f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:02.392636 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26a3d4-4c4e-43ac-b057-959416705f12 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:02.393508 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26a3d4-4c4e-43ac-b057-959416705f12 admin admin] RBAC: Adding query filter params (role.id=419ebcf5b1d8470394e463c9f01cb154, scope.project.id=66788b3f0330483e8a610768f0864423, user.id=e90634c2f9fb4792963d0551248329a4) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:02.393832 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26a3d4-4c4e-43ac-b057-959416705f12 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:02.395737 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26a3d4-4c4e-43ac-b057-959416705f12 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:02.400290 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b0bab-5345-4f8e-a981-06027eef5eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:02.401106 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b0bab-5345-4f8e-a981-06027eef5eca admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:02.401399 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b0bab-5345-4f8e-a981-06027eef5eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:02.401678 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b0bab-5345-4f8e-a981-06027eef5eca admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:02.404170 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b0bab-5345-4f8e-a981-06027eef5eca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:02.405849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b0bab-5345-4f8e-a981-06027eef5eca admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:02.407746 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 49/94] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:02.413369 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b0bab-5345-4f8e-a981-06027eef5eca admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:02.416512 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 46/95] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:02 2022] GET /identity/v3/role_assignments?user.id=e90634c2f9fb4792963d0551248329a4&scope.project.id=66788b3f0330483e8a610768f0864423&role.id=419ebcf5b1d8470394e463c9f01cb154 => generated 259 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:02.426187 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b0bab-5345-4f8e-a981-06027eef5eca admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:02.431944 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c905417-f8b2-42ae-b431-aab4355188cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:02.432649 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c905417-f8b2-42ae-b431-aab4355188cc admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:02.433004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c905417-f8b2-42ae-b431-aab4355188cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:02.433336 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c905417-f8b2-42ae-b431-aab4355188cc admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:02.434175 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c905417-f8b2-42ae-b431-aab4355188cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:02.435291 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING py.warnings [None req-6c905417-f8b2-42ae-b431-aab4355188cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:03:02.435291 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: warnings.warn(msg) Feb 10 23:03:02.435291 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: Feb 10 23:03:02.436609 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c905417-f8b2-42ae-b431-aab4355188cc admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:02.469012 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 50/96] 10.222.0.77 () {60 vars in 1153 bytes} [Thu Feb 10 23:03:02 2022] POST /identity/v3/users => generated 289 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:03:04.840727 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb86fd7-a4e2-412a-9acb-c5deff2b1d29 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:04.841343 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb86fd7-a4e2-412a-9acb-c5deff2b1d29 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:04.841343 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb86fd7-a4e2-412a-9acb-c5deff2b1d29 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:04.843303 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 47/97] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:04.860840 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3e5a0-9003-4784-9853-ce060575c19b None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:04.861315 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3e5a0-9003-4784-9853-ce060575c19b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:04.861414 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3e5a0-9003-4784-9853-ce060575c19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:04.888838 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-48a3e5a0-9003-4784-9853-ce060575c19b None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:04.890053 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-48a3e5a0-9003-4784-9853-ce060575c19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:04.902732 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 51/98] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:04.926199 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16a0ff-0e06-4143-99aa-c5abcf1e9d22 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:04.926505 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16a0ff-0e06-4143-99aa-c5abcf1e9d22 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:04.926767 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16a0ff-0e06-4143-99aa-c5abcf1e9d22 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:04.928692 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 48/99] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:04.934777 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bc15c-917d-447f-9377-c0b016099427 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:04.935072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bc15c-917d-447f-9377-c0b016099427 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:04.935354 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bc15c-917d-447f-9377-c0b016099427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:04.962758 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-bb8bc15c-917d-447f-9377-c0b016099427 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:04.964031 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-bb8bc15c-917d-447f-9377-c0b016099427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:04.966254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16a0ff-0e06-4143-99aa-c5abcf1e9d22 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:04.980862 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16a0ff-0e06-4143-99aa-c5abcf1e9d22 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:04.989560 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 52/100] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:04.996519 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da25ee0-495f-470f-9238-cdcb42b60414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:04.997330 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da25ee0-495f-470f-9238-cdcb42b60414 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:04.997621 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da25ee0-495f-470f-9238-cdcb42b60414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:04.997909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da25ee0-495f-470f-9238-cdcb42b60414 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:05.014176 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da25ee0-495f-470f-9238-cdcb42b60414 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:05.021032 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-3da25ee0-495f-470f-9238-cdcb42b60414 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:03:05.022223 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 49/101] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:03:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:03:05.027157 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bc15c-917d-447f-9377-c0b016099427 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:05.036592 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da25ee0-495f-470f-9238-cdcb42b60414 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:05.040504 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bc15c-917d-447f-9377-c0b016099427 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:05.057537 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da25ee0-495f-470f-9238-cdcb42b60414 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:05.059593 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58977c69-6c5c-402a-b680-424ae8a0180c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:05.060427 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58977c69-6c5c-402a-b680-424ae8a0180c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:05.060714 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58977c69-6c5c-402a-b680-424ae8a0180c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:05.060987 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58977c69-6c5c-402a-b680-424ae8a0180c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:05.072570 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196c096-142b-41c5-8d22-5b5121de3c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:05.073243 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196c096-142b-41c5-8d22-5b5121de3c51 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:05.073533 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196c096-142b-41c5-8d22-5b5121de3c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:05.073810 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196c096-142b-41c5-8d22-5b5121de3c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:05.074586 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196c096-142b-41c5-8d22-5b5121de3c51 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:05.074893 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196c096-142b-41c5-8d22-5b5121de3c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:05.078072 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196c096-142b-41c5-8d22-5b5121de3c51 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:05.087695 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58977c69-6c5c-402a-b680-424ae8a0180c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:05.094250 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-58977c69-6c5c-402a-b680-424ae8a0180c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 23:03:05.095440 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 53/102] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:05.102565 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 50/103] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:05.103738 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58977c69-6c5c-402a-b680-424ae8a0180c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:05.108645 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196c096-142b-41c5-8d22-5b5121de3c51 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:05.135080 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196c096-142b-41c5-8d22-5b5121de3c51 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:05.140689 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58977c69-6c5c-402a-b680-424ae8a0180c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:05.152314 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e605a-e4de-4e5d-8152-f82aa953d397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:05.153209 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e605a-e4de-4e5d-8152-f82aa953d397 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:05.153496 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e605a-e4de-4e5d-8152-f82aa953d397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:05.153776 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e605a-e4de-4e5d-8152-f82aa953d397 admin admin] PATH_INFO: `/v3/users/93804c035bb74a079b9cb29e5d154621` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:05.155755 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e605a-e4de-4e5d-8152-f82aa953d397 admin admin] RBAC: Authorizing `identity:get_user(user_id=93804c035bb74a079b9cb29e5d154621)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:05.157612 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e605a-e4de-4e5d-8152-f82aa953d397 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:05.159405 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 51/104] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:05 2022] GET /identity/v3/users/93804c035bb74a079b9cb29e5d154621 => generated 247 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:05.159995 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef64eb-72e7-41c0-88bd-708c058d7e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:05.160751 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef64eb-72e7-41c0-88bd-708c058d7e01 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:05.161037 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef64eb-72e7-41c0-88bd-708c058d7e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:05.161314 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef64eb-72e7-41c0-88bd-708c058d7e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:05.162091 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef64eb-72e7-41c0-88bd-708c058d7e01 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:05.162396 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef64eb-72e7-41c0-88bd-708c058d7e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:05.165332 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef64eb-72e7-41c0-88bd-708c058d7e01 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:05.167643 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e605a-e4de-4e5d-8152-f82aa953d397 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:05.182845 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 54/105] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:05.185342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e605a-e4de-4e5d-8152-f82aa953d397 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:05.192768 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef64eb-72e7-41c0-88bd-708c058d7e01 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:05.204755 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef64eb-72e7-41c0-88bd-708c058d7e01 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:05.207183 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae53fb4-8a67-48ba-a259-b911974e425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:05.208064 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae53fb4-8a67-48ba-a259-b911974e425a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:05.208352 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae53fb4-8a67-48ba-a259-b911974e425a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:05.208630 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae53fb4-8a67-48ba-a259-b911974e425a admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:05.210096 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae53fb4-8a67-48ba-a259-b911974e425a admin admin] RBAC: Authorizing `identity:get_project(project_id=ff1d62262d6348b39c63a74a5afe64bd)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:05.213203 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae53fb4-8a67-48ba-a259-b911974e425a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:05.214865 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 52/106] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:05 2022] GET /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:05.221798 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae53fb4-8a67-48ba-a259-b911974e425a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:05.224326 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075023ea-6af6-4c29-bc2a-b289fab89fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:05.225206 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075023ea-6af6-4c29-bc2a-b289fab89fbf admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:05.225491 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075023ea-6af6-4c29-bc2a-b289fab89fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:05.225768 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075023ea-6af6-4c29-bc2a-b289fab89fbf admin admin] PATH_INFO: `/v3/users/e90634c2f9fb4792963d0551248329a4` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:05.232460 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075023ea-6af6-4c29-bc2a-b289fab89fbf admin admin] RBAC: Authorizing `identity:get_user(user_id=e90634c2f9fb4792963d0551248329a4)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:05.234640 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075023ea-6af6-4c29-bc2a-b289fab89fbf admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:05.244602 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 55/107] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:05 2022] GET /identity/v3/users/e90634c2f9fb4792963d0551248329a4 => generated 275 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:05.248016 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae53fb4-8a67-48ba-a259-b911974e425a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:05.250355 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075023ea-6af6-4c29-bc2a-b289fab89fbf admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:05.264394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075023ea-6af6-4c29-bc2a-b289fab89fbf admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:05.266464 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16b2fc-b56d-4491-b318-8ac83cde7c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:05.267363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16b2fc-b56d-4491-b318-8ac83cde7c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:05.267647 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16b2fc-b56d-4491-b318-8ac83cde7c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:05.267953 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16b2fc-b56d-4491-b318-8ac83cde7c9b admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd/users/93804c035bb74a079b9cb29e5d154621/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:05.270565 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16b2fc-b56d-4491-b318-8ac83cde7c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1d62262d6348b39c63a74a5afe64bd, user_id=93804c035bb74a079b9cb29e5d154621, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:05.274047 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16b2fc-b56d-4491-b318-8ac83cde7c9b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:05.286571 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5276f8e-bb7a-43ea-926e-bcb531db90b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:05.287443 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5276f8e-bb7a-43ea-926e-bcb531db90b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:05.287728 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5276f8e-bb7a-43ea-926e-bcb531db90b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:05.288037 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5276f8e-bb7a-43ea-926e-bcb531db90b8 admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:05.290490 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5276f8e-bb7a-43ea-926e-bcb531db90b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff1d62262d6348b39c63a74a5afe64bd)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:05.292623 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5276f8e-bb7a-43ea-926e-bcb531db90b8 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:05.294534 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 56/108] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:05 2022] GET /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:05.300278 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5276f8e-bb7a-43ea-926e-bcb531db90b8 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:05.312629 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 53/109] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:03:05 2022] PUT /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd/users/93804c035bb74a079b9cb29e5d154621/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:03:05.318659 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5276f8e-bb7a-43ea-926e-bcb531db90b8 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:05.383474 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc24c1-2beb-4901-81a9-256decb1e64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:05.384384 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc24c1-2beb-4901-81a9-256decb1e64b admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:05.384724 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc24c1-2beb-4901-81a9-256decb1e64b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:05.385005 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc24c1-2beb-4901-81a9-256decb1e64b admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd/users/e90634c2f9fb4792963d0551248329a4/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:05.387097 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc24c1-2beb-4901-81a9-256decb1e64b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1d62262d6348b39c63a74a5afe64bd, user_id=e90634c2f9fb4792963d0551248329a4, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:05.388415 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING py.warnings [None req-0afc24c1-2beb-4901-81a9-256decb1e64b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:03:05.388415 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: warnings.warn(msg) Feb 10 23:03:05.388415 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: Feb 10 23:03:05.390394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc24c1-2beb-4901-81a9-256decb1e64b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:05.409786 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 57/110] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:03:05 2022] PUT /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd/users/e90634c2f9fb4792963d0551248329a4/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:03:05.479133 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235662a-57dd-45e5-ae70-244dd7229e9b None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:05.479470 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235662a-57dd-45e5-ae70-244dd7229e9b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:05.479704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235662a-57dd-45e5-ae70-244dd7229e9b None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:05.481631 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 54/111] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:05.494897 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebac53-f964-41fc-8869-428aca956df8 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:05.495210 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebac53-f964-41fc-8869-428aca956df8 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:05.495471 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebac53-f964-41fc-8869-428aca956df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:05.518958 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-43ebac53-f964-41fc-8869-428aca956df8 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:05.520327 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-43ebac53-f964-41fc-8869-428aca956df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:05.599515 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 58/112] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:05.631135 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235662a-57dd-45e5-ae70-244dd7229e9b None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:05.651753 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235662a-57dd-45e5-ae70-244dd7229e9b None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:05.659560 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080c5b4-5ea5-4c27-af69-1d193ef8563c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:05.660422 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080c5b4-5ea5-4c27-af69-1d193ef8563c admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:05.660686 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080c5b4-5ea5-4c27-af69-1d193ef8563c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:05.660968 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080c5b4-5ea5-4c27-af69-1d193ef8563c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:05.676745 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080c5b4-5ea5-4c27-af69-1d193ef8563c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:05.684994 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-8080c5b4-5ea5-4c27-af69-1d193ef8563c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 23:03:05.686246 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 55/113] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:05.692384 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebac53-f964-41fc-8869-428aca956df8 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:05.702325 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebac53-f964-41fc-8869-428aca956df8 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:05.707010 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf3c28-2a07-4a51-b004-586c521ca8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:05.707592 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf3c28-2a07-4a51-b004-586c521ca8dd admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:05.707915 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf3c28-2a07-4a51-b004-586c521ca8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:05.708199 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf3c28-2a07-4a51-b004-586c521ca8dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:05.708993 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf3c28-2a07-4a51-b004-586c521ca8dd admin admin] RBAC: Adding query filter params (name=member) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:05.709300 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf3c28-2a07-4a51-b004-586c521ca8dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:05.712221 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf3c28-2a07-4a51-b004-586c521ca8dd admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:05.722076 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 59/114] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:05.728431 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080c5b4-5ea5-4c27-af69-1d193ef8563c admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:05.742811 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080c5b4-5ea5-4c27-af69-1d193ef8563c admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:05.748273 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef2f6a-b345-400e-82ee-ef04886df5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:05.749232 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef2f6a-b345-400e-82ee-ef04886df5db admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:05.749516 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef2f6a-b345-400e-82ee-ef04886df5db admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:05.749790 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef2f6a-b345-400e-82ee-ef04886df5db admin admin] PATH_INFO: `/v3/users/e90634c2f9fb4792963d0551248329a4` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:05.751110 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef2f6a-b345-400e-82ee-ef04886df5db admin admin] RBAC: Authorizing `identity:get_user(user_id=e90634c2f9fb4792963d0551248329a4)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:05.753345 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef2f6a-b345-400e-82ee-ef04886df5db admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:05.755070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 56/115] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:05 2022] GET /identity/v3/users/e90634c2f9fb4792963d0551248329a4 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:05.761427 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf3c28-2a07-4a51-b004-586c521ca8dd admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:05.771766 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf3c28-2a07-4a51-b004-586c521ca8dd admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:05.777961 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072e091-5fb3-4487-8627-096f202be945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:05.778926 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072e091-5fb3-4487-8627-096f202be945 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:05.779218 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072e091-5fb3-4487-8627-096f202be945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:05.779479 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072e091-5fb3-4487-8627-096f202be945 admin admin] PATH_INFO: `/v3/projects/66788b3f0330483e8a610768f0864423` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:05.781879 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072e091-5fb3-4487-8627-096f202be945 admin admin] RBAC: Authorizing `identity:get_project(project_id=66788b3f0330483e8a610768f0864423)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:05.784106 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072e091-5fb3-4487-8627-096f202be945 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:05.785964 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 60/116] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:05 2022] GET /identity/v3/projects/66788b3f0330483e8a610768f0864423 => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:05.792197 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef2f6a-b345-400e-82ee-ef04886df5db admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:05.802430 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef2f6a-b345-400e-82ee-ef04886df5db admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:05.808586 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa0423-de42-4d2e-bee2-d7137e461908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:05.809622 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa0423-de42-4d2e-bee2-d7137e461908 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:05.809916 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa0423-de42-4d2e-bee2-d7137e461908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:05.810247 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa0423-de42-4d2e-bee2-d7137e461908 admin admin] PATH_INFO: `/v3/projects/66788b3f0330483e8a610768f0864423/users/e90634c2f9fb4792963d0551248329a4/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:05.812391 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa0423-de42-4d2e-bee2-d7137e461908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66788b3f0330483e8a610768f0864423, user_id=e90634c2f9fb4792963d0551248329a4, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:05.815206 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa0423-de42-4d2e-bee2-d7137e461908 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:05.831602 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 57/117] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:03:05 2022] PUT /identity/v3/projects/66788b3f0330483e8a610768f0864423/users/e90634c2f9fb4792963d0551248329a4/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:03:06.010799 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80e067-8250-4976-828d-38bf6ef329a2 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:06.011292 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80e067-8250-4976-828d-38bf6ef329a2 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:06.011543 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80e067-8250-4976-828d-38bf6ef329a2 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:06.013554 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 61/118] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:06.024304 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a85bd-ca89-45af-9e15-89bf92bab41a None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:06.024902 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a85bd-ca89-45af-9e15-89bf92bab41a None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:06.024902 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a85bd-ca89-45af-9e15-89bf92bab41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:06.050589 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-a83a85bd-ca89-45af-9e15-89bf92bab41a None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:06.051869 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a83a85bd-ca89-45af-9e15-89bf92bab41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:06.119684 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 58/119] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:06.143979 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80e067-8250-4976-828d-38bf6ef329a2 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:06.158259 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80e067-8250-4976-828d-38bf6ef329a2 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:06.163001 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256aa45-8036-491a-9891-4e6458271c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:06.164560 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256aa45-8036-491a-9891-4e6458271c61 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:06.164908 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256aa45-8036-491a-9891-4e6458271c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:06.165190 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256aa45-8036-491a-9891-4e6458271c61 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:06.176852 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256aa45-8036-491a-9891-4e6458271c61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:06.185002 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-8256aa45-8036-491a-9891-4e6458271c61 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 23:03:06.186366 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 62/120] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:03:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:06.192238 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a85bd-ca89-45af-9e15-89bf92bab41a None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:06.202909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a85bd-ca89-45af-9e15-89bf92bab41a None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:06.207445 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24211ca-7bc3-4721-9859-b22ff81f944e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:06.208220 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24211ca-7bc3-4721-9859-b22ff81f944e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:06.208508 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24211ca-7bc3-4721-9859-b22ff81f944e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:06.208828 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24211ca-7bc3-4721-9859-b22ff81f944e admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:06.209608 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24211ca-7bc3-4721-9859-b22ff81f944e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:06.209916 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24211ca-7bc3-4721-9859-b22ff81f944e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:06.213027 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24211ca-7bc3-4721-9859-b22ff81f944e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:06.222227 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 59/121] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:06.229074 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256aa45-8036-491a-9891-4e6458271c61 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:06.240379 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256aa45-8036-491a-9891-4e6458271c61 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:06.246126 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a39dc8-2594-4038-9c05-a10dc787c03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:06.247066 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a39dc8-2594-4038-9c05-a10dc787c03d admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:06.247354 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a39dc8-2594-4038-9c05-a10dc787c03d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:06.247683 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a39dc8-2594-4038-9c05-a10dc787c03d admin admin] PATH_INFO: `/v3/users/e90634c2f9fb4792963d0551248329a4` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:06.248934 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a39dc8-2594-4038-9c05-a10dc787c03d admin admin] RBAC: Authorizing `identity:get_user(user_id=e90634c2f9fb4792963d0551248329a4)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:06.251270 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a39dc8-2594-4038-9c05-a10dc787c03d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:06.252910 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 63/122] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:06 2022] GET /identity/v3/users/e90634c2f9fb4792963d0551248329a4 => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:06.259917 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24211ca-7bc3-4721-9859-b22ff81f944e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:06.270342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24211ca-7bc3-4721-9859-b22ff81f944e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:06.276613 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cd7b9-6beb-4285-9e5f-dde5aec649f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:06.277634 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cd7b9-6beb-4285-9e5f-dde5aec649f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:06.277924 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cd7b9-6beb-4285-9e5f-dde5aec649f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:06.278210 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cd7b9-6beb-4285-9e5f-dde5aec649f1 admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:06.279564 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cd7b9-6beb-4285-9e5f-dde5aec649f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff1d62262d6348b39c63a74a5afe64bd)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:06.281806 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cd7b9-6beb-4285-9e5f-dde5aec649f1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:06.283612 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 60/123] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:06 2022] GET /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:06.290150 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a39dc8-2594-4038-9c05-a10dc787c03d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:06.300585 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a39dc8-2594-4038-9c05-a10dc787c03d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:06.305927 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b23581-02a3-4e1f-8074-576ba646b232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:06.306871 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b23581-02a3-4e1f-8074-576ba646b232 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:06.307156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b23581-02a3-4e1f-8074-576ba646b232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:06.307434 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b23581-02a3-4e1f-8074-576ba646b232 admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd/users/e90634c2f9fb4792963d0551248329a4/roles/7f727831e261404999a27a5a15b515b1` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:06.309875 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b23581-02a3-4e1f-8074-576ba646b232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1d62262d6348b39c63a74a5afe64bd, user_id=e90634c2f9fb4792963d0551248329a4, role_id=7f727831e261404999a27a5a15b515b1)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:06.312501 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a534c3-0919-4ac1-97c8-4c11389168b3 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:06.312839 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a534c3-0919-4ac1-97c8-4c11389168b3 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:06.313120 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a534c3-0919-4ac1-97c8-4c11389168b3 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:06.314930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 61/124] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:03:06.317142 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b23581-02a3-4e1f-8074-576ba646b232 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:06.321298 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf07b33-b443-4f44-b5a3-cf361cbdf1b7 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:06.321584 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf07b33-b443-4f44-b5a3-cf361cbdf1b7 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:06.321917 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf07b33-b443-4f44-b5a3-cf361cbdf1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:06.349949 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 64/125] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:03:06 2022] PUT /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd/users/e90634c2f9fb4792963d0551248329a4/roles/7f727831e261404999a27a5a15b515b1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:03:06.358172 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-acf07b33-b443-4f44-b5a3-cf361cbdf1b7 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:06.359430 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-acf07b33-b443-4f44-b5a3-cf361cbdf1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:06.432461 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 62/126] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:06.457501 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b23581-02a3-4e1f-8074-576ba646b232 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:06.469317 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b23581-02a3-4e1f-8074-576ba646b232 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:06.474033 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99f246-21fb-4a68-9cca-af022075e246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:06.474847 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99f246-21fb-4a68-9cca-af022075e246 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:06.475138 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99f246-21fb-4a68-9cca-af022075e246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:06.475413 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99f246-21fb-4a68-9cca-af022075e246 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:06.489064 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99f246-21fb-4a68-9cca-af022075e246 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:06.497003 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-cb99f246-21fb-4a68-9cca-af022075e246 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 23:03:06.498458 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 65/127] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:06.504389 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf07b33-b443-4f44-b5a3-cf361cbdf1b7 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:06.514334 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf07b33-b443-4f44-b5a3-cf361cbdf1b7 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:06.519130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1015c-c45c-42d3-972f-f2990a5cde8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:06.519844 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1015c-c45c-42d3-972f-f2990a5cde8a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:06.520148 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1015c-c45c-42d3-972f-f2990a5cde8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:06.520480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1015c-c45c-42d3-972f-f2990a5cde8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:06.521263 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1015c-c45c-42d3-972f-f2990a5cde8a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:06.521614 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1015c-c45c-42d3-972f-f2990a5cde8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:06.524575 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1015c-c45c-42d3-972f-f2990a5cde8a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:06.534727 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 63/128] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:06.541498 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99f246-21fb-4a68-9cca-af022075e246 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:06.556402 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99f246-21fb-4a68-9cca-af022075e246 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:06.561769 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515d53d-f729-46e1-907d-a118a61863e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:06.562702 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515d53d-f729-46e1-907d-a118a61863e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:06.562986 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515d53d-f729-46e1-907d-a118a61863e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:06.563262 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515d53d-f729-46e1-907d-a118a61863e9 admin admin] PATH_INFO: `/v3/users/b244533bd84d481c8ef4b099da492bdd` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:06.582479 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515d53d-f729-46e1-907d-a118a61863e9 admin admin] RBAC: Authorizing `identity:get_user(user_id=b244533bd84d481c8ef4b099da492bdd)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:06.584803 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515d53d-f729-46e1-907d-a118a61863e9 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:06.587436 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 66/129] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:06 2022] GET /identity/v3/users/b244533bd84d481c8ef4b099da492bdd => generated 289 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:06.593054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1015c-c45c-42d3-972f-f2990a5cde8a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:06.604912 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1015c-c45c-42d3-972f-f2990a5cde8a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:06.609639 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7178e-d5ab-408e-b5f8-5d32c8af04ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:06.610365 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7178e-d5ab-408e-b5f8-5d32c8af04ca admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:06.610964 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7178e-d5ab-408e-b5f8-5d32c8af04ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:06.611249 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7178e-d5ab-408e-b5f8-5d32c8af04ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:06.621949 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7178e-d5ab-408e-b5f8-5d32c8af04ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:06.623883 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7178e-d5ab-408e-b5f8-5d32c8af04ca admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:06.634944 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 64/130] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:06.640791 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515d53d-f729-46e1-907d-a118a61863e9 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:06.651723 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515d53d-f729-46e1-907d-a118a61863e9 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:06.656360 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bd46a-355f-4d3a-957d-266bc7dfe7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:06.657225 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bd46a-355f-4d3a-957d-266bc7dfe7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:06.657510 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bd46a-355f-4d3a-957d-266bc7dfe7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:06.657788 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bd46a-355f-4d3a-957d-266bc7dfe7c3 admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:06.659098 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bd46a-355f-4d3a-957d-266bc7dfe7c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff1d62262d6348b39c63a74a5afe64bd)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:06.661185 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bd46a-355f-4d3a-957d-266bc7dfe7c3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:06.662924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 67/131] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:06 2022] GET /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:06.669931 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7178e-d5ab-408e-b5f8-5d32c8af04ca admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:06.680437 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7178e-d5ab-408e-b5f8-5d32c8af04ca admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:06.685158 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad227b2-7273-441c-a44a-9648a8867a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:06.685834 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad227b2-7273-441c-a44a-9648a8867a82 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:06.686181 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad227b2-7273-441c-a44a-9648a8867a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:06.686460 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad227b2-7273-441c-a44a-9648a8867a82 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:06.687368 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad227b2-7273-441c-a44a-9648a8867a82 admin admin] RBAC: Adding query filter params (role.id=d73ea8a0130d4158afa3b074bb2a4ccb, scope.project.id=ff1d62262d6348b39c63a74a5afe64bd, user.id=b244533bd84d481c8ef4b099da492bdd) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:06.687732 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad227b2-7273-441c-a44a-9648a8867a82 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:06.689762 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad227b2-7273-441c-a44a-9648a8867a82 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:06.697611 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 65/132] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:06 2022] GET /identity/v3/role_assignments?user.id=b244533bd84d481c8ef4b099da492bdd&scope.project.id=ff1d62262d6348b39c63a74a5afe64bd&role.id=d73ea8a0130d4158afa3b074bb2a4ccb => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:06.807933 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b60fa-2963-45c7-a2e6-9f7bcd7afdaa None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:06.808248 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b60fa-2963-45c7-a2e6-9f7bcd7afdaa None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:06.808471 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b60fa-2963-45c7-a2e6-9f7bcd7afdaa None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:06.810372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 68/133] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:06.815657 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2599f-e7d0-4944-93fe-49e24141b176 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:06.815982 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2599f-e7d0-4944-93fe-49e24141b176 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:06.816265 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2599f-e7d0-4944-93fe-49e24141b176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:06.840624 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-01b2599f-e7d0-4944-93fe-49e24141b176 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:06.841935 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-01b2599f-e7d0-4944-93fe-49e24141b176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:06.863179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 66/134] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:06.888457 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b60fa-2963-45c7-a2e6-9f7bcd7afdaa None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:06.904106 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b60fa-2963-45c7-a2e6-9f7bcd7afdaa None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:06.916093 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1f18d-ca5e-48dd-9298-8dd8a4e0718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:06.916924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1f18d-ca5e-48dd-9298-8dd8a4e0718f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:06.917264 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1f18d-ca5e-48dd-9298-8dd8a4e0718f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:06.917546 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1f18d-ca5e-48dd-9298-8dd8a4e0718f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:06.918857 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1f18d-ca5e-48dd-9298-8dd8a4e0718f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:06.920695 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1f18d-ca5e-48dd-9298-8dd8a4e0718f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:06.923525 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 69/135] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:06.928161 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2599f-e7d0-4944-93fe-49e24141b176 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:06.938684 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2599f-e7d0-4944-93fe-49e24141b176 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:06.950575 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb8206-a0ed-4a84-be4a-a3bdda1c6280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:06.950575 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb8206-a0ed-4a84-be4a-a3bdda1c6280 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:06.950575 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb8206-a0ed-4a84-be4a-a3bdda1c6280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:06.950575 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb8206-a0ed-4a84-be4a-a3bdda1c6280 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:06.951289 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb8206-a0ed-4a84-be4a-a3bdda1c6280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:06.951289 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb8206-a0ed-4a84-be4a-a3bdda1c6280 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:06.992278 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 67/136] 10.222.0.77 () {60 vars in 1162 bytes} [Thu Feb 10 23:03:06 2022] POST /identity/v3/projects => generated 302 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:03:08.799980 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc6cb8-0a26-4f18-8103-f523cfe94d36 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:08.800513 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc6cb8-0a26-4f18-8103-f523cfe94d36 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:08.800513 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc6cb8-0a26-4f18-8103-f523cfe94d36 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:08.802282 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 70/137] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:08.808422 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdda73-c5d4-4c42-bbed-3c55e48c7e4a None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:08.809312 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdda73-c5d4-4c42-bbed-3c55e48c7e4a None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:08.809796 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdda73-c5d4-4c42-bbed-3c55e48c7e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:08.836888 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-4efdda73-c5d4-4c42-bbed-3c55e48c7e4a None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:08.838439 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-4efdda73-c5d4-4c42-bbed-3c55e48c7e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:08.906460 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5711a81-5784-44dd-a721-db27e7c33f9b None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:08.907105 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5711a81-5784-44dd-a721-db27e7c33f9b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:08.907586 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5711a81-5784-44dd-a721-db27e7c33f9b None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:08.909585 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 71/138] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:03:08.914945 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3d9d8-5fad-496e-9baa-22d9ebef99a8 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:08.915490 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3d9d8-5fad-496e-9baa-22d9ebef99a8 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:08.915971 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 68/139] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:08.916220 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3d9d8-5fad-496e-9baa-22d9ebef99a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:08.954867 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efdda73-c5d4-4c42-bbed-3c55e48c7e4a None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:08.956193 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-bee3d9d8-5fad-496e-9baa-22d9ebef99a8 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:08.957615 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-bee3d9d8-5fad-496e-9baa-22d9ebef99a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:08.967330 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efdda73-c5d4-4c42-bbed-3c55e48c7e4a None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:08.971540 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 72/140] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:08.984494 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c55112-9a4b-4228-9d79-57227dc6c379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:08.985305 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c55112-9a4b-4228-9d79-57227dc6c379 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:08.985841 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c55112-9a4b-4228-9d79-57227dc6c379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:08.986123 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c55112-9a4b-4228-9d79-57227dc6c379 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.004760 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c55112-9a4b-4228-9d79-57227dc6c379 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:09.011796 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-87c55112-9a4b-4228-9d79-57227dc6c379 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 23:03:09.013206 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 69/141] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:03:09.024902 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3d9d8-5fad-496e-9baa-22d9ebef99a8 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:09.028552 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c55112-9a4b-4228-9d79-57227dc6c379 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:09.039853 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c55112-9a4b-4228-9d79-57227dc6c379 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:09.041561 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3d9d8-5fad-496e-9baa-22d9ebef99a8 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:09.049518 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b30093-7ffa-4054-8d14-ed3a92389213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:09.050418 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b30093-7ffa-4054-8d14-ed3a92389213 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.050654 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b30093-7ffa-4054-8d14-ed3a92389213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.050983 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b30093-7ffa-4054-8d14-ed3a92389213 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.057313 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38273b35-62c8-4210-8dc9-abd604a7afe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:09.058234 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38273b35-62c8-4210-8dc9-abd604a7afe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.058739 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38273b35-62c8-4210-8dc9-abd604a7afe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.059215 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38273b35-62c8-4210-8dc9-abd604a7afe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.060236 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38273b35-62c8-4210-8dc9-abd604a7afe7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:09.060758 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38273b35-62c8-4210-8dc9-abd604a7afe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:09.062606 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38273b35-62c8-4210-8dc9-abd604a7afe7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:09.077941 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b30093-7ffa-4054-8d14-ed3a92389213 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:09.083709 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-32b30093-7ffa-4054-8d14-ed3a92389213 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 23:03:09.086001 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 70/142] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:09.092335 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b30093-7ffa-4054-8d14-ed3a92389213 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:09.094161 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 73/143] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:09.103843 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38273b35-62c8-4210-8dc9-abd604a7afe7 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:09.107400 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b30093-7ffa-4054-8d14-ed3a92389213 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:09.118967 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae4416-36f9-4620-b387-289ded373653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:09.119840 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae4416-36f9-4620-b387-289ded373653 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.120271 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae4416-36f9-4620-b387-289ded373653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.120687 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae4416-36f9-4620-b387-289ded373653 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.121261 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38273b35-62c8-4210-8dc9-abd604a7afe7 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:09.121780 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae4416-36f9-4620-b387-289ded373653 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:09.122336 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae4416-36f9-4620-b387-289ded373653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:09.124122 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae4416-36f9-4620-b387-289ded373653 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:09.137980 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d2688-53ae-49ef-92b4-3a12d6ce23bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:09.138992 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d2688-53ae-49ef-92b4-3a12d6ce23bd admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.139214 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 71/144] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:09.140004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d2688-53ae-49ef-92b4-3a12d6ce23bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.140004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d2688-53ae-49ef-92b4-3a12d6ce23bd admin admin] PATH_INFO: `/v3/users/e90634c2f9fb4792963d0551248329a4` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.144465 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae4416-36f9-4620-b387-289ded373653 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:09.144702 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d2688-53ae-49ef-92b4-3a12d6ce23bd admin admin] RBAC: Authorizing `identity:get_user(user_id=e90634c2f9fb4792963d0551248329a4)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:09.146963 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d2688-53ae-49ef-92b4-3a12d6ce23bd admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:09.148952 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 74/145] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:09 2022] GET /identity/v3/users/e90634c2f9fb4792963d0551248329a4 => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:09.154686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d2688-53ae-49ef-92b4-3a12d6ce23bd admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:09.158194 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae4416-36f9-4620-b387-289ded373653 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:09.162860 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2e8e4-1706-45ea-8e4f-89a077ac82fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:09.164747 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2e8e4-1706-45ea-8e4f-89a077ac82fd admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.165252 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2e8e4-1706-45ea-8e4f-89a077ac82fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.165690 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2e8e4-1706-45ea-8e4f-89a077ac82fd admin admin] PATH_INFO: `/v3/users/e90634c2f9fb4792963d0551248329a4` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.167057 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2e8e4-1706-45ea-8e4f-89a077ac82fd admin admin] RBAC: Authorizing `identity:get_user(user_id=e90634c2f9fb4792963d0551248329a4)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:09.169289 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d2688-53ae-49ef-92b4-3a12d6ce23bd admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:09.169599 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2e8e4-1706-45ea-8e4f-89a077ac82fd admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:09.171499 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 72/146] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:09 2022] GET /identity/v3/users/e90634c2f9fb4792963d0551248329a4 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:09.175683 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bf6df-7cdc-4ebf-aed6-884be5ff194b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:09.177466 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2e8e4-1706-45ea-8e4f-89a077ac82fd admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:09.177992 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bf6df-7cdc-4ebf-aed6-884be5ff194b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.181554 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bf6df-7cdc-4ebf-aed6-884be5ff194b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.181989 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bf6df-7cdc-4ebf-aed6-884be5ff194b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.196737 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2e8e4-1706-45ea-8e4f-89a077ac82fd admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:09.198511 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bf6df-7cdc-4ebf-aed6-884be5ff194b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:09.200482 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bf6df-7cdc-4ebf-aed6-884be5ff194b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:09.208588 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc62795-58b6-4657-a814-682a1ddb973c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:09.209424 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc62795-58b6-4657-a814-682a1ddb973c admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.209854 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc62795-58b6-4657-a814-682a1ddb973c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.210394 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc62795-58b6-4657-a814-682a1ddb973c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.221694 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 75/147] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 23:03:09.224038 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc62795-58b6-4657-a814-682a1ddb973c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:09.226698 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc62795-58b6-4657-a814-682a1ddb973c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:09.227845 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bf6df-7cdc-4ebf-aed6-884be5ff194b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:09.241272 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bf6df-7cdc-4ebf-aed6-884be5ff194b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:09.249573 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 73/148] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 23:03:09.250922 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96574f84-dfde-4530-a380-41c9f7df3258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:09.251966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96574f84-dfde-4530-a380-41c9f7df3258 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.252411 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96574f84-dfde-4530-a380-41c9f7df3258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.252847 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96574f84-dfde-4530-a380-41c9f7df3258 admin admin] PATH_INFO: `/v3/projects/66788b3f0330483e8a610768f0864423` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.254415 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96574f84-dfde-4530-a380-41c9f7df3258 admin admin] RBAC: Authorizing `identity:get_project(project_id=66788b3f0330483e8a610768f0864423)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:09.255453 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc62795-58b6-4657-a814-682a1ddb973c admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:09.260273 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96574f84-dfde-4530-a380-41c9f7df3258 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:09.264341 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 76/149] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:09 2022] GET /identity/v3/projects/66788b3f0330483e8a610768f0864423 => generated 312 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:09.269791 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc62795-58b6-4657-a814-682a1ddb973c admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:09.270958 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96574f84-dfde-4530-a380-41c9f7df3258 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:09.284791 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331a56d-b9e3-4b2b-9973-68c1c10f8a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:09.285966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331a56d-b9e3-4b2b-9973-68c1c10f8a73 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.287998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331a56d-b9e3-4b2b-9973-68c1c10f8a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.289348 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331a56d-b9e3-4b2b-9973-68c1c10f8a73 admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.291145 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96574f84-dfde-4530-a380-41c9f7df3258 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:09.293297 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331a56d-b9e3-4b2b-9973-68c1c10f8a73 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff1d62262d6348b39c63a74a5afe64bd)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:09.297021 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331a56d-b9e3-4b2b-9973-68c1c10f8a73 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:09.301614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb38a13-4d3d-40f5-9719-d576af692aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:09.303186 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb38a13-4d3d-40f5-9719-d576af692aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.303426 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 74/150] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:09 2022] GET /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:09.305064 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb38a13-4d3d-40f5-9719-d576af692aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.305675 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb38a13-4d3d-40f5-9719-d576af692aa0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.306684 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb38a13-4d3d-40f5-9719-d576af692aa0 admin admin] RBAC: Adding query filter params (role.id=419ebcf5b1d8470394e463c9f01cb154, scope.project.id=66788b3f0330483e8a610768f0864423, user.id=e90634c2f9fb4792963d0551248329a4) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:09.307185 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb38a13-4d3d-40f5-9719-d576af692aa0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:09.309301 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331a56d-b9e3-4b2b-9973-68c1c10f8a73 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:09.315837 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb38a13-4d3d-40f5-9719-d576af692aa0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:09.326532 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331a56d-b9e3-4b2b-9973-68c1c10f8a73 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:09.327831 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 77/151] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:09 2022] GET /identity/v3/role_assignments?user.id=e90634c2f9fb4792963d0551248329a4&scope.project.id=66788b3f0330483e8a610768f0864423&role.id=419ebcf5b1d8470394e463c9f01cb154 => generated 608 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:09.332380 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c94bb2-8372-46d7-85fc-4cae245c1e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:09.333240 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c94bb2-8372-46d7-85fc-4cae245c1e8b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.333745 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c94bb2-8372-46d7-85fc-4cae245c1e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.334177 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c94bb2-8372-46d7-85fc-4cae245c1e8b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.335282 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c94bb2-8372-46d7-85fc-4cae245c1e8b admin admin] RBAC: Adding query filter params (role.id=419ebcf5b1d8470394e463c9f01cb154, scope.project.id=ff1d62262d6348b39c63a74a5afe64bd, user.id=e90634c2f9fb4792963d0551248329a4) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:09.336075 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c94bb2-8372-46d7-85fc-4cae245c1e8b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:09.338373 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c94bb2-8372-46d7-85fc-4cae245c1e8b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:09.345912 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 75/152] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:09 2022] GET /identity/v3/role_assignments?user.id=e90634c2f9fb4792963d0551248329a4&scope.project.id=ff1d62262d6348b39c63a74a5afe64bd&role.id=419ebcf5b1d8470394e463c9f01cb154 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:09.572309 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e5cd5-ad81-4453-8ae5-8c9e853100a3 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.572841 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e5cd5-ad81-4453-8ae5-8c9e853100a3 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.573267 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e5cd5-ad81-4453-8ae5-8c9e853100a3 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.575424 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 78/153] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:09.581709 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba272e1e-3c6d-45b1-a2e9-3c943be86dce None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.582239 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba272e1e-3c6d-45b1-a2e9-3c943be86dce None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.582666 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba272e1e-3c6d-45b1-a2e9-3c943be86dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.610112 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-ba272e1e-3c6d-45b1-a2e9-3c943be86dce None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:09.611904 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-ba272e1e-3c6d-45b1-a2e9-3c943be86dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:09.622681 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 76/154] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:09.666061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e5cd5-ad81-4453-8ae5-8c9e853100a3 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:09.680515 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e5cd5-ad81-4453-8ae5-8c9e853100a3 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:09.685219 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d821eee-d6de-4a20-9d11-9eae3d2874ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:09.686264 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d821eee-d6de-4a20-9d11-9eae3d2874ad admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.686704 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d821eee-d6de-4a20-9d11-9eae3d2874ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.687119 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d821eee-d6de-4a20-9d11-9eae3d2874ad admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.701855 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d821eee-d6de-4a20-9d11-9eae3d2874ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:09.709109 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-0d821eee-d6de-4a20-9d11-9eae3d2874ad admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:03:09.710606 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 79/155] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:03:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:09.716649 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba272e1e-3c6d-45b1-a2e9-3c943be86dce None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:09.726562 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba272e1e-3c6d-45b1-a2e9-3c943be86dce None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:09.731396 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bbe32-f13f-4a25-9201-5f015e48592d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:09.732375 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bbe32-f13f-4a25-9201-5f015e48592d admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.732800 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bbe32-f13f-4a25-9201-5f015e48592d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.733215 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bbe32-f13f-4a25-9201-5f015e48592d admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.734209 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bbe32-f13f-4a25-9201-5f015e48592d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:09.734674 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bbe32-f13f-4a25-9201-5f015e48592d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:09.736736 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bbe32-f13f-4a25-9201-5f015e48592d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:09.746927 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 77/156] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:09.752466 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d821eee-d6de-4a20-9d11-9eae3d2874ad admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:09.764407 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d821eee-d6de-4a20-9d11-9eae3d2874ad admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:09.769223 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9461ac-84f9-4da8-934c-9b8ab4671603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:09.770324 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9461ac-84f9-4da8-934c-9b8ab4671603 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.770778 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9461ac-84f9-4da8-934c-9b8ab4671603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.771191 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9461ac-84f9-4da8-934c-9b8ab4671603 admin admin] PATH_INFO: `/v3/users/93804c035bb74a079b9cb29e5d154621` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.772640 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9461ac-84f9-4da8-934c-9b8ab4671603 admin admin] RBAC: Authorizing `identity:get_user(user_id=93804c035bb74a079b9cb29e5d154621)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:09.775256 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9461ac-84f9-4da8-934c-9b8ab4671603 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:09.777142 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 80/157] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:09 2022] GET /identity/v3/users/93804c035bb74a079b9cb29e5d154621 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:09.783239 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bbe32-f13f-4a25-9201-5f015e48592d admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:09.794234 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bbe32-f13f-4a25-9201-5f015e48592d admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:09.799297 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09051db-4795-479f-a2d6-3d4adfb3fe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:09.800209 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09051db-4795-479f-a2d6-3d4adfb3fe12 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.800683 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09051db-4795-479f-a2d6-3d4adfb3fe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.801094 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09051db-4795-479f-a2d6-3d4adfb3fe12 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.812710 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09051db-4795-479f-a2d6-3d4adfb3fe12 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:09.815210 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09051db-4795-479f-a2d6-3d4adfb3fe12 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:09.829205 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 78/158] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:09.835219 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9461ac-84f9-4da8-934c-9b8ab4671603 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:09.847197 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9461ac-84f9-4da8-934c-9b8ab4671603 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:09.852948 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a55b90-8564-4bbb-8db0-2d4c53fcba70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:09.854089 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a55b90-8564-4bbb-8db0-2d4c53fcba70 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.854670 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a55b90-8564-4bbb-8db0-2d4c53fcba70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.855153 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a55b90-8564-4bbb-8db0-2d4c53fcba70 admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.856633 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a55b90-8564-4bbb-8db0-2d4c53fcba70 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff1d62262d6348b39c63a74a5afe64bd)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:09.859051 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a55b90-8564-4bbb-8db0-2d4c53fcba70 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:09.861688 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 81/159] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:09 2022] GET /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:09.868073 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09051db-4795-479f-a2d6-3d4adfb3fe12 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:09.879053 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09051db-4795-479f-a2d6-3d4adfb3fe12 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:09.884410 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0507f-05bc-4d0d-a249-80cd9775bbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:09.885389 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0507f-05bc-4d0d-a249-80cd9775bbdd admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.885929 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0507f-05bc-4d0d-a249-80cd9775bbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.886467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0507f-05bc-4d0d-a249-80cd9775bbdd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.887510 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0507f-05bc-4d0d-a249-80cd9775bbdd admin admin] RBAC: Adding query filter params (role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f, scope.project.id=ff1d62262d6348b39c63a74a5afe64bd, user.id=93804c035bb74a079b9cb29e5d154621) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:09.888054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0507f-05bc-4d0d-a249-80cd9775bbdd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:09.890214 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0507f-05bc-4d0d-a249-80cd9775bbdd admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:09.900660 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 79/160] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:09 2022] GET /identity/v3/role_assignments?user.id=93804c035bb74a079b9cb29e5d154621&scope.project.id=ff1d62262d6348b39c63a74a5afe64bd&role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:09.911738 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a9cfc-b098-49b4-bd35-266cdc97ec8f None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.912443 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a9cfc-b098-49b4-bd35-266cdc97ec8f None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.912967 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a9cfc-b098-49b4-bd35-266cdc97ec8f None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.916607 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 82/161] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:09.923171 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3cda1-308c-44ea-834b-3d76ca4fddc6 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:09.923527 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3cda1-308c-44ea-834b-3d76ca4fddc6 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:09.923718 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3cda1-308c-44ea-834b-3d76ca4fddc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:09.950203 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-afc3cda1-308c-44ea-834b-3d76ca4fddc6 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:09.951848 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-afc3cda1-308c-44ea-834b-3d76ca4fddc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:09.962530 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 80/162] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:09.989832 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a9cfc-b098-49b4-bd35-266cdc97ec8f None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:10.004833 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a9cfc-b098-49b4-bd35-266cdc97ec8f None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:10.012795 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847ca7f-e6fe-4610-b2f4-0272f3e58fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:10.014073 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847ca7f-e6fe-4610-b2f4-0272f3e58fba admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:10.014671 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847ca7f-e6fe-4610-b2f4-0272f3e58fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:10.015173 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847ca7f-e6fe-4610-b2f4-0272f3e58fba admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:10.033640 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847ca7f-e6fe-4610-b2f4-0272f3e58fba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:10.042172 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-b847ca7f-e6fe-4610-b2f4-0272f3e58fba admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 23:03:10.044054 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 83/163] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:10.049948 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3cda1-308c-44ea-834b-3d76ca4fddc6 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:10.061616 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3cda1-308c-44ea-834b-3d76ca4fddc6 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:10.067851 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7a67c-69a0-4339-b72c-6ef27a31a39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:10.068881 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7a67c-69a0-4339-b72c-6ef27a31a39a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:10.069389 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7a67c-69a0-4339-b72c-6ef27a31a39a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:10.070420 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7a67c-69a0-4339-b72c-6ef27a31a39a admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:10.071423 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7a67c-69a0-4339-b72c-6ef27a31a39a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:10.071972 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7a67c-69a0-4339-b72c-6ef27a31a39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:10.076100 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7a67c-69a0-4339-b72c-6ef27a31a39a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:10.086766 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 81/164] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:10.092493 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847ca7f-e6fe-4610-b2f4-0272f3e58fba admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:10.105355 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847ca7f-e6fe-4610-b2f4-0272f3e58fba admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:10.110149 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329b301-ccd8-4795-b775-1627edbd51e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:10.111609 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329b301-ccd8-4795-b775-1627edbd51e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:10.112117 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329b301-ccd8-4795-b775-1627edbd51e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:10.112615 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329b301-ccd8-4795-b775-1627edbd51e1 admin admin] PATH_INFO: `/v3/users/b244533bd84d481c8ef4b099da492bdd` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:10.114115 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329b301-ccd8-4795-b775-1627edbd51e1 admin admin] RBAC: Authorizing `identity:get_user(user_id=b244533bd84d481c8ef4b099da492bdd)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:10.117320 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329b301-ccd8-4795-b775-1627edbd51e1 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:10.119538 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 84/165] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:10 2022] GET /identity/v3/users/b244533bd84d481c8ef4b099da492bdd => generated 289 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:10.125346 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7a67c-69a0-4339-b72c-6ef27a31a39a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:10.136051 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7a67c-69a0-4339-b72c-6ef27a31a39a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:10.141332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fb2fc-60a0-4eb5-b632-e7a03ab3c1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:10.142219 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fb2fc-60a0-4eb5-b632-e7a03ab3c1eb admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:10.142506 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fb2fc-60a0-4eb5-b632-e7a03ab3c1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:10.142784 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fb2fc-60a0-4eb5-b632-e7a03ab3c1eb admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:10.144811 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fb2fc-60a0-4eb5-b632-e7a03ab3c1eb admin admin] RBAC: Authorizing `identity:get_project(project_id=ff1d62262d6348b39c63a74a5afe64bd)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:10.147296 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fb2fc-60a0-4eb5-b632-e7a03ab3c1eb admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:10.149518 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 82/166] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:10 2022] GET /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:10.155347 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329b301-ccd8-4795-b775-1627edbd51e1 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:10.166954 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329b301-ccd8-4795-b775-1627edbd51e1 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:10.171448 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab5779-d843-44bb-a750-503a4209682c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:10.172368 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab5779-d843-44bb-a750-503a4209682c admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:10.172790 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab5779-d843-44bb-a750-503a4209682c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:10.173070 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab5779-d843-44bb-a750-503a4209682c admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd/users/b244533bd84d481c8ef4b099da492bdd/roles/d73ea8a0130d4158afa3b074bb2a4ccb` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:10.175155 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab5779-d843-44bb-a750-503a4209682c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1d62262d6348b39c63a74a5afe64bd, user_id=b244533bd84d481c8ef4b099da492bdd, role_id=d73ea8a0130d4158afa3b074bb2a4ccb)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:10.177912 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab5779-d843-44bb-a750-503a4209682c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:10.193677 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 85/167] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:03:10 2022] PUT /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd/users/b244533bd84d481c8ef4b099da492bdd/roles/d73ea8a0130d4158afa3b074bb2a4ccb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:03:10.237276 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60d7c-f464-4c73-b63b-66d192a5815b None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:10.237566 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60d7c-f464-4c73-b63b-66d192a5815b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:10.237849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60d7c-f464-4c73-b63b-66d192a5815b None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:10.239654 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 83/168] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:10.246010 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74497ac5-c8bd-4518-9e66-33f681a02dd4 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:10.246633 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74497ac5-c8bd-4518-9e66-33f681a02dd4 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:10.247156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74497ac5-c8bd-4518-9e66-33f681a02dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:10.268722 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-74497ac5-c8bd-4518-9e66-33f681a02dd4 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:10.270675 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-74497ac5-c8bd-4518-9e66-33f681a02dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:10.336566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 86/169] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:10.362402 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece60d7c-f464-4c73-b63b-66d192a5815b None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:10.377269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece60d7c-f464-4c73-b63b-66d192a5815b None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:10.383436 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562d4f5-1601-4c9c-84e9-217c8da20409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:10.384305 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562d4f5-1601-4c9c-84e9-217c8da20409 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:10.384584 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562d4f5-1601-4c9c-84e9-217c8da20409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:10.384853 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562d4f5-1601-4c9c-84e9-217c8da20409 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:10.386037 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562d4f5-1601-4c9c-84e9-217c8da20409 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:10.387719 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562d4f5-1601-4c9c-84e9-217c8da20409 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:10.389419 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 84/170] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:10.395036 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74497ac5-c8bd-4518-9e66-33f681a02dd4 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:10.404669 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74497ac5-c8bd-4518-9e66-33f681a02dd4 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:10.409081 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09123df-0733-49fc-a298-0d028cfab7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:10.409754 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09123df-0733-49fc-a298-0d028cfab7ca admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:10.410035 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09123df-0733-49fc-a298-0d028cfab7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:10.410304 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09123df-0733-49fc-a298-0d028cfab7ca admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:10.411023 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09123df-0733-49fc-a298-0d028cfab7ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:10.413023 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09123df-0733-49fc-a298-0d028cfab7ca admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:10.434492 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 87/171] 10.222.0.77 () {60 vars in 1153 bytes} [Thu Feb 10 23:03:10 2022] POST /identity/v3/users => generated 283 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:03:10.435971 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9050d76-b6c3-4eff-adba-5a34918ad318 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:10.436447 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9050d76-b6c3-4eff-adba-5a34918ad318 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:10.436558 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9050d76-b6c3-4eff-adba-5a34918ad318 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:10.438559 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 85/172] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:03:10.445932 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0ef14-0b08-43c4-8048-72cf7088bd88 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:10.446221 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0ef14-0b08-43c4-8048-72cf7088bd88 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:10.446504 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0ef14-0b08-43c4-8048-72cf7088bd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:10.466292 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-52d0ef14-0b08-43c4-8048-72cf7088bd88 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:10.467747 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-52d0ef14-0b08-43c4-8048-72cf7088bd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:10.477021 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 88/173] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:10.501422 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9050d76-b6c3-4eff-adba-5a34918ad318 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:10.514904 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9050d76-b6c3-4eff-adba-5a34918ad318 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:10.519414 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0878c2-c67c-44c5-b626-62d94a9a62b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:10.520401 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0878c2-c67c-44c5-b626-62d94a9a62b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:10.520786 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0878c2-c67c-44c5-b626-62d94a9a62b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:10.521206 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0878c2-c67c-44c5-b626-62d94a9a62b8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:10.534221 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0878c2-c67c-44c5-b626-62d94a9a62b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:10.542349 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-2b0878c2-c67c-44c5-b626-62d94a9a62b8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 23:03:10.543966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 86/174] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:03:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:10.549481 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0ef14-0b08-43c4-8048-72cf7088bd88 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:10.560173 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0ef14-0b08-43c4-8048-72cf7088bd88 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:10.564594 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cde1e-f647-47c7-89df-a3e1e633b99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:10.565269 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cde1e-f647-47c7-89df-a3e1e633b99b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:10.565551 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cde1e-f647-47c7-89df-a3e1e633b99b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:10.565826 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cde1e-f647-47c7-89df-a3e1e633b99b admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:10.566601 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cde1e-f647-47c7-89df-a3e1e633b99b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:10.566903 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cde1e-f647-47c7-89df-a3e1e633b99b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:10.568563 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cde1e-f647-47c7-89df-a3e1e633b99b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:10.583654 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 89/175] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:10.585439 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0878c2-c67c-44c5-b626-62d94a9a62b8 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:10.596542 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0878c2-c67c-44c5-b626-62d94a9a62b8 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:10.601943 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4886c5-2c71-40bb-9bdc-e3d5589d637f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:10.602958 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4886c5-2c71-40bb-9bdc-e3d5589d637f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:10.603234 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4886c5-2c71-40bb-9bdc-e3d5589d637f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:10.603573 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4886c5-2c71-40bb-9bdc-e3d5589d637f admin admin] PATH_INFO: `/v3/users/e90634c2f9fb4792963d0551248329a4` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:10.604917 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4886c5-2c71-40bb-9bdc-e3d5589d637f admin admin] RBAC: Authorizing `identity:get_user(user_id=e90634c2f9fb4792963d0551248329a4)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:10.607133 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4886c5-2c71-40bb-9bdc-e3d5589d637f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:10.609032 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 87/176] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:10 2022] GET /identity/v3/users/e90634c2f9fb4792963d0551248329a4 => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:10.614701 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cde1e-f647-47c7-89df-a3e1e633b99b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:10.625069 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cde1e-f647-47c7-89df-a3e1e633b99b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:10.629379 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19b31c-6bab-4296-9e95-5486e19f3d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:10.630013 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19b31c-6bab-4296-9e95-5486e19f3d3c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:10.630295 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19b31c-6bab-4296-9e95-5486e19f3d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:10.630568 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19b31c-6bab-4296-9e95-5486e19f3d3c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:10.639124 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19b31c-6bab-4296-9e95-5486e19f3d3c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:10.640942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19b31c-6bab-4296-9e95-5486e19f3d3c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:10.650711 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 90/177] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:10.656145 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4886c5-2c71-40bb-9bdc-e3d5589d637f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:10.666387 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4886c5-2c71-40bb-9bdc-e3d5589d637f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:10.670700 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a25156-7aca-435f-bd52-344f00956398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:10.671537 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a25156-7aca-435f-bd52-344f00956398 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:10.671856 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a25156-7aca-435f-bd52-344f00956398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:10.672135 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a25156-7aca-435f-bd52-344f00956398 admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:10.673389 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a25156-7aca-435f-bd52-344f00956398 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff1d62262d6348b39c63a74a5afe64bd)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:10.675567 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a25156-7aca-435f-bd52-344f00956398 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:10.677384 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 88/178] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:10 2022] GET /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:10.683658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19b31c-6bab-4296-9e95-5486e19f3d3c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:10.693490 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19b31c-6bab-4296-9e95-5486e19f3d3c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:10.698781 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432a50e-e51e-463b-88b8-8343b8ec1c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:10.699476 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432a50e-e51e-463b-88b8-8343b8ec1c0a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:10.699809 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432a50e-e51e-463b-88b8-8343b8ec1c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:10.700112 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432a50e-e51e-463b-88b8-8343b8ec1c0a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:10.701022 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432a50e-e51e-463b-88b8-8343b8ec1c0a admin admin] RBAC: Adding query filter params (role.id=7f727831e261404999a27a5a15b515b1, scope.project.id=ff1d62262d6348b39c63a74a5afe64bd, user.id=e90634c2f9fb4792963d0551248329a4) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:10.701330 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432a50e-e51e-463b-88b8-8343b8ec1c0a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:10.703219 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432a50e-e51e-463b-88b8-8343b8ec1c0a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:10.711205 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 91/179] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:10 2022] GET /identity/v3/role_assignments?user.id=e90634c2f9fb4792963d0551248329a4&scope.project.id=ff1d62262d6348b39c63a74a5afe64bd&role.id=7f727831e261404999a27a5a15b515b1 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:12.481774 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fe960-1c67-4154-89fa-2b81c8205933 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:12.482324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fe960-1c67-4154-89fa-2b81c8205933 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:12.482324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fe960-1c67-4154-89fa-2b81c8205933 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:12.484146 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 89/180] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:12.489806 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e9e49-f7e0-4b23-9123-711d8f2583e0 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:12.490242 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e9e49-f7e0-4b23-9123-711d8f2583e0 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:12.490343 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e9e49-f7e0-4b23-9123-711d8f2583e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:12.509170 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-7e9e9e49-f7e0-4b23-9123-711d8f2583e0 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:12.510346 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-7e9e9e49-f7e0-4b23-9123-711d8f2583e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:12.518257 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 92/181] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:12.542112 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fe960-1c67-4154-89fa-2b81c8205933 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:12.558880 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fe960-1c67-4154-89fa-2b81c8205933 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:12.563419 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81539cda-cd23-42f2-ac37-093377ae7ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:12.564285 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539cda-cd23-42f2-ac37-093377ae7ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:12.564571 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539cda-cd23-42f2-ac37-093377ae7ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:12.564847 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539cda-cd23-42f2-ac37-093377ae7ec4 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:12.578381 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81539cda-cd23-42f2-ac37-093377ae7ec4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:12.586253 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-81539cda-cd23-42f2-ac37-093377ae7ec4 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 23:03:12.587773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 90/182] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:12.593368 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e9e49-f7e0-4b23-9123-711d8f2583e0 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:12.603414 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e9e49-f7e0-4b23-9123-711d8f2583e0 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:12.607888 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ba12c-e514-4f47-a6c6-a39607061652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:12.608556 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ba12c-e514-4f47-a6c6-a39607061652 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:12.608841 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ba12c-e514-4f47-a6c6-a39607061652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:12.609115 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ba12c-e514-4f47-a6c6-a39607061652 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:12.609886 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ba12c-e514-4f47-a6c6-a39607061652 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:12.610190 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ba12c-e514-4f47-a6c6-a39607061652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:12.612136 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ba12c-e514-4f47-a6c6-a39607061652 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:12.621149 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 93/183] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:12.626450 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81539cda-cd23-42f2-ac37-093377ae7ec4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:12.636495 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81539cda-cd23-42f2-ac37-093377ae7ec4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:12.640896 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d6d87-b823-4465-aec3-cc9f6dd05e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:12.641755 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d6d87-b823-4465-aec3-cc9f6dd05e96 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:12.642043 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d6d87-b823-4465-aec3-cc9f6dd05e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:12.642324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d6d87-b823-4465-aec3-cc9f6dd05e96 admin admin] PATH_INFO: `/v3/users/b244533bd84d481c8ef4b099da492bdd` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:12.643537 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d6d87-b823-4465-aec3-cc9f6dd05e96 admin admin] RBAC: Authorizing `identity:get_user(user_id=b244533bd84d481c8ef4b099da492bdd)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:12.645700 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d6d87-b823-4465-aec3-cc9f6dd05e96 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:12.647282 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 91/184] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:12 2022] GET /identity/v3/users/b244533bd84d481c8ef4b099da492bdd => generated 289 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:12.653719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ba12c-e514-4f47-a6c6-a39607061652 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:12.664132 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ba12c-e514-4f47-a6c6-a39607061652 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:12.668570 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c73e95-a111-4e65-af10-88cd4812f8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:12.669202 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c73e95-a111-4e65-af10-88cd4812f8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:12.669488 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c73e95-a111-4e65-af10-88cd4812f8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:12.669761 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c73e95-a111-4e65-af10-88cd4812f8d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:12.678093 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c73e95-a111-4e65-af10-88cd4812f8d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:12.680668 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c73e95-a111-4e65-af10-88cd4812f8d0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:12.690181 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 94/185] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:12.696455 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d6d87-b823-4465-aec3-cc9f6dd05e96 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:12.707452 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d6d87-b823-4465-aec3-cc9f6dd05e96 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:12.712512 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e21d5c-d693-4526-8ec4-bbaa3cea9dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:12.713466 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e21d5c-d693-4526-8ec4-bbaa3cea9dce admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:12.713750 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e21d5c-d693-4526-8ec4-bbaa3cea9dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:12.714034 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e21d5c-d693-4526-8ec4-bbaa3cea9dce admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:12.715417 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e21d5c-d693-4526-8ec4-bbaa3cea9dce admin admin] RBAC: Authorizing `identity:get_project(project_id=ff1d62262d6348b39c63a74a5afe64bd)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:12.717542 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e21d5c-d693-4526-8ec4-bbaa3cea9dce admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:12.719669 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 92/186] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:12 2022] GET /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:12.725786 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c73e95-a111-4e65-af10-88cd4812f8d0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:12.735447 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c73e95-a111-4e65-af10-88cd4812f8d0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:12.740174 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a42b4-fcb9-4554-8546-26411c568e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:12.740889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a42b4-fcb9-4554-8546-26411c568e20 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:12.741172 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a42b4-fcb9-4554-8546-26411c568e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:12.742023 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a42b4-fcb9-4554-8546-26411c568e20 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:12.742876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a42b4-fcb9-4554-8546-26411c568e20 admin admin] RBAC: Adding query filter params (role.id=d73ea8a0130d4158afa3b074bb2a4ccb, scope.project.id=ff1d62262d6348b39c63a74a5afe64bd, user.id=b244533bd84d481c8ef4b099da492bdd) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:12.743184 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a42b4-fcb9-4554-8546-26411c568e20 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:12.745060 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a42b4-fcb9-4554-8546-26411c568e20 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:12.751943 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 95/187] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:12 2022] GET /identity/v3/role_assignments?user.id=b244533bd84d481c8ef4b099da492bdd&scope.project.id=ff1d62262d6348b39c63a74a5afe64bd&role.id=d73ea8a0130d4158afa3b074bb2a4ccb => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:12.867676 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea258366-78ca-4e4a-9ad5-d5a06379a83e None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:12.867676 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea258366-78ca-4e4a-9ad5-d5a06379a83e None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:12.867676 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea258366-78ca-4e4a-9ad5-d5a06379a83e None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:12.867676 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 93/188] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:12.873868 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401538e-dc08-4774-981b-5fb65b5eb74d None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:12.874382 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401538e-dc08-4774-981b-5fb65b5eb74d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:12.874805 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401538e-dc08-4774-981b-5fb65b5eb74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:12.893521 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-5401538e-dc08-4774-981b-5fb65b5eb74d None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:12.894965 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-5401538e-dc08-4774-981b-5fb65b5eb74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:12.903487 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 96/189] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:12.928287 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea258366-78ca-4e4a-9ad5-d5a06379a83e None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:12.941364 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea258366-78ca-4e4a-9ad5-d5a06379a83e None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:12.945937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d5b36-4ae7-4790-887d-57be3b94ede2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:12.946724 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d5b36-4ae7-4790-887d-57be3b94ede2 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:12.947010 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d5b36-4ae7-4790-887d-57be3b94ede2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:12.947287 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d5b36-4ae7-4790-887d-57be3b94ede2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:12.957960 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d5b36-4ae7-4790-887d-57be3b94ede2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:12.964880 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-106d5b36-4ae7-4790-887d-57be3b94ede2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:03:12.966091 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 94/190] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:03:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:12.971788 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401538e-dc08-4774-981b-5fb65b5eb74d None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:12.981718 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401538e-dc08-4774-981b-5fb65b5eb74d None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:12.986485 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56320a9-a4c8-4de2-b1dd-60448d6f86fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:12.987100 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56320a9-a4c8-4de2-b1dd-60448d6f86fc admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:12.987383 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56320a9-a4c8-4de2-b1dd-60448d6f86fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:12.987666 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56320a9-a4c8-4de2-b1dd-60448d6f86fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:12.988468 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56320a9-a4c8-4de2-b1dd-60448d6f86fc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:12.988780 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56320a9-a4c8-4de2-b1dd-60448d6f86fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:12.990396 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56320a9-a4c8-4de2-b1dd-60448d6f86fc admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:12.994306 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49242bdb-0fad-44e7-bce8-d7d122ed551a None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:12.994860 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49242bdb-0fad-44e7-bce8-d7d122ed551a None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:12.995355 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49242bdb-0fad-44e7-bce8-d7d122ed551a None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:12.997469 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 95/191] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:03:13.000014 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 97/192] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:13.003665 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c3022-9930-4b94-b6d6-7a2c1c6e0da2 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:13.004175 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c3022-9930-4b94-b6d6-7a2c1c6e0da2 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:13.004545 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c3022-9930-4b94-b6d6-7a2c1c6e0da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:13.008349 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56320a9-a4c8-4de2-b1dd-60448d6f86fc admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:13.019200 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56320a9-a4c8-4de2-b1dd-60448d6f86fc admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:13.024693 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89907d0-b983-475c-a542-add6f1a413a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:13.025812 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89907d0-b983-475c-a542-add6f1a413a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:13.026242 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89907d0-b983-475c-a542-add6f1a413a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:13.026708 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89907d0-b983-475c-a542-add6f1a413a6 admin admin] PATH_INFO: `/v3/users/bfa4324665f143248433c3f19ff3a58f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:13.029505 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-cc5c3022-9930-4b94-b6d6-7a2c1c6e0da2 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:13.034365 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-cc5c3022-9930-4b94-b6d6-7a2c1c6e0da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:13.044620 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 96/193] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:13.044879 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89907d0-b983-475c-a542-add6f1a413a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=bfa4324665f143248433c3f19ff3a58f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:13.047107 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89907d0-b983-475c-a542-add6f1a413a6 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:13.048984 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 98/194] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:13 2022] GET /identity/v3/users/bfa4324665f143248433c3f19ff3a58f => generated 283 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:13.054713 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c3022-9930-4b94-b6d6-7a2c1c6e0da2 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:13.064128 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c3022-9930-4b94-b6d6-7a2c1c6e0da2 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:13.068408 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75540443-3801-450b-bd2d-2f66e8997970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:13.069137 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75540443-3801-450b-bd2d-2f66e8997970 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:13.070023 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75540443-3801-450b-bd2d-2f66e8997970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:13.070366 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75540443-3801-450b-bd2d-2f66e8997970 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:13.072004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89907d0-b983-475c-a542-add6f1a413a6 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:13.079050 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75540443-3801-450b-bd2d-2f66e8997970 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:13.080848 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75540443-3801-450b-bd2d-2f66e8997970 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:13.084352 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89907d0-b983-475c-a542-add6f1a413a6 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:13.091100 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 97/195] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 23:03:13.092500 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e4b82-6fd2-492b-8058-9d64400c11bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:13.093503 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e4b82-6fd2-492b-8058-9d64400c11bc admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:13.093964 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e4b82-6fd2-492b-8058-9d64400c11bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:13.094430 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e4b82-6fd2-492b-8058-9d64400c11bc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:13.096746 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75540443-3801-450b-bd2d-2f66e8997970 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:13.105342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75540443-3801-450b-bd2d-2f66e8997970 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:13.105664 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e4b82-6fd2-492b-8058-9d64400c11bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:13.109557 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2845a-f475-48e5-901a-6ce2c5e5c813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:13.110378 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2845a-f475-48e5-901a-6ce2c5e5c813 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:13.110922 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2845a-f475-48e5-901a-6ce2c5e5c813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:13.111201 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2845a-f475-48e5-901a-6ce2c5e5c813 admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:13.112458 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2845a-f475-48e5-901a-6ce2c5e5c813 admin admin] RBAC: Authorizing `identity:get_project(project_id=d3485c2fbadb4400a6eacec1952e81f3)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:13.113181 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-1f5e4b82-6fd2-492b-8058-9d64400c11bc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 23:03:13.114367 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 99/196] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:03:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:03:13.114968 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2845a-f475-48e5-901a-6ce2c5e5c813 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:13.121677 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 98/197] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:13 2022] GET /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:13.121799 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e4b82-6fd2-492b-8058-9d64400c11bc admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:13.122923 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d808d2-4a64-46f3-9070-90c2475ff03d None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:13.123205 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d808d2-4a64-46f3-9070-90c2475ff03d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:13.123478 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d808d2-4a64-46f3-9070-90c2475ff03d None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:13.125168 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 99/198] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:03:13.125850 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d808d2-4a64-46f3-9070-90c2475ff03d None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:13.129498 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e4b82-6fd2-492b-8058-9d64400c11bc admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:13.134427 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686163f4-18ee-403a-a989-2d49709c1d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:13.135060 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686163f4-18ee-403a-a989-2d49709c1d5f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:13.135347 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686163f4-18ee-403a-a989-2d49709c1d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:13.135619 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686163f4-18ee-403a-a989-2d49709c1d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:13.136420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686163f4-18ee-403a-a989-2d49709c1d5f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:13.136728 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686163f4-18ee-403a-a989-2d49709c1d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:13.138118 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d808d2-4a64-46f3-9070-90c2475ff03d None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:13.138326 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686163f4-18ee-403a-a989-2d49709c1d5f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:13.142191 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7611e98-af6c-4634-8bae-60ef190fdd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:13.142773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7611e98-af6c-4634-8bae-60ef190fdd03 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:13.143073 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7611e98-af6c-4634-8bae-60ef190fdd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:13.143323 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7611e98-af6c-4634-8bae-60ef190fdd03 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:13.144201 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7611e98-af6c-4634-8bae-60ef190fdd03 admin admin] RBAC: Adding query filter params (role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f, scope.project.id=d3485c2fbadb4400a6eacec1952e81f3, user.id=bfa4324665f143248433c3f19ff3a58f) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:13.144509 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7611e98-af6c-4634-8bae-60ef190fdd03 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:13.146299 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7611e98-af6c-4634-8bae-60ef190fdd03 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:13.149168 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 100/199] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:13.151446 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7ae3c-74e5-4382-8bdd-d17e5cec1da6 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:13.151744 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7ae3c-74e5-4382-8bdd-d17e5cec1da6 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:13.152053 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7ae3c-74e5-4382-8bdd-d17e5cec1da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:13.152448 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 100/200] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:13 2022] GET /identity/v3/role_assignments?user.id=bfa4324665f143248433c3f19ff3a58f&scope.project.id=d3485c2fbadb4400a6eacec1952e81f3&role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:13.154430 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7611e98-af6c-4634-8bae-60ef190fdd03 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:13.164356 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7611e98-af6c-4634-8bae-60ef190fdd03 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:13.168812 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc76914-129b-4dc1-8d0d-271bfd23c139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:13.169702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc76914-129b-4dc1-8d0d-271bfd23c139 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:13.169986 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc76914-129b-4dc1-8d0d-271bfd23c139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:13.170260 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc76914-129b-4dc1-8d0d-271bfd23c139 admin admin] PATH_INFO: `/v3/users/bfa4324665f143248433c3f19ff3a58f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:13.171537 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc76914-129b-4dc1-8d0d-271bfd23c139 admin admin] RBAC: Authorizing `identity:get_user(user_id=bfa4324665f143248433c3f19ff3a58f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:13.173746 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc76914-129b-4dc1-8d0d-271bfd23c139 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:13.174712 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-25f7ae3c-74e5-4382-8bdd-d17e5cec1da6 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:13.175589 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 101/201] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:13 2022] GET /identity/v3/users/bfa4324665f143248433c3f19ff3a58f => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:13.176583 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-25f7ae3c-74e5-4382-8bdd-d17e5cec1da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:13.181744 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc76914-129b-4dc1-8d0d-271bfd23c139 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:13.188040 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 101/202] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:13.191584 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc76914-129b-4dc1-8d0d-271bfd23c139 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:13.203868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc1230-47c1-43bb-9074-773677aaba28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:13.203868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc1230-47c1-43bb-9074-773677aaba28 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:13.203868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc1230-47c1-43bb-9074-773677aaba28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:13.203868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc1230-47c1-43bb-9074-773677aaba28 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:13.206659 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc1230-47c1-43bb-9074-773677aaba28 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:13.208489 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc1230-47c1-43bb-9074-773677aaba28 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:13.214113 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7ae3c-74e5-4382-8bdd-d17e5cec1da6 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:13.218970 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 102/203] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:13.223790 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7ae3c-74e5-4382-8bdd-d17e5cec1da6 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:13.224515 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc1230-47c1-43bb-9074-773677aaba28 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:13.228546 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd71916-1819-42c8-bb0f-ee6b9b0f4eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:13.229363 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd71916-1819-42c8-bb0f-ee6b9b0f4eda admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:13.229650 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd71916-1819-42c8-bb0f-ee6b9b0f4eda admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:13.229927 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd71916-1819-42c8-bb0f-ee6b9b0f4eda admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:13.231739 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd71916-1819-42c8-bb0f-ee6b9b0f4eda admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:13.232923 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd71916-1819-42c8-bb0f-ee6b9b0f4eda admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:13.234790 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 102/204] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:13.235317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc1230-47c1-43bb-9074-773677aaba28 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:13.240289 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e84d82-efae-4c77-a048-497bbce2a25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:13.240565 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd71916-1819-42c8-bb0f-ee6b9b0f4eda admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:13.241240 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e84d82-efae-4c77-a048-497bbce2a25e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:13.242116 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e84d82-efae-4c77-a048-497bbce2a25e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:13.242460 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e84d82-efae-4c77-a048-497bbce2a25e admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:13.243770 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e84d82-efae-4c77-a048-497bbce2a25e admin admin] RBAC: Authorizing `identity:get_project(project_id=d3485c2fbadb4400a6eacec1952e81f3)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:13.245953 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e84d82-efae-4c77-a048-497bbce2a25e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:13.247910 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 103/205] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:13 2022] GET /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:13.251701 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd71916-1819-42c8-bb0f-ee6b9b0f4eda admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:13.253872 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e84d82-efae-4c77-a048-497bbce2a25e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:13.256279 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b7e34-fdfc-4d91-8188-6a13b2a249d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:13.257009 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b7e34-fdfc-4d91-8188-6a13b2a249d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:13.257798 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b7e34-fdfc-4d91-8188-6a13b2a249d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:13.258069 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b7e34-fdfc-4d91-8188-6a13b2a249d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:13.258805 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b7e34-fdfc-4d91-8188-6a13b2a249d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:13.260777 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b7e34-fdfc-4d91-8188-6a13b2a249d3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:13.265222 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e84d82-efae-4c77-a048-497bbce2a25e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:13.270254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0702a-7f59-4900-9913-053c45c346b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:13.271153 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0702a-7f59-4900-9913-053c45c346b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:13.271305 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0702a-7f59-4900-9913-053c45c346b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:13.271850 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0702a-7f59-4900-9913-053c45c346b3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:13.272979 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0702a-7f59-4900-9913-053c45c346b3 admin admin] RBAC: Adding query filter params (role.id=7f727831e261404999a27a5a15b515b1, scope.project.id=d3485c2fbadb4400a6eacec1952e81f3, user.id=bfa4324665f143248433c3f19ff3a58f) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:13.273146 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0702a-7f59-4900-9913-053c45c346b3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:13.275215 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0702a-7f59-4900-9913-053c45c346b3 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:13.282955 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 104/206] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:13 2022] GET /identity/v3/role_assignments?user.id=bfa4324665f143248433c3f19ff3a58f&scope.project.id=d3485c2fbadb4400a6eacec1952e81f3&role.id=7f727831e261404999a27a5a15b515b1 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:13.290862 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 103/207] 10.222.0.77 () {60 vars in 1153 bytes} [Thu Feb 10 23:03:13 2022] POST /identity/v3/users => generated 297 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:03:15.423571 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fb687-6ec8-43c8-b159-a61cf5623705 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.424122 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fb687-6ec8-43c8-b159-a61cf5623705 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.424203 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fb687-6ec8-43c8-b159-a61cf5623705 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.425923 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 105/208] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:15.432078 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10a50c-50de-4e5b-9359-5d087fcea25a None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.432507 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10a50c-50de-4e5b-9359-5d087fcea25a None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.432674 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10a50c-50de-4e5b-9359-5d087fcea25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.451102 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-9b10a50c-50de-4e5b-9359-5d087fcea25a None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:15.452407 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-9b10a50c-50de-4e5b-9359-5d087fcea25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:15.461005 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 104/209] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:15.484290 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fb687-6ec8-43c8-b159-a61cf5623705 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:15.497068 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fb687-6ec8-43c8-b159-a61cf5623705 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:15.501718 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e0e7f-7ec4-479f-bad6-59e13d415db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:15.502736 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e0e7f-7ec4-479f-bad6-59e13d415db3 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.503219 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e0e7f-7ec4-479f-bad6-59e13d415db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.503723 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e0e7f-7ec4-479f-bad6-59e13d415db3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.514626 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e0e7f-7ec4-479f-bad6-59e13d415db3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:15.521747 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8f76a-8c8f-4330-8295-917f9e3f6d97 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.522034 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8f76a-8c8f-4330-8295-917f9e3f6d97 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.522282 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-719e0e7f-7ec4-479f-bad6-59e13d415db3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:03:15.522399 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8f76a-8c8f-4330-8295-917f9e3f6d97 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.524377 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 106/210] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:03:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:15.525041 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 105/211] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:03:15.532325 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e0e7f-7ec4-479f-bad6-59e13d415db3 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:15.533379 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4ca90-ba0f-4921-9561-f92b8d3f1f02 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.533664 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4ca90-ba0f-4921-9561-f92b8d3f1f02 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.533932 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4ca90-ba0f-4921-9561-f92b8d3f1f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.544033 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e0e7f-7ec4-479f-bad6-59e13d415db3 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:15.548669 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5c7d8-4e56-407f-b35c-2bc6b346707c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:15.549553 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5c7d8-4e56-407f-b35c-2bc6b346707c admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.550050 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5c7d8-4e56-407f-b35c-2bc6b346707c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.550515 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5c7d8-4e56-407f-b35c-2bc6b346707c admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.551464 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5c7d8-4e56-407f-b35c-2bc6b346707c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:15.551993 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5c7d8-4e56-407f-b35c-2bc6b346707c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:15.552549 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-73f4ca90-ba0f-4921-9561-f92b8d3f1f02 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:15.553995 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-73f4ca90-ba0f-4921-9561-f92b8d3f1f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:15.554247 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5c7d8-4e56-407f-b35c-2bc6b346707c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:15.563057 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 107/212] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:15.564019 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 106/213] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:15.573860 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5c7d8-4e56-407f-b35c-2bc6b346707c admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:15.583715 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5c7d8-4e56-407f-b35c-2bc6b346707c admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:15.587338 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4ca90-ba0f-4921-9561-f92b8d3f1f02 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:15.591007 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683827a9-6a25-4ced-adb8-4597018a9b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:15.592212 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683827a9-6a25-4ced-adb8-4597018a9b9e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.592697 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683827a9-6a25-4ced-adb8-4597018a9b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.592980 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683827a9-6a25-4ced-adb8-4597018a9b9e admin admin] PATH_INFO: `/v3/users/bfa4324665f143248433c3f19ff3a58f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.594171 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683827a9-6a25-4ced-adb8-4597018a9b9e admin admin] RBAC: Authorizing `identity:get_user(user_id=bfa4324665f143248433c3f19ff3a58f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:15.596326 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683827a9-6a25-4ced-adb8-4597018a9b9e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:15.596802 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4ca90-ba0f-4921-9561-f92b8d3f1f02 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:15.598012 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 108/214] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:15 2022] GET /identity/v3/users/bfa4324665f143248433c3f19ff3a58f => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:15.603926 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683827a9-6a25-4ced-adb8-4597018a9b9e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:15.604195 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5465792-4d50-4315-96f8-0aef3125621f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:15.605203 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5465792-4d50-4315-96f8-0aef3125621f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.605679 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5465792-4d50-4315-96f8-0aef3125621f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.606156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5465792-4d50-4315-96f8-0aef3125621f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.613539 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683827a9-6a25-4ced-adb8-4597018a9b9e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:15.618587 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5465792-4d50-4315-96f8-0aef3125621f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:15.619362 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8fd14-18e4-48d3-aca8-17c1f6e88520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:15.620231 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8fd14-18e4-48d3-aca8-17c1f6e88520 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.620508 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8fd14-18e4-48d3-aca8-17c1f6e88520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.620779 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8fd14-18e4-48d3-aca8-17c1f6e88520 admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.621951 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8fd14-18e4-48d3-aca8-17c1f6e88520 admin admin] RBAC: Authorizing `identity:get_project(project_id=d3485c2fbadb4400a6eacec1952e81f3)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:15.624004 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8fd14-18e4-48d3-aca8-17c1f6e88520 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:15.625635 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 109/215] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:15 2022] GET /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:15.628219 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-c5465792-4d50-4315-96f8-0aef3125621f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 23:03:15.629751 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 107/216] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:03:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:03:15.636874 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8fd14-18e4-48d3-aca8-17c1f6e88520 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:15.640048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5465792-4d50-4315-96f8-0aef3125621f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:15.647446 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8fd14-18e4-48d3-aca8-17c1f6e88520 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:15.651375 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5465792-4d50-4315-96f8-0aef3125621f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:15.653086 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad974347-13ae-4a16-bb10-7bb9f015b20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:15.654183 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad974347-13ae-4a16-bb10-7bb9f015b20a admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.654851 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad974347-13ae-4a16-bb10-7bb9f015b20a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.655321 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad974347-13ae-4a16-bb10-7bb9f015b20a admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3/users/bfa4324665f143248433c3f19ff3a58f/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.655747 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719ef6d-fdd3-4c6d-ae1c-6e40aff30745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:15.656418 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719ef6d-fdd3-4c6d-ae1c-6e40aff30745 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.656695 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719ef6d-fdd3-4c6d-ae1c-6e40aff30745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.656961 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719ef6d-fdd3-4c6d-ae1c-6e40aff30745 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.657720 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719ef6d-fdd3-4c6d-ae1c-6e40aff30745 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:15.658020 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719ef6d-fdd3-4c6d-ae1c-6e40aff30745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:15.658759 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad974347-13ae-4a16-bb10-7bb9f015b20a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3485c2fbadb4400a6eacec1952e81f3, user_id=bfa4324665f143248433c3f19ff3a58f, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:15.659586 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719ef6d-fdd3-4c6d-ae1c-6e40aff30745 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:15.664112 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad974347-13ae-4a16-bb10-7bb9f015b20a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:15.670239 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 108/217] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:15.672968 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d3de2-c750-40eb-8996-e8d2e194b5f1 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.673292 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d3de2-c750-40eb-8996-e8d2e194b5f1 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.673514 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d3de2-c750-40eb-8996-e8d2e194b5f1 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.675911 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 109/218] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:03:15.677871 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d3de2-c750-40eb-8996-e8d2e194b5f1 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:15.683872 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 110/219] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:03:15 2022] PUT /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3/users/bfa4324665f143248433c3f19ff3a58f/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:03:15.685134 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fdded-5ecf-47db-a386-384e257970af None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.685424 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fdded-5ecf-47db-a386-384e257970af None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.685702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fdded-5ecf-47db-a386-384e257970af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.704267 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-0f4fdded-5ecf-47db-a386-384e257970af None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:15.705483 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-0f4fdded-5ecf-47db-a386-384e257970af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:15.759871 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d3de2-c750-40eb-8996-e8d2e194b5f1 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:15.765007 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3088c69-b9be-483d-99ab-591673c1b8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:15.766198 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3088c69-b9be-483d-99ab-591673c1b8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.766198 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3088c69-b9be-483d-99ab-591673c1b8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.766464 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3088c69-b9be-483d-99ab-591673c1b8a6 admin admin] PATH_INFO: `/v3/users/bfa4324665f143248433c3f19ff3a58f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.767749 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3088c69-b9be-483d-99ab-591673c1b8a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=bfa4324665f143248433c3f19ff3a58f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:15.770327 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3088c69-b9be-483d-99ab-591673c1b8a6 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:15.772109 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 110/220] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:15 2022] GET /identity/v3/users/bfa4324665f143248433c3f19ff3a58f => generated 283 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:15.773985 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709c785-2eef-4c8a-92df-6a4aecb39051 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.774277 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709c785-2eef-4c8a-92df-6a4aecb39051 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.774561 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709c785-2eef-4c8a-92df-6a4aecb39051 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.776628 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 111/221] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:15.779634 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709c785-2eef-4c8a-92df-6a4aecb39051 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:15.787372 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 111/222] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:15.789220 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71544647-0fe8-437b-bfd3-6dba90047b39 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.789511 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71544647-0fe8-437b-bfd3-6dba90047b39 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.789787 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71544647-0fe8-437b-bfd3-6dba90047b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.797288 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709c785-2eef-4c8a-92df-6a4aecb39051 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:15.802003 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904c568-d0f1-4b5e-b00e-8ae090aa41b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:15.803088 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904c568-d0f1-4b5e-b00e-8ae090aa41b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.803526 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904c568-d0f1-4b5e-b00e-8ae090aa41b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.804687 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904c568-d0f1-4b5e-b00e-8ae090aa41b4 admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.806424 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904c568-d0f1-4b5e-b00e-8ae090aa41b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=d3485c2fbadb4400a6eacec1952e81f3)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:15.808664 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904c568-d0f1-4b5e-b00e-8ae090aa41b4 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:15.810589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 112/223] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:15 2022] GET /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:15.815609 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-71544647-0fe8-437b-bfd3-6dba90047b39 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:15.815609 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-71544647-0fe8-437b-bfd3-6dba90047b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:15.816792 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904c568-d0f1-4b5e-b00e-8ae090aa41b4 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:15.821951 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 112/224] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:15.822697 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71544647-0fe8-437b-bfd3-6dba90047b39 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:15.833469 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71544647-0fe8-437b-bfd3-6dba90047b39 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:15.835720 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904c568-d0f1-4b5e-b00e-8ae090aa41b4 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:15.838309 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c42ff-e835-4c5d-8182-cf342e2077e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:15.839250 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c42ff-e835-4c5d-8182-cf342e2077e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.839485 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c42ff-e835-4c5d-8182-cf342e2077e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.839753 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c42ff-e835-4c5d-8182-cf342e2077e8 admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3/users/bfa4324665f143248433c3f19ff3a58f/roles/7f727831e261404999a27a5a15b515b1` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.842055 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c42ff-e835-4c5d-8182-cf342e2077e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3485c2fbadb4400a6eacec1952e81f3, user_id=bfa4324665f143248433c3f19ff3a58f, role_id=7f727831e261404999a27a5a15b515b1)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:15.842973 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15b173-7a80-4579-be96-06f8f7312e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:15.844107 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15b173-7a80-4579-be96-06f8f7312e96 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.844609 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15b173-7a80-4579-be96-06f8f7312e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.844780 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c42ff-e835-4c5d-8182-cf342e2077e8 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:15.845281 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15b173-7a80-4579-be96-06f8f7312e96 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.859132 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 113/225] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:03:15 2022] PUT /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3/users/bfa4324665f143248433c3f19ff3a58f/roles/7f727831e261404999a27a5a15b515b1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:03:15.859680 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15b173-7a80-4579-be96-06f8f7312e96 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:15.861032 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c42ff-e835-4c5d-8182-cf342e2077e8 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:15.869586 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-6d15b173-7a80-4579-be96-06f8f7312e96 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 23:03:15.871231 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 113/226] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:15.877206 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15b173-7a80-4579-be96-06f8f7312e96 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:15.888878 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15b173-7a80-4579-be96-06f8f7312e96 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:15.943964 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c42ff-e835-4c5d-8182-cf342e2077e8 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:15.950313 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab01677-30fc-4bf0-9349-2c1375e7b4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:15.951450 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab01677-30fc-4bf0-9349-2c1375e7b4bd admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.951861 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab01677-30fc-4bf0-9349-2c1375e7b4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.952141 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab01677-30fc-4bf0-9349-2c1375e7b4bd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.952309 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d416c42-1d65-4185-8cf5-e7cef5551da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:15.953051 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d416c42-1d65-4185-8cf5-e7cef5551da4 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.953339 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d416c42-1d65-4185-8cf5-e7cef5551da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.953452 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab01677-30fc-4bf0-9349-2c1375e7b4bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:15.953612 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d416c42-1d65-4185-8cf5-e7cef5551da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.954394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d416c42-1d65-4185-8cf5-e7cef5551da4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:15.954710 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d416c42-1d65-4185-8cf5-e7cef5551da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:15.955240 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab01677-30fc-4bf0-9349-2c1375e7b4bd admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:15.956353 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d416c42-1d65-4185-8cf5-e7cef5551da4 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:15.957117 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 114/227] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:15.963296 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab01677-30fc-4bf0-9349-2c1375e7b4bd admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:15.968077 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 114/228] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:15.973731 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab01677-30fc-4bf0-9349-2c1375e7b4bd admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:15.973904 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d416c42-1d65-4185-8cf5-e7cef5551da4 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:15.979137 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319c4c2-a102-4596-8f02-3eaf1bb4bd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:15.979842 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319c4c2-a102-4596-8f02-3eaf1bb4bd78 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.980129 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319c4c2-a102-4596-8f02-3eaf1bb4bd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.980406 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319c4c2-a102-4596-8f02-3eaf1bb4bd78 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:15.981143 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319c4c2-a102-4596-8f02-3eaf1bb4bd78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:15.983139 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319c4c2-a102-4596-8f02-3eaf1bb4bd78 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:15.985492 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d416c42-1d65-4185-8cf5-e7cef5551da4 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:15.990546 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e273a4-b8f9-4bf4-925f-af2f8a98f4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:15.992170 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e273a4-b8f9-4bf4-925f-af2f8a98f4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:15.992451 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e273a4-b8f9-4bf4-925f-af2f8a98f4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:15.992728 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e273a4-b8f9-4bf4-925f-af2f8a98f4c2 admin admin] PATH_INFO: `/v3/users/328ffe50c8f14d0f9658fe8a4d0fe04f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:16.008404 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 115/229] 10.222.0.77 () {60 vars in 1153 bytes} [Thu Feb 10 23:03:15 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:03:16.011887 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e273a4-b8f9-4bf4-925f-af2f8a98f4c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=328ffe50c8f14d0f9658fe8a4d0fe04f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:16.011887 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e273a4-b8f9-4bf4-925f-af2f8a98f4c2 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:16.013712 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 115/230] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:15 2022] GET /identity/v3/users/328ffe50c8f14d0f9658fe8a4d0fe04f => generated 297 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:16.019493 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319c4c2-a102-4596-8f02-3eaf1bb4bd78 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:16.030802 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319c4c2-a102-4596-8f02-3eaf1bb4bd78 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:16.036600 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb90a4-2aff-4ac9-8c6c-36a2d35ca4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:16.037384 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb90a4-2aff-4ac9-8c6c-36a2d35ca4be admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:16.037673 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb90a4-2aff-4ac9-8c6c-36a2d35ca4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:16.037952 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb90a4-2aff-4ac9-8c6c-36a2d35ca4be admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:16.048714 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb90a4-2aff-4ac9-8c6c-36a2d35ca4be admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:16.050597 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb90a4-2aff-4ac9-8c6c-36a2d35ca4be admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:16.061531 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 116/231] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:16.066977 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e273a4-b8f9-4bf4-925f-af2f8a98f4c2 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:16.078240 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e273a4-b8f9-4bf4-925f-af2f8a98f4c2 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:16.083432 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9bf1d-e18a-4125-a76c-5f4ee11d80b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:16.084204 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9bf1d-e18a-4125-a76c-5f4ee11d80b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:16.084491 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9bf1d-e18a-4125-a76c-5f4ee11d80b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:16.084770 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9bf1d-e18a-4125-a76c-5f4ee11d80b0 admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:16.086810 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9bf1d-e18a-4125-a76c-5f4ee11d80b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=d3485c2fbadb4400a6eacec1952e81f3)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:16.089218 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9bf1d-e18a-4125-a76c-5f4ee11d80b0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:16.091151 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 116/232] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:16 2022] GET /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:16.097091 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb90a4-2aff-4ac9-8c6c-36a2d35ca4be admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:16.107210 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb90a4-2aff-4ac9-8c6c-36a2d35ca4be admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:16.112377 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca619859-449a-494d-ab51-4276a71badaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:16.113083 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca619859-449a-494d-ab51-4276a71badaf admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:16.113367 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca619859-449a-494d-ab51-4276a71badaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:16.113736 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca619859-449a-494d-ab51-4276a71badaf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:16.114693 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca619859-449a-494d-ab51-4276a71badaf admin admin] RBAC: Adding query filter params (role.id=419ebcf5b1d8470394e463c9f01cb154, scope.project.id=d3485c2fbadb4400a6eacec1952e81f3, user.id=328ffe50c8f14d0f9658fe8a4d0fe04f) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:16.115007 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca619859-449a-494d-ab51-4276a71badaf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:16.117575 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca619859-449a-494d-ab51-4276a71badaf admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:16.124072 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 117/233] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:16 2022] GET /identity/v3/role_assignments?user.id=328ffe50c8f14d0f9658fe8a4d0fe04f&scope.project.id=d3485c2fbadb4400a6eacec1952e81f3&role.id=419ebcf5b1d8470394e463c9f01cb154 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:18.306373 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b806e03-2871-46ce-9744-d3a5c712f944 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:18.307385 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b806e03-2871-46ce-9744-d3a5c712f944 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:18.307899 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b806e03-2871-46ce-9744-d3a5c712f944 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:18.309872 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 117/234] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:18.315409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f8fa3-ada8-47d7-a026-7de40b32f43d None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:18.315840 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f8fa3-ada8-47d7-a026-7de40b32f43d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:18.316030 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f8fa3-ada8-47d7-a026-7de40b32f43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:18.340490 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-357f8fa3-ada8-47d7-a026-7de40b32f43d None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:18.341688 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-357f8fa3-ada8-47d7-a026-7de40b32f43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:18.354191 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 118/235] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:18.377794 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b806e03-2871-46ce-9744-d3a5c712f944 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:18.399988 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b806e03-2871-46ce-9744-d3a5c712f944 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:18.408084 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d916512-1eed-4c2a-9fc1-7714ddb360fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:18.409172 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d916512-1eed-4c2a-9fc1-7714ddb360fd admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:18.409806 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d916512-1eed-4c2a-9fc1-7714ddb360fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:18.410275 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d916512-1eed-4c2a-9fc1-7714ddb360fd admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:18.429299 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d916512-1eed-4c2a-9fc1-7714ddb360fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:18.437167 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-3d916512-1eed-4c2a-9fc1-7714ddb360fd admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 23:03:18.438595 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 118/236] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:03:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:18.444645 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f8fa3-ada8-47d7-a026-7de40b32f43d None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:18.456784 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f8fa3-ada8-47d7-a026-7de40b32f43d None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:18.464372 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1e2a2-9469-401e-87d3-8db685beec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:18.465042 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1e2a2-9469-401e-87d3-8db685beec11 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:18.465327 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1e2a2-9469-401e-87d3-8db685beec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:18.465602 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1e2a2-9469-401e-87d3-8db685beec11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:18.466365 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1e2a2-9469-401e-87d3-8db685beec11 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:18.466670 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1e2a2-9469-401e-87d3-8db685beec11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:18.468325 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1e2a2-9469-401e-87d3-8db685beec11 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:18.480452 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 119/237] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:18.485915 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d916512-1eed-4c2a-9fc1-7714ddb360fd admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:18.500810 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d916512-1eed-4c2a-9fc1-7714ddb360fd admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:18.501332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7729ac6-8a7a-47ba-8421-e784d0ebea0e None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:18.501619 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7729ac6-8a7a-47ba-8421-e784d0ebea0e None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:18.501894 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7729ac6-8a7a-47ba-8421-e784d0ebea0e None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:18.504122 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 120/238] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:18.508774 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a7280-5914-4905-9fb2-9d421add61de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:18.509637 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a7280-5914-4905-9fb2-9d421add61de admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:18.509914 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a7280-5914-4905-9fb2-9d421add61de admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:18.510185 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a7280-5914-4905-9fb2-9d421add61de admin admin] PATH_INFO: `/v3/users/bfa4324665f143248433c3f19ff3a58f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:18.511995 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3405f-0d70-40b3-b61b-e1b5669519b9 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:18.512272 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3405f-0d70-40b3-b61b-e1b5669519b9 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:18.512538 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3405f-0d70-40b3-b61b-e1b5669519b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:18.514504 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a7280-5914-4905-9fb2-9d421add61de admin admin] RBAC: Authorizing `identity:get_user(user_id=bfa4324665f143248433c3f19ff3a58f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:18.516664 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a7280-5914-4905-9fb2-9d421add61de admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:18.518510 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 119/239] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:18 2022] GET /identity/v3/users/bfa4324665f143248433c3f19ff3a58f => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:18.524407 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a7280-5914-4905-9fb2-9d421add61de admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:18.543268 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-eea3405f-0d70-40b3-b61b-e1b5669519b9 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:18.544472 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-eea3405f-0d70-40b3-b61b-e1b5669519b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:18.548197 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a7280-5914-4905-9fb2-9d421add61de admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:18.555986 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e159f86-cd2d-403d-b8c1-777417b50b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:18.556638 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e159f86-cd2d-403d-b8c1-777417b50b0f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:18.556909 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e159f86-cd2d-403d-b8c1-777417b50b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:18.557183 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e159f86-cd2d-403d-b8c1-777417b50b0f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:18.565558 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 121/240] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:18.569110 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e159f86-cd2d-403d-b8c1-777417b50b0f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:18.571485 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e159f86-cd2d-403d-b8c1-777417b50b0f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:18.580614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 120/241] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:18.586986 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3405f-0d70-40b3-b61b-e1b5669519b9 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:18.597051 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3405f-0d70-40b3-b61b-e1b5669519b9 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:18.602203 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b659133-6cf2-4737-ad3c-33f62a94e87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:18.603088 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b659133-6cf2-4737-ad3c-33f62a94e87e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:18.603365 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b659133-6cf2-4737-ad3c-33f62a94e87e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:18.603638 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b659133-6cf2-4737-ad3c-33f62a94e87e admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:18.604926 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b659133-6cf2-4737-ad3c-33f62a94e87e admin admin] RBAC: Authorizing `identity:get_project(project_id=d3485c2fbadb4400a6eacec1952e81f3)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:18.607590 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e159f86-cd2d-403d-b8c1-777417b50b0f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:18.614321 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b659133-6cf2-4737-ad3c-33f62a94e87e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:18.616640 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 122/242] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:18 2022] GET /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:18.619952 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e159f86-cd2d-403d-b8c1-777417b50b0f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:18.622465 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b659133-6cf2-4737-ad3c-33f62a94e87e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:18.629322 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a659e-fe43-4747-8925-3ecc4f1cc628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:18.630111 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a659e-fe43-4747-8925-3ecc4f1cc628 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:18.630402 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a659e-fe43-4747-8925-3ecc4f1cc628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:18.630655 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a659e-fe43-4747-8925-3ecc4f1cc628 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:18.632721 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b659133-6cf2-4737-ad3c-33f62a94e87e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:18.643544 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc88a6-4b4f-4779-920c-183585734993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:18.644420 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc88a6-4b4f-4779-920c-183585734993 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:18.645854 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc88a6-4b4f-4779-920c-183585734993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:18.646269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc88a6-4b4f-4779-920c-183585734993 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:18.647263 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc88a6-4b4f-4779-920c-183585734993 admin admin] RBAC: Adding query filter params (role.id=7f727831e261404999a27a5a15b515b1, scope.project.id=d3485c2fbadb4400a6eacec1952e81f3, user.id=bfa4324665f143248433c3f19ff3a58f) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:18.649221 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc88a6-4b4f-4779-920c-183585734993 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:18.653133 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc88a6-4b4f-4779-920c-183585734993 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:18.655889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a659e-fe43-4747-8925-3ecc4f1cc628 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:18.665718 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-5b1a659e-fe43-4747-8925-3ecc4f1cc628 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:03:18.667999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 123/243] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:18 2022] GET /identity/v3/role_assignments?user.id=bfa4324665f143248433c3f19ff3a58f&scope.project.id=d3485c2fbadb4400a6eacec1952e81f3&role.id=7f727831e261404999a27a5a15b515b1 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:18.669542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 121/244] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:03:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:18.674999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc88a6-4b4f-4779-920c-183585734993 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:18.688954 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc88a6-4b4f-4779-920c-183585734993 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:18.697568 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e9b66-89d8-46b4-bbcd-675a4fff93e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:18.698504 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e9b66-89d8-46b4-bbcd-675a4fff93e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:18.698933 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e9b66-89d8-46b4-bbcd-675a4fff93e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:18.699341 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e9b66-89d8-46b4-bbcd-675a4fff93e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:18.700275 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e9b66-89d8-46b4-bbcd-675a4fff93e2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:18.700730 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e9b66-89d8-46b4-bbcd-675a4fff93e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:18.702618 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e9b66-89d8-46b4-bbcd-675a4fff93e2 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:18.716526 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 124/245] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:18.722370 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a659e-fe43-4747-8925-3ecc4f1cc628 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:18.737417 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a659e-fe43-4747-8925-3ecc4f1cc628 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:18.746208 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22492717-1ffa-4830-9520-260f923bf71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:18.747123 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22492717-1ffa-4830-9520-260f923bf71e admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:18.747405 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22492717-1ffa-4830-9520-260f923bf71e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:18.747679 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22492717-1ffa-4830-9520-260f923bf71e admin admin] PATH_INFO: `/v3/users/bfa4324665f143248433c3f19ff3a58f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:18.749165 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22492717-1ffa-4830-9520-260f923bf71e admin admin] RBAC: Authorizing `identity:get_user(user_id=bfa4324665f143248433c3f19ff3a58f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:18.751380 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22492717-1ffa-4830-9520-260f923bf71e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:18.753205 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 122/246] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:18 2022] GET /identity/v3/users/bfa4324665f143248433c3f19ff3a58f => generated 283 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:18.759549 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e9b66-89d8-46b4-bbcd-675a4fff93e2 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:18.774095 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e9b66-89d8-46b4-bbcd-675a4fff93e2 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:18.784521 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8139b-6700-4e41-840a-a9ae9427a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:18.785439 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8139b-6700-4e41-840a-a9ae9427a04e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:18.785862 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8139b-6700-4e41-840a-a9ae9427a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:18.786348 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8139b-6700-4e41-840a-a9ae9427a04e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:18.799933 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8139b-6700-4e41-840a-a9ae9427a04e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:18.801977 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8139b-6700-4e41-840a-a9ae9427a04e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:18.817805 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 125/247] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:18.824167 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22492717-1ffa-4830-9520-260f923bf71e admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:18.841423 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22492717-1ffa-4830-9520-260f923bf71e admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:18.849036 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad2d11-b49e-421b-800c-b2a92a6c1592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:18.849877 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad2d11-b49e-421b-800c-b2a92a6c1592 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:18.850160 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad2d11-b49e-421b-800c-b2a92a6c1592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:18.850974 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad2d11-b49e-421b-800c-b2a92a6c1592 admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:18.852301 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad2d11-b49e-421b-800c-b2a92a6c1592 admin admin] RBAC: Authorizing `identity:get_project(project_id=d3485c2fbadb4400a6eacec1952e81f3)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:18.854458 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad2d11-b49e-421b-800c-b2a92a6c1592 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:18.856478 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 123/248] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:18 2022] GET /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:18.862795 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8139b-6700-4e41-840a-a9ae9427a04e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:18.874836 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8139b-6700-4e41-840a-a9ae9427a04e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:18.883997 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803b687-3a65-4e2e-bc27-24f98bd4fab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:18.885014 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803b687-3a65-4e2e-bc27-24f98bd4fab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:18.885524 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803b687-3a65-4e2e-bc27-24f98bd4fab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:18.885998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803b687-3a65-4e2e-bc27-24f98bd4fab4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:18.887048 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803b687-3a65-4e2e-bc27-24f98bd4fab4 admin admin] RBAC: Adding query filter params (role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f, scope.project.id=d3485c2fbadb4400a6eacec1952e81f3, user.id=bfa4324665f143248433c3f19ff3a58f) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:18.887569 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803b687-3a65-4e2e-bc27-24f98bd4fab4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:18.889657 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803b687-3a65-4e2e-bc27-24f98bd4fab4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:18.896494 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 126/249] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:18 2022] GET /identity/v3/role_assignments?user.id=bfa4324665f143248433c3f19ff3a58f&scope.project.id=d3485c2fbadb4400a6eacec1952e81f3&role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:18.932610 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89adfe-0c90-48f0-8daf-be43a47045f3 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:18.932943 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89adfe-0c90-48f0-8daf-be43a47045f3 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:18.933157 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89adfe-0c90-48f0-8daf-be43a47045f3 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:18.934962 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 124/250] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:18.941284 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef92c3f-e52b-4c6c-a916-bee38a56cf22 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:18.941893 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef92c3f-e52b-4c6c-a916-bee38a56cf22 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:18.942345 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef92c3f-e52b-4c6c-a916-bee38a56cf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:18.969230 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-eef92c3f-e52b-4c6c-a916-bee38a56cf22 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:18.970444 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-eef92c3f-e52b-4c6c-a916-bee38a56cf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:18.981717 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 127/251] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:19.007357 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89adfe-0c90-48f0-8daf-be43a47045f3 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:19.021396 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89adfe-0c90-48f0-8daf-be43a47045f3 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:19.027123 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e117e7-abdc-4325-bd6e-4bea0cd3fb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:19.028004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e117e7-abdc-4325-bd6e-4bea0cd3fb2a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:19.028286 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e117e7-abdc-4325-bd6e-4bea0cd3fb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:19.028553 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e117e7-abdc-4325-bd6e-4bea0cd3fb2a admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:19.042296 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e117e7-abdc-4325-bd6e-4bea0cd3fb2a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:19.053002 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-85e117e7-abdc-4325-bd6e-4bea0cd3fb2a admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 23:03:19.053002 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 125/252] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:19.059335 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef92c3f-e52b-4c6c-a916-bee38a56cf22 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:19.073514 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef92c3f-e52b-4c6c-a916-bee38a56cf22 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:19.090797 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9d477-e8ed-43c1-be2a-4ea97fe74601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:19.091205 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2861528-09bf-488b-a78b-5b37dd5df9fc None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:19.091466 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9d477-e8ed-43c1-be2a-4ea97fe74601 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:19.091565 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2861528-09bf-488b-a78b-5b37dd5df9fc None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:19.091750 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9d477-e8ed-43c1-be2a-4ea97fe74601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:19.091876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2861528-09bf-488b-a78b-5b37dd5df9fc None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:19.092078 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9d477-e8ed-43c1-be2a-4ea97fe74601 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:19.092848 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9d477-e8ed-43c1-be2a-4ea97fe74601 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:19.093154 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9d477-e8ed-43c1-be2a-4ea97fe74601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:19.093684 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 126/253] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:03:19.094763 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9d477-e8ed-43c1-be2a-4ea97fe74601 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:19.099577 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657e4db-45e1-4970-a4fb-8decd4bbc109 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:19.099854 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657e4db-45e1-4970-a4fb-8decd4bbc109 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:19.100106 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657e4db-45e1-4970-a4fb-8decd4bbc109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:19.105235 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 128/254] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:19.110516 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9d477-e8ed-43c1-be2a-4ea97fe74601 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:19.121720 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9d477-e8ed-43c1-be2a-4ea97fe74601 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:19.124500 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-0657e4db-45e1-4970-a4fb-8decd4bbc109 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:19.125687 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-0657e4db-45e1-4970-a4fb-8decd4bbc109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:19.126144 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aba4e3-c901-454d-b9a2-ffc3072b907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:19.127001 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aba4e3-c901-454d-b9a2-ffc3072b907e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:19.127280 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aba4e3-c901-454d-b9a2-ffc3072b907e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:19.127550 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aba4e3-c901-454d-b9a2-ffc3072b907e admin admin] PATH_INFO: `/v3/users/389f1dbe35264c19a602652214a23bdb` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:19.144106 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aba4e3-c901-454d-b9a2-ffc3072b907e admin admin] RBAC: Authorizing `identity:get_user(user_id=389f1dbe35264c19a602652214a23bdb)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:19.144296 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 127/255] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:19.146678 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aba4e3-c901-454d-b9a2-ffc3072b907e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:19.149733 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 129/256] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:19 2022] GET /identity/v3/users/389f1dbe35264c19a602652214a23bdb => generated 297 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:19.154906 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12181bee-3143-4048-9095-bd039403e19c None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:19.155065 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aba4e3-c901-454d-b9a2-ffc3072b907e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:19.155279 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12181bee-3143-4048-9095-bd039403e19c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:19.155522 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12181bee-3143-4048-9095-bd039403e19c None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:19.157380 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 128/257] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:19.163043 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957a335-afd4-4aa0-a191-e44cc218bfcb None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:19.163394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957a335-afd4-4aa0-a191-e44cc218bfcb None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:19.163677 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957a335-afd4-4aa0-a191-e44cc218bfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:19.166217 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aba4e3-c901-454d-b9a2-ffc3072b907e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:19.171569 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027acc7-1e42-492d-95d3-5913ad86465b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:19.172267 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027acc7-1e42-492d-95d3-5913ad86465b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:19.172637 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027acc7-1e42-492d-95d3-5913ad86465b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:19.172932 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027acc7-1e42-492d-95d3-5913ad86465b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:19.182422 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027acc7-1e42-492d-95d3-5913ad86465b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:19.184271 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027acc7-1e42-492d-95d3-5913ad86465b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:19.189810 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-2957a335-afd4-4aa0-a191-e44cc218bfcb None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:19.191542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2957a335-afd4-4aa0-a191-e44cc218bfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:19.193770 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 130/258] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 23:03:19.195169 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027acc7-1e42-492d-95d3-5913ad86465b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:19.205236 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 129/259] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:19.205742 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027acc7-1e42-492d-95d3-5913ad86465b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:19.206480 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957a335-afd4-4aa0-a191-e44cc218bfcb None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:19.210177 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c284a89-3131-4646-895e-e87002f8b66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:19.211020 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c284a89-3131-4646-895e-e87002f8b66f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:19.211307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c284a89-3131-4646-895e-e87002f8b66f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:19.211583 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c284a89-3131-4646-895e-e87002f8b66f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:19.212783 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c284a89-3131-4646-895e-e87002f8b66f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:19.214455 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c284a89-3131-4646-895e-e87002f8b66f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:19.217139 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 131/260] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:19.222911 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c284a89-3131-4646-895e-e87002f8b66f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:19.224405 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957a335-afd4-4aa0-a191-e44cc218bfcb None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:19.232262 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c284a89-3131-4646-895e-e87002f8b66f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:19.234134 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9a96b-8eca-4ade-893a-4ea36f061790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:19.235587 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9a96b-8eca-4ade-893a-4ea36f061790 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:19.236379 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9a96b-8eca-4ade-893a-4ea36f061790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:19.236845 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47d3c4-56cf-45a4-a25b-e50895f89081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:19.236969 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9a96b-8eca-4ade-893a-4ea36f061790 admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:19.237490 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47d3c4-56cf-45a4-a25b-e50895f89081 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:19.237775 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47d3c4-56cf-45a4-a25b-e50895f89081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:19.238051 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47d3c4-56cf-45a4-a25b-e50895f89081 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:19.238768 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47d3c4-56cf-45a4-a25b-e50895f89081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:19.238871 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9a96b-8eca-4ade-893a-4ea36f061790 admin admin] RBAC: Authorizing `identity:get_project(project_id=d3485c2fbadb4400a6eacec1952e81f3)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:19.240693 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47d3c4-56cf-45a4-a25b-e50895f89081 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:19.243006 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9a96b-8eca-4ade-893a-4ea36f061790 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:19.246228 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 130/261] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:19 2022] GET /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3 => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:19.250834 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9a96b-8eca-4ade-893a-4ea36f061790 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:19.266915 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9a96b-8eca-4ade-893a-4ea36f061790 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:19.268386 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 132/262] 10.222.0.77 () {60 vars in 1153 bytes} [Thu Feb 10 23:03:19 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:03:19.269652 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47d3c4-56cf-45a4-a25b-e50895f89081 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:19.276573 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585a834-aeff-4d6d-a29f-7210061de3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:19.278422 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585a834-aeff-4d6d-a29f-7210061de3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:19.278949 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585a834-aeff-4d6d-a29f-7210061de3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:19.279382 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585a834-aeff-4d6d-a29f-7210061de3f7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:19.286212 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47d3c4-56cf-45a4-a25b-e50895f89081 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:19.293365 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cd626-5c7a-4d31-9114-6db3460aaff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:19.294399 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cd626-5c7a-4d31-9114-6db3460aaff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:19.294846 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cd626-5c7a-4d31-9114-6db3460aaff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:19.295297 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cd626-5c7a-4d31-9114-6db3460aaff7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:19.296822 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42cd626-5c7a-4d31-9114-6db3460aaff7 admin admin] RBAC: Adding query filter params (role.id=d73ea8a0130d4158afa3b074bb2a4ccb, scope.project.id=d3485c2fbadb4400a6eacec1952e81f3, user.id=389f1dbe35264c19a602652214a23bdb) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:19.297333 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42cd626-5c7a-4d31-9114-6db3460aaff7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:19.298433 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585a834-aeff-4d6d-a29f-7210061de3f7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:19.300598 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42cd626-5c7a-4d31-9114-6db3460aaff7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:19.311338 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-c585a834-aeff-4d6d-a29f-7210061de3f7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 23:03:19.312933 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 133/263] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:19 2022] GET /identity/v3/role_assignments?user.id=389f1dbe35264c19a602652214a23bdb&scope.project.id=d3485c2fbadb4400a6eacec1952e81f3&role.id=d73ea8a0130d4158afa3b074bb2a4ccb => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:19.313543 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 131/264] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:19.321623 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cd626-5c7a-4d31-9114-6db3460aaff7 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:19.334219 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cd626-5c7a-4d31-9114-6db3460aaff7 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:19.339160 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc91cd-2c56-4013-b916-2e4c2da8f272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:19.339997 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc91cd-2c56-4013-b916-2e4c2da8f272 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:19.340355 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc91cd-2c56-4013-b916-2e4c2da8f272 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:19.340729 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc91cd-2c56-4013-b916-2e4c2da8f272 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:19.341621 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc91cd-2c56-4013-b916-2e4c2da8f272 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:19.342009 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc91cd-2c56-4013-b916-2e4c2da8f272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:19.343787 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc91cd-2c56-4013-b916-2e4c2da8f272 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:19.354006 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 134/265] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:19.359547 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585a834-aeff-4d6d-a29f-7210061de3f7 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:19.372155 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585a834-aeff-4d6d-a29f-7210061de3f7 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:19.377033 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3bc85-ca1f-4c5d-b6fd-6f83a521003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:19.378063 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3bc85-ca1f-4c5d-b6fd-6f83a521003b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:19.378461 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3bc85-ca1f-4c5d-b6fd-6f83a521003b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:19.378827 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3bc85-ca1f-4c5d-b6fd-6f83a521003b admin admin] PATH_INFO: `/v3/users/328ffe50c8f14d0f9658fe8a4d0fe04f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:19.380363 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3bc85-ca1f-4c5d-b6fd-6f83a521003b admin admin] RBAC: Authorizing `identity:get_user(user_id=328ffe50c8f14d0f9658fe8a4d0fe04f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:19.383364 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3bc85-ca1f-4c5d-b6fd-6f83a521003b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:19.385474 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 132/266] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:19 2022] GET /identity/v3/users/328ffe50c8f14d0f9658fe8a4d0fe04f => generated 297 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:19.391150 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc91cd-2c56-4013-b916-2e4c2da8f272 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:19.401875 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc91cd-2c56-4013-b916-2e4c2da8f272 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:19.406632 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab93448-34bc-4a16-865f-926bc86bf37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:19.407708 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab93448-34bc-4a16-865f-926bc86bf37e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:19.408129 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab93448-34bc-4a16-865f-926bc86bf37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:19.408508 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab93448-34bc-4a16-865f-926bc86bf37e admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:19.410055 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab93448-34bc-4a16-865f-926bc86bf37e admin admin] RBAC: Authorizing `identity:get_project(project_id=d3485c2fbadb4400a6eacec1952e81f3)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:19.412376 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab93448-34bc-4a16-865f-926bc86bf37e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:19.414705 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 135/267] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:19 2022] GET /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:19.420678 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3bc85-ca1f-4c5d-b6fd-6f83a521003b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:19.431764 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3bc85-ca1f-4c5d-b6fd-6f83a521003b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:19.436516 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891c4b6-b999-4eb2-9d86-07588ab6ab23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:19.437608 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891c4b6-b999-4eb2-9d86-07588ab6ab23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:19.437992 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891c4b6-b999-4eb2-9d86-07588ab6ab23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:19.438363 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891c4b6-b999-4eb2-9d86-07588ab6ab23 admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3/users/328ffe50c8f14d0f9658fe8a4d0fe04f/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:19.440600 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891c4b6-b999-4eb2-9d86-07588ab6ab23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3485c2fbadb4400a6eacec1952e81f3, user_id=328ffe50c8f14d0f9658fe8a4d0fe04f, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:19.443482 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891c4b6-b999-4eb2-9d86-07588ab6ab23 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:19.461193 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 133/268] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:03:19 2022] PUT /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3/users/328ffe50c8f14d0f9658fe8a4d0fe04f/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:03:21.641977 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d8289-7293-4cac-8652-532727765dfc None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.642494 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d8289-7293-4cac-8652-532727765dfc None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.642569 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d8289-7293-4cac-8652-532727765dfc None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:21.644448 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 136/269] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:21.650806 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38e0b3-07a1-4e9c-8e7f-00b14c88acf1 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.651617 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38e0b3-07a1-4e9c-8e7f-00b14c88acf1 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.652120 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38e0b3-07a1-4e9c-8e7f-00b14c88acf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:21.665044 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd3191-3230-4b33-89a9-728df9e1d39c None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.665322 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd3191-3230-4b33-89a9-728df9e1d39c None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.665594 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd3191-3230-4b33-89a9-728df9e1d39c None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:21.667345 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 137/270] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:21.671560 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-3f38e0b3-07a1-4e9c-8e7f-00b14c88acf1 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:21.672761 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-3f38e0b3-07a1-4e9c-8e7f-00b14c88acf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:21.673391 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882736e-32ce-4edd-8a25-3a7692a984e1 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.673885 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882736e-32ce-4edd-8a25-3a7692a984e1 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.674349 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882736e-32ce-4edd-8a25-3a7692a984e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:21.692801 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-a882736e-32ce-4edd-8a25-3a7692a984e1 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:21.695068 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a882736e-32ce-4edd-8a25-3a7692a984e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:21.737747 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 134/271] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:21.739078 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d0ed9-48c3-41a4-86d2-3fe73705a67d None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.739366 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d0ed9-48c3-41a4-86d2-3fe73705a67d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.739642 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d0ed9-48c3-41a4-86d2-3fe73705a67d None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:21.742278 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 135/272] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:21.743222 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928e7ac-06b6-484f-828d-bb894900ae85 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.743508 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928e7ac-06b6-484f-828d-bb894900ae85 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.743783 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928e7ac-06b6-484f-828d-bb894900ae85 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:21.745377 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 136/273] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:21.750314 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b541f-ea5b-4d96-9051-28e8ee4e0c15 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.750604 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b541f-ea5b-4d96-9051-28e8ee4e0c15 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.750887 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b541f-ea5b-4d96-9051-28e8ee4e0c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:21.759002 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 138/274] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:21.760392 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c34824-1013-4cb8-9c41-da9ac5982101 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.760679 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c34824-1013-4cb8-9c41-da9ac5982101 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.760952 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c34824-1013-4cb8-9c41-da9ac5982101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:21.777602 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-8c2b541f-ea5b-4d96-9051-28e8ee4e0c15 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:21.778788 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-8c2b541f-ea5b-4d96-9051-28e8ee4e0c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:21.780577 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-f1c34824-1013-4cb8-9c41-da9ac5982101 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:21.781680 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-f1c34824-1013-4cb8-9c41-da9ac5982101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:21.786839 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 137/275] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:21.789680 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b541f-ea5b-4d96-9051-28e8ee4e0c15 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:21.789887 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 139/276] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:21.790750 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c34824-1013-4cb8-9c41-da9ac5982101 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:21.798650 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b541f-ea5b-4d96-9051-28e8ee4e0c15 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:21.802931 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c34824-1013-4cb8-9c41-da9ac5982101 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:21.803042 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e935a-8388-4c9c-8f48-ec9368bf7590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:21.804328 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e935a-8388-4c9c-8f48-ec9368bf7590 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.805007 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e935a-8388-4c9c-8f48-ec9368bf7590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.805179 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e935a-8388-4c9c-8f48-ec9368bf7590 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:21.809676 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254992-0b30-4795-9cbb-f25e7d1eb16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:21.811043 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254992-0b30-4795-9cbb-f25e7d1eb16a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.811670 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254992-0b30-4795-9cbb-f25e7d1eb16a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.811980 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254992-0b30-4795-9cbb-f25e7d1eb16a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:21.815914 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e935a-8388-4c9c-8f48-ec9368bf7590 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:21.823711 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c254992-0b30-4795-9cbb-f25e7d1eb16a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:21.823881 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-f09e935a-8388-4c9c-8f48-ec9368bf7590 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 23:03:21.824953 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 138/277] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:21.826716 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e935a-8388-4c9c-8f48-ec9368bf7590 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:21.830786 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-3c254992-0b30-4795-9cbb-f25e7d1eb16a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 23:03:21.831985 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 140/278] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:21.832740 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254992-0b30-4795-9cbb-f25e7d1eb16a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:21.836217 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e935a-8388-4c9c-8f48-ec9368bf7590 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:21.840500 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e482a-5832-4e6c-9c6b-055d26f7aed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:21.841233 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e482a-5832-4e6c-9c6b-055d26f7aed3 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.841510 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e482a-5832-4e6c-9c6b-055d26f7aed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.841763 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254992-0b30-4795-9cbb-f25e7d1eb16a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:21.841878 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e482a-5832-4e6c-9c6b-055d26f7aed3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:21.842909 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e482a-5832-4e6c-9c6b-055d26f7aed3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:21.844598 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e482a-5832-4e6c-9c6b-055d26f7aed3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:21.846059 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da38658-af7a-4841-b40e-029fe9bd08b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:21.846178 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 139/279] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:21.846776 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da38658-af7a-4841-b40e-029fe9bd08b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.846869 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e482a-5832-4e6c-9c6b-055d26f7aed3 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:21.847065 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da38658-af7a-4841-b40e-029fe9bd08b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.847340 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da38658-af7a-4841-b40e-029fe9bd08b2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:21.860344 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e482a-5832-4e6c-9c6b-055d26f7aed3 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:21.861289 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da38658-af7a-4841-b40e-029fe9bd08b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:21.864802 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b3ab6-9c80-4ff6-92d7-0dc4772c9d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:21.865400 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b3ab6-9c80-4ff6-92d7-0dc4772c9d1b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.865680 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b3ab6-9c80-4ff6-92d7-0dc4772c9d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.865955 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b3ab6-9c80-4ff6-92d7-0dc4772c9d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:21.867671 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b3ab6-9c80-4ff6-92d7-0dc4772c9d1b admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:21.868011 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b3ab6-9c80-4ff6-92d7-0dc4772c9d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:21.868788 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-4da38658-af7a-4841-b40e-029fe9bd08b2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 23:03:21.869538 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b3ab6-9c80-4ff6-92d7-0dc4772c9d1b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:21.869923 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 141/280] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:21.870673 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da38658-af7a-4841-b40e-029fe9bd08b2 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:21.879510 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da38658-af7a-4841-b40e-029fe9bd08b2 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:21.881569 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 140/281] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:21.883135 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b3ab6-9c80-4ff6-92d7-0dc4772c9d1b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:21.885106 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd7e61-374d-4d03-b1f5-ffa012c3a830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:21.885737 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd7e61-374d-4d03-b1f5-ffa012c3a830 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.886016 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd7e61-374d-4d03-b1f5-ffa012c3a830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.886289 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd7e61-374d-4d03-b1f5-ffa012c3a830 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:21.887042 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd7e61-374d-4d03-b1f5-ffa012c3a830 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:21.887344 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd7e61-374d-4d03-b1f5-ffa012c3a830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:21.888968 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd7e61-374d-4d03-b1f5-ffa012c3a830 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:21.892269 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b3ab6-9c80-4ff6-92d7-0dc4772c9d1b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:21.896382 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001338b2-4d4d-43d4-add3-18232ae034ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:21.897004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001338b2-4d4d-43d4-add3-18232ae034ef admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.897106 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 142/282] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:21.897380 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001338b2-4d4d-43d4-add3-18232ae034ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.898161 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001338b2-4d4d-43d4-add3-18232ae034ef admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:21.898447 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd7e61-374d-4d03-b1f5-ffa012c3a830 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:21.898974 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001338b2-4d4d-43d4-add3-18232ae034ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:21.900875 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001338b2-4d4d-43d4-add3-18232ae034ef admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:21.910365 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd7e61-374d-4d03-b1f5-ffa012c3a830 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:21.915329 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff82b3-d6e4-4bce-8750-c31c6657ad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:21.916041 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff82b3-d6e4-4bce-8750-c31c6657ad98 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.916323 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff82b3-d6e4-4bce-8750-c31c6657ad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.916598 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff82b3-d6e4-4bce-8750-c31c6657ad98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:21.917336 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff82b3-d6e4-4bce-8750-c31c6657ad98 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:21.917644 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff82b3-d6e4-4bce-8750-c31c6657ad98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:21.919226 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff82b3-d6e4-4bce-8750-c31c6657ad98 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:21.920595 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 141/283] 10.222.0.77 () {60 vars in 1153 bytes} [Thu Feb 10 23:03:21 2022] POST /identity/v3/users => generated 293 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:03:21.921384 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001338b2-4d4d-43d4-add3-18232ae034ef admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:21.931473 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001338b2-4d4d-43d4-add3-18232ae034ef admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:21.932220 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 143/284] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:21.933079 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff82b3-d6e4-4bce-8750-c31c6657ad98 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:21.941373 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b715453-4136-4325-9343-75863639d730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:21.942616 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b715453-4136-4325-9343-75863639d730 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.943036 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff82b3-d6e4-4bce-8750-c31c6657ad98 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:21.943333 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b715453-4136-4325-9343-75863639d730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.943782 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b715453-4136-4325-9343-75863639d730 admin admin] PATH_INFO: `/v3/users/389f1dbe35264c19a602652214a23bdb` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:21.946200 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b715453-4136-4325-9343-75863639d730 admin admin] RBAC: Authorizing `identity:get_user(user_id=389f1dbe35264c19a602652214a23bdb)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:21.948382 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976ff02-8598-4519-b583-8b845624927f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:21.949014 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b715453-4136-4325-9343-75863639d730 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:21.949271 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976ff02-8598-4519-b583-8b845624927f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.949557 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976ff02-8598-4519-b583-8b845624927f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.949835 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976ff02-8598-4519-b583-8b845624927f admin admin] PATH_INFO: `/v3/users/65cea400046c4172a5ceebc48aa417e6` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:21.951601 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 142/285] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:21 2022] GET /identity/v3/users/389f1dbe35264c19a602652214a23bdb => generated 297 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:21.952605 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b715453-4136-4325-9343-75863639d730 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:21.963115 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b715453-4136-4325-9343-75863639d730 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:21.967605 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f5d7b-f18d-4b7e-bd5e-ceb48a0b3f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:21.968511 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f5d7b-f18d-4b7e-bd5e-ceb48a0b3f17 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.968792 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f5d7b-f18d-4b7e-bd5e-ceb48a0b3f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.969067 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f5d7b-f18d-4b7e-bd5e-ceb48a0b3f17 admin admin] PATH_INFO: `/v3/users/328ffe50c8f14d0f9658fe8a4d0fe04f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:21.970434 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f5d7b-f18d-4b7e-bd5e-ceb48a0b3f17 admin admin] RBAC: Authorizing `identity:get_user(user_id=328ffe50c8f14d0f9658fe8a4d0fe04f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:21.971281 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976ff02-8598-4519-b583-8b845624927f admin admin] RBAC: Authorizing `identity:get_user(user_id=65cea400046c4172a5ceebc48aa417e6)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:21.972756 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f5d7b-f18d-4b7e-bd5e-ceb48a0b3f17 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:21.973476 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976ff02-8598-4519-b583-8b845624927f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:21.980414 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 143/286] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:21 2022] GET /identity/v3/users/328ffe50c8f14d0f9658fe8a4d0fe04f => generated 297 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:21.980967 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 144/287] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:21 2022] GET /identity/v3/users/65cea400046c4172a5ceebc48aa417e6 => generated 293 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:21.981070 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f5d7b-f18d-4b7e-bd5e-ceb48a0b3f17 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:21.981243 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976ff02-8598-4519-b583-8b845624927f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:21.992311 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976ff02-8598-4519-b583-8b845624927f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:21.993592 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f5d7b-f18d-4b7e-bd5e-ceb48a0b3f17 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:21.996886 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2f6c9-840d-48da-ba17-626daa6fc36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:21.997660 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2f6c9-840d-48da-ba17-626daa6fc36f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.997923 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2f6c9-840d-48da-ba17-626daa6fc36f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.998200 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2f6c9-840d-48da-ba17-626daa6fc36f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:21.998296 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24799806-20d2-4b66-bd99-ce149ec8ee92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:21.999071 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24799806-20d2-4b66-bd99-ce149ec8ee92 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:21.999372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24799806-20d2-4b66-bd99-ce149ec8ee92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:21.999682 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24799806-20d2-4b66-bd99-ce149ec8ee92 admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:22.000931 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24799806-20d2-4b66-bd99-ce149ec8ee92 admin admin] RBAC: Authorizing `identity:get_project(project_id=d3485c2fbadb4400a6eacec1952e81f3)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:22.003053 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24799806-20d2-4b66-bd99-ce149ec8ee92 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:22.004822 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 144/288] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:21 2022] GET /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:22.005594 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24799806-20d2-4b66-bd99-ce149ec8ee92 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:22.012237 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2f6c9-840d-48da-ba17-626daa6fc36f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:22.014044 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2f6c9-840d-48da-ba17-626daa6fc36f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:22.015947 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24799806-20d2-4b66-bd99-ce149ec8ee92 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:22.020314 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedee53f-d56e-48a1-be43-c4dfe4764e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:22.020970 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedee53f-d56e-48a1-be43-c4dfe4764e9a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:22.021255 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedee53f-d56e-48a1-be43-c4dfe4764e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:22.021533 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedee53f-d56e-48a1-be43-c4dfe4764e9a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:22.022529 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedee53f-d56e-48a1-be43-c4dfe4764e9a admin admin] RBAC: Adding query filter params (role.id=419ebcf5b1d8470394e463c9f01cb154, user.id=65cea400046c4172a5ceebc48aa417e6, scope.system=all) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:22.022974 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedee53f-d56e-48a1-be43-c4dfe4764e9a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:22.029233 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 145/289] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 23:03:22.029426 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedee53f-d56e-48a1-be43-c4dfe4764e9a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:22.029506 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2f6c9-840d-48da-ba17-626daa6fc36f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:22.033685 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 145/290] 10.222.0.77 () {56 vars in 1329 bytes} [Thu Feb 10 23:03:22 2022] GET /identity/v3/role_assignments?user.id=65cea400046c4172a5ceebc48aa417e6&scope.system=all&role.id=419ebcf5b1d8470394e463c9f01cb154 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:22.034417 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedee53f-d56e-48a1-be43-c4dfe4764e9a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:22.045445 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedee53f-d56e-48a1-be43-c4dfe4764e9a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:22.050392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98f2b1-9f3b-4b17-90bf-09bf0a2af7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:22.050998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2f6c9-840d-48da-ba17-626daa6fc36f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:22.051312 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98f2b1-9f3b-4b17-90bf-09bf0a2af7cc admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:22.051598 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98f2b1-9f3b-4b17-90bf-09bf0a2af7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:22.051911 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98f2b1-9f3b-4b17-90bf-09bf0a2af7cc admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:22.053335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98f2b1-9f3b-4b17-90bf-09bf0a2af7cc admin admin] RBAC: Authorizing `identity:get_project(project_id=d3485c2fbadb4400a6eacec1952e81f3)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:22.056576 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98f2b1-9f3b-4b17-90bf-09bf0a2af7cc admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:22.058426 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 146/291] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:22 2022] GET /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:22.058782 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae640b-9a10-4922-bbbf-17d370c5d22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:22.060143 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae640b-9a10-4922-bbbf-17d370c5d22c admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:22.060713 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae640b-9a10-4922-bbbf-17d370c5d22c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:22.061192 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae640b-9a10-4922-bbbf-17d370c5d22c admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3/users/389f1dbe35264c19a602652214a23bdb/roles/d73ea8a0130d4158afa3b074bb2a4ccb` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:22.064140 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae640b-9a10-4922-bbbf-17d370c5d22c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3485c2fbadb4400a6eacec1952e81f3, user_id=389f1dbe35264c19a602652214a23bdb, role_id=d73ea8a0130d4158afa3b074bb2a4ccb)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:22.064577 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98f2b1-9f3b-4b17-90bf-09bf0a2af7cc admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:22.067870 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae640b-9a10-4922-bbbf-17d370c5d22c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:22.085002 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98f2b1-9f3b-4b17-90bf-09bf0a2af7cc admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:22.092287 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 146/292] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:03:22 2022] PUT /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3/users/389f1dbe35264c19a602652214a23bdb/roles/d73ea8a0130d4158afa3b074bb2a4ccb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:03:22.165214 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d7818-6fca-491e-b54b-6cc36e0e6fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:22.165803 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d7818-6fca-491e-b54b-6cc36e0e6fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:22.166086 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d7818-6fca-491e-b54b-6cc36e0e6fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:22.166357 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d7818-6fca-491e-b54b-6cc36e0e6fa6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:22.167219 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d7818-6fca-491e-b54b-6cc36e0e6fa6 admin admin] RBAC: Adding query filter params (role.id=419ebcf5b1d8470394e463c9f01cb154, scope.project.id=d3485c2fbadb4400a6eacec1952e81f3, user.id=328ffe50c8f14d0f9658fe8a4d0fe04f) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:22.167530 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d7818-6fca-491e-b54b-6cc36e0e6fa6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:22.169479 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d7818-6fca-491e-b54b-6cc36e0e6fa6 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:22.176538 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 147/293] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:22 2022] GET /identity/v3/role_assignments?user.id=328ffe50c8f14d0f9658fe8a4d0fe04f&scope.project.id=d3485c2fbadb4400a6eacec1952e81f3&role.id=419ebcf5b1d8470394e463c9f01cb154 => generated 608 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:24.332510 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a18e0a-ac87-4e9e-896d-aa4e88353d8d None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.333086 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a18e0a-ac87-4e9e-896d-aa4e88353d8d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.333086 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a18e0a-ac87-4e9e-896d-aa4e88353d8d None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.335054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 147/294] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:24.340813 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a0fc6-8e89-4fbe-bc11-d2f3c836d6cd None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.341280 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a0fc6-8e89-4fbe-bc11-d2f3c836d6cd None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.341356 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a0fc6-8e89-4fbe-bc11-d2f3c836d6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.359847 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-626a0fc6-8e89-4fbe-bc11-d2f3c836d6cd None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:24.361288 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-626a0fc6-8e89-4fbe-bc11-d2f3c836d6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:24.370084 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 148/295] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:24.383462 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8d2b4-bfcc-4391-849a-4e278a2472e7 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.383753 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8d2b4-bfcc-4391-849a-4e278a2472e7 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.384070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8d2b4-bfcc-4391-849a-4e278a2472e7 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.385836 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 148/296] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:24.387855 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e136c0e-346a-48d3-a078-eeb7634e1b02 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.387855 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e136c0e-346a-48d3-a078-eeb7634e1b02 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.388244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e136c0e-346a-48d3-a078-eeb7634e1b02 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.390219 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 149/297] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:24.390710 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1afe5-badb-4e56-8571-f3533bdccce1 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.391000 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1afe5-badb-4e56-8571-f3533bdccce1 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.391278 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1afe5-badb-4e56-8571-f3533bdccce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.394708 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e136c0e-346a-48d3-a078-eeb7634e1b02 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:24.408382 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e136c0e-346a-48d3-a078-eeb7634e1b02 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:24.410164 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-46f1afe5-badb-4e56-8571-f3533bdccce1 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:24.411652 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-46f1afe5-badb-4e56-8571-f3533bdccce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:24.412694 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c7e71-a5f4-4fd7-8c52-dcc438c308b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:24.414245 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c7e71-a5f4-4fd7-8c52-dcc438c308b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.414530 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c7e71-a5f4-4fd7-8c52-dcc438c308b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.414803 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c7e71-a5f4-4fd7-8c52-dcc438c308b1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.423873 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 149/298] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:24.423873 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92e645-ebc0-4bfb-becc-deed3c077d01 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.423873 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92e645-ebc0-4bfb-becc-deed3c077d01 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.423873 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92e645-ebc0-4bfb-becc-deed3c077d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.428125 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c7e71-a5f4-4fd7-8c52-dcc438c308b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:24.435694 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-236c7e71-a5f4-4fd7-8c52-dcc438c308b1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 23:03:24.437344 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 150/299] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:03:24.442889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c7e71-a5f4-4fd7-8c52-dcc438c308b1 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:24.448253 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-4b92e645-ebc0-4bfb-becc-deed3c077d01 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:24.449429 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-4b92e645-ebc0-4bfb-becc-deed3c077d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:24.453781 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c7e71-a5f4-4fd7-8c52-dcc438c308b1 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:24.457423 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 150/300] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:24.458108 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92e645-ebc0-4bfb-becc-deed3c077d01 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:24.458277 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661174a4-2557-4741-8979-dc955cf1e1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:24.458951 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661174a4-2557-4741-8979-dc955cf1e1bf admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.459184 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661174a4-2557-4741-8979-dc955cf1e1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.459461 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661174a4-2557-4741-8979-dc955cf1e1bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.461070 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661174a4-2557-4741-8979-dc955cf1e1bf admin admin] RBAC: Adding query filter params (name=member) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:24.461462 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661174a4-2557-4741-8979-dc955cf1e1bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:24.463071 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661174a4-2557-4741-8979-dc955cf1e1bf admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:24.468578 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92e645-ebc0-4bfb-becc-deed3c077d01 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:24.473752 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5834a88-860c-4102-9877-3f72b6bad71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:24.474653 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5834a88-860c-4102-9877-3f72b6bad71e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.474968 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5834a88-860c-4102-9877-3f72b6bad71e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.475371 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5834a88-860c-4102-9877-3f72b6bad71e admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.479408 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 151/301] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:24.480296 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661174a4-2557-4741-8979-dc955cf1e1bf admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:24.490100 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5834a88-860c-4102-9877-3f72b6bad71e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:24.490358 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661174a4-2557-4741-8979-dc955cf1e1bf admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:24.495511 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0d196-284f-4d7f-bd6f-a6c8ff7032ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:24.496397 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0d196-284f-4d7f-bd6f-a6c8ff7032ee admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.496679 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0d196-284f-4d7f-bd6f-a6c8ff7032ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.496952 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0d196-284f-4d7f-bd6f-a6c8ff7032ee admin admin] PATH_INFO: `/v3/users/65cea400046c4172a5ceebc48aa417e6` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.497665 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-d5834a88-860c-4102-9877-3f72b6bad71e admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 23:03:24.498154 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0d196-284f-4d7f-bd6f-a6c8ff7032ee admin admin] RBAC: Authorizing `identity:get_user(user_id=65cea400046c4172a5ceebc48aa417e6)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:24.499021 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 151/302] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:24.499858 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5834a88-860c-4102-9877-3f72b6bad71e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:24.500437 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0d196-284f-4d7f-bd6f-a6c8ff7032ee admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:24.502142 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 152/303] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:24 2022] GET /identity/v3/users/65cea400046c4172a5ceebc48aa417e6 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:24.506127 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0d196-284f-4d7f-bd6f-a6c8ff7032ee admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:24.510769 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5834a88-860c-4102-9877-3f72b6bad71e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:24.515224 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4271f2-a8ee-44b1-b6cd-ce069b85550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:24.516012 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4271f2-a8ee-44b1-b6cd-ce069b85550c admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.516298 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4271f2-a8ee-44b1-b6cd-ce069b85550c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.516526 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0d196-284f-4d7f-bd6f-a6c8ff7032ee admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:24.516633 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4271f2-a8ee-44b1-b6cd-ce069b85550c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.521052 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ad0c6-7091-43f1-b70d-7b8bf9462e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:24.521677 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ad0c6-7091-43f1-b70d-7b8bf9462e8a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.521958 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ad0c6-7091-43f1-b70d-7b8bf9462e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.522807 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ad0c6-7091-43f1-b70d-7b8bf9462e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.523644 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ad0c6-7091-43f1-b70d-7b8bf9462e8a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:24.523981 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ad0c6-7091-43f1-b70d-7b8bf9462e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:24.525540 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ad0c6-7091-43f1-b70d-7b8bf9462e8a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:24.528403 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4271f2-a8ee-44b1-b6cd-ce069b85550c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:24.539630 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 153/304] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:24.539630 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ad0c6-7091-43f1-b70d-7b8bf9462e8a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:24.539854 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-ed4271f2-a8ee-44b1-b6cd-ce069b85550c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 23:03:24.539854 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 152/305] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:24.541323 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4271f2-a8ee-44b1-b6cd-ce069b85550c admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:24.547412 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ad0c6-7091-43f1-b70d-7b8bf9462e8a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:24.550920 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4271f2-a8ee-44b1-b6cd-ce069b85550c admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:24.552149 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f1111-3e16-415e-8c6d-aa2da4ce9e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:24.552996 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f1111-3e16-415e-8c6d-aa2da4ce9e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.553279 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f1111-3e16-415e-8c6d-aa2da4ce9e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.553607 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f1111-3e16-415e-8c6d-aa2da4ce9e85 admin admin] PATH_INFO: `/v3/system/users/65cea400046c4172a5ceebc48aa417e6/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.555272 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f1111-3e16-415e-8c6d-aa2da4ce9e85 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=65cea400046c4172a5ceebc48aa417e6, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:24.555368 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62739e20-f9fe-480d-9e40-afc8a42f02f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:24.556180 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62739e20-f9fe-480d-9e40-afc8a42f02f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.556335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING py.warnings [None req-f69f1111-3e16-415e-8c6d-aa2da4ce9e85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:03:24.556335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: warnings.warn(msg) Feb 10 23:03:24.556335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: Feb 10 23:03:24.556544 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62739e20-f9fe-480d-9e40-afc8a42f02f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.556724 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62739e20-f9fe-480d-9e40-afc8a42f02f5 admin admin] PATH_INFO: `/v3/users/1ea997de9d184e7ab2db7cee9755f31d` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.557192 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f1111-3e16-415e-8c6d-aa2da4ce9e85 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:24.566931 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 154/306] 10.222.0.77 () {58 vars in 1355 bytes} [Thu Feb 10 23:03:24 2022] PUT /identity/v3/system/users/65cea400046c4172a5ceebc48aa417e6/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:03:24.568178 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f1111-3e16-415e-8c6d-aa2da4ce9e85 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:24.579720 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f1111-3e16-415e-8c6d-aa2da4ce9e85 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:24.580114 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62739e20-f9fe-480d-9e40-afc8a42f02f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ea997de9d184e7ab2db7cee9755f31d)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:24.583265 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62739e20-f9fe-480d-9e40-afc8a42f02f5 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:24.584574 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04455a9d-fc58-4f0a-9b0d-e389521d56c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:24.585835 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04455a9d-fc58-4f0a-9b0d-e389521d56c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.586124 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04455a9d-fc58-4f0a-9b0d-e389521d56c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.586404 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04455a9d-fc58-4f0a-9b0d-e389521d56c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.587205 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04455a9d-fc58-4f0a-9b0d-e389521d56c0 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:24.587527 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04455a9d-fc58-4f0a-9b0d-e389521d56c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:24.592433 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04455a9d-fc58-4f0a-9b0d-e389521d56c0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:24.592614 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 153/307] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:24 2022] GET /identity/v3/users/1ea997de9d184e7ab2db7cee9755f31d => generated 293 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:24.594664 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62739e20-f9fe-480d-9e40-afc8a42f02f5 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:24.606079 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 155/308] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:24.606079 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e72d63-3fe1-46fe-8113-9ebb838df06b None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.606079 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e72d63-3fe1-46fe-8113-9ebb838df06b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.606079 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e72d63-3fe1-46fe-8113-9ebb838df06b None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.607905 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 156/309] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:24.608536 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e72d63-3fe1-46fe-8113-9ebb838df06b None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:24.609365 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62739e20-f9fe-480d-9e40-afc8a42f02f5 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:24.616699 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97a8c4-3df9-45e1-b8b4-28fbe79ff9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:24.617632 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97a8c4-3df9-45e1-b8b4-28fbe79ff9df admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.617979 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97a8c4-3df9-45e1-b8b4-28fbe79ff9df admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.618318 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97a8c4-3df9-45e1-b8b4-28fbe79ff9df admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.619289 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97a8c4-3df9-45e1-b8b4-28fbe79ff9df admin admin] RBAC: Adding query filter params (role.id=d73ea8a0130d4158afa3b074bb2a4ccb, user.id=1ea997de9d184e7ab2db7cee9755f31d, scope.system=all) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:24.619661 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97a8c4-3df9-45e1-b8b4-28fbe79ff9df admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:24.621659 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97a8c4-3df9-45e1-b8b4-28fbe79ff9df admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:24.621798 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e72d63-3fe1-46fe-8113-9ebb838df06b None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:24.628116 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c9e3c-c2a0-4f7a-a39f-acfba9078e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:24.629337 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c9e3c-c2a0-4f7a-a39f-acfba9078e8f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.629628 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c9e3c-c2a0-4f7a-a39f-acfba9078e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.629907 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c9e3c-c2a0-4f7a-a39f-acfba9078e8f admin admin] PATH_INFO: `/v3/users/389f1dbe35264c19a602652214a23bdb` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.631279 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c9e3c-c2a0-4f7a-a39f-acfba9078e8f admin admin] RBAC: Authorizing `identity:get_user(user_id=389f1dbe35264c19a602652214a23bdb)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:24.632423 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 154/310] 10.222.0.77 () {56 vars in 1329 bytes} [Thu Feb 10 23:03:24 2022] GET /identity/v3/role_assignments?user.id=1ea997de9d184e7ab2db7cee9755f31d&scope.system=all&role.id=d73ea8a0130d4158afa3b074bb2a4ccb => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:24.634228 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c9e3c-c2a0-4f7a-a39f-acfba9078e8f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:24.634515 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3007f-6194-419c-b7f7-48611a74a2b7 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.635027 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3007f-6194-419c-b7f7-48611a74a2b7 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.635558 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3007f-6194-419c-b7f7-48611a74a2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.636142 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 157/311] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:24 2022] GET /identity/v3/users/389f1dbe35264c19a602652214a23bdb => generated 297 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:24.645820 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c9e3c-c2a0-4f7a-a39f-acfba9078e8f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:24.656697 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c9e3c-c2a0-4f7a-a39f-acfba9078e8f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:24.660902 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-1fb3007f-6194-419c-b7f7-48611a74a2b7 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:24.661558 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b3cc9-5d80-4840-b0b4-dda7a15b918b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:24.662238 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b3cc9-5d80-4840-b0b4-dda7a15b918b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.662585 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b3cc9-5d80-4840-b0b4-dda7a15b918b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.662980 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b3cc9-5d80-4840-b0b4-dda7a15b918b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.663749 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-1fb3007f-6194-419c-b7f7-48611a74a2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:24.672378 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 155/312] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:24.680604 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b3cc9-5d80-4840-b0b4-dda7a15b918b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:24.682807 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b3cc9-5d80-4840-b0b4-dda7a15b918b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:24.695937 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 158/313] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 23:03:24.702444 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b3cc9-5d80-4840-b0b4-dda7a15b918b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:24.702780 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3007f-6194-419c-b7f7-48611a74a2b7 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:24.713141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b3cc9-5d80-4840-b0b4-dda7a15b918b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:24.715288 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3007f-6194-419c-b7f7-48611a74a2b7 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:24.718156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d35b6-3c97-4c1c-b302-6cccf88aa375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:24.719120 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d35b6-3c97-4c1c-b302-6cccf88aa375 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.719466 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d35b6-3c97-4c1c-b302-6cccf88aa375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.719894 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d35b6-3c97-4c1c-b302-6cccf88aa375 admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.721315 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d35b6-3c97-4c1c-b302-6cccf88aa375 admin admin] RBAC: Authorizing `identity:get_project(project_id=d3485c2fbadb4400a6eacec1952e81f3)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:24.722064 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc40a5-9d5c-410f-b42d-b5e6652a92fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:24.723097 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc40a5-9d5c-410f-b42d-b5e6652a92fa admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.723625 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc40a5-9d5c-410f-b42d-b5e6652a92fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.723730 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d35b6-3c97-4c1c-b302-6cccf88aa375 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:24.724190 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc40a5-9d5c-410f-b42d-b5e6652a92fa admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.726305 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc40a5-9d5c-410f-b42d-b5e6652a92fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:24.726674 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 159/314] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:24 2022] GET /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:24.728977 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc40a5-9d5c-410f-b42d-b5e6652a92fa admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:24.731010 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 156/315] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:24.736094 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d35b6-3c97-4c1c-b302-6cccf88aa375 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:24.737315 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc40a5-9d5c-410f-b42d-b5e6652a92fa admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:24.747743 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d35b6-3c97-4c1c-b302-6cccf88aa375 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:24.749462 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc40a5-9d5c-410f-b42d-b5e6652a92fa admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:24.754380 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e17f2-0737-4437-a310-efc587daf6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:24.754699 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c8d35-4229-4178-9aab-6007691f176f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:24.755272 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e17f2-0737-4437-a310-efc587daf6ef admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.755658 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e17f2-0737-4437-a310-efc587daf6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.755886 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c8d35-4229-4178-9aab-6007691f176f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:24.755992 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e17f2-0737-4437-a310-efc587daf6ef admin admin] PATH_INFO: `/v3/groups` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.756395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c8d35-4229-4178-9aab-6007691f176f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:24.757385 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e17f2-0737-4437-a310-efc587daf6ef admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:24.757725 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c8d35-4229-4178-9aab-6007691f176f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:24.759464 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING py.warnings [None req-7e3e17f2-0737-4437-a310-efc587daf6ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:03:24.759464 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: warnings.warn(msg) Feb 10 23:03:24.759464 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: Feb 10 23:03:24.759731 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c8d35-4229-4178-9aab-6007691f176f admin admin] RBAC: Adding query filter params (role.id=d73ea8a0130d4158afa3b074bb2a4ccb, scope.project.id=d3485c2fbadb4400a6eacec1952e81f3, user.id=389f1dbe35264c19a602652214a23bdb) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:24.759956 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e17f2-0737-4437-a310-efc587daf6ef admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:24.760410 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c8d35-4229-4178-9aab-6007691f176f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:24.762418 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c8d35-4229-4178-9aab-6007691f176f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:24.770655 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 160/316] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:24 2022] GET /identity/v3/role_assignments?user.id=389f1dbe35264c19a602652214a23bdb&scope.project.id=d3485c2fbadb4400a6eacec1952e81f3&role.id=d73ea8a0130d4158afa3b074bb2a4ccb => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:24.777491 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 157/317] 10.222.0.77 () {60 vars in 1155 bytes} [Thu Feb 10 23:03:24 2022] POST /identity/v3/groups => generated 229 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:03:26.854559 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab08d4d-7420-4b0a-8ec0-fdbd58e3bc9f None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:26.855074 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab08d4d-7420-4b0a-8ec0-fdbd58e3bc9f None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:26.855074 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab08d4d-7420-4b0a-8ec0-fdbd58e3bc9f None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:26.856911 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 161/318] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:26.860112 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a56dce-1ce8-460d-a875-56e22b8308b6 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:26.860637 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a56dce-1ce8-460d-a875-56e22b8308b6 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:26.861273 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a56dce-1ce8-460d-a875-56e22b8308b6 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:26.861966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761805a-bcca-43c0-bea2-54bfb349075c None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:26.862253 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761805a-bcca-43c0-bea2-54bfb349075c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:26.862529 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761805a-bcca-43c0-bea2-54bfb349075c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:26.863450 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 158/319] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:03:26.869040 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5851ee9-e76a-4d2a-927f-aac84ab3f2d2 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:26.869322 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5851ee9-e76a-4d2a-927f-aac84ab3f2d2 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:26.869591 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5851ee9-e76a-4d2a-927f-aac84ab3f2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:26.880562 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-1761805a-bcca-43c0-bea2-54bfb349075c None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:26.882326 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-1761805a-bcca-43c0-bea2-54bfb349075c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:26.887467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-a5851ee9-e76a-4d2a-927f-aac84ab3f2d2 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:26.888627 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a5851ee9-e76a-4d2a-927f-aac84ab3f2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:26.889871 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 162/320] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:26.896018 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 159/321] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:26.913116 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761805a-bcca-43c0-bea2-54bfb349075c None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:26.918486 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5851ee9-e76a-4d2a-927f-aac84ab3f2d2 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:26.922019 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761805a-bcca-43c0-bea2-54bfb349075c None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:26.926650 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9796f-0e05-43e9-ba65-80a5b85fcb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:26.927404 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5851ee9-e76a-4d2a-927f-aac84ab3f2d2 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:26.927512 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9796f-0e05-43e9-ba65-80a5b85fcb23 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:26.927897 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9796f-0e05-43e9-ba65-80a5b85fcb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:26.928183 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9796f-0e05-43e9-ba65-80a5b85fcb23 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:26.932485 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1058656-f917-4b14-940f-76792d9bcf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:26.933267 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1058656-f917-4b14-940f-76792d9bcf19 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:26.933552 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1058656-f917-4b14-940f-76792d9bcf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:26.933821 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1058656-f917-4b14-940f-76792d9bcf19 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:26.939394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9796f-0e05-43e9-ba65-80a5b85fcb23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:26.944577 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1058656-f917-4b14-940f-76792d9bcf19 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:26.947207 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-2ec9796f-0e05-43e9-ba65-80a5b85fcb23 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 23:03:26.951864 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 163/322] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:26.951975 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-f1058656-f917-4b14-940f-76792d9bcf19 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 23:03:26.952640 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 160/323] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:03:26.954030 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9796f-0e05-43e9-ba65-80a5b85fcb23 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:26.957813 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1058656-f917-4b14-940f-76792d9bcf19 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:26.963491 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9796f-0e05-43e9-ba65-80a5b85fcb23 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:26.966913 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1058656-f917-4b14-940f-76792d9bcf19 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:26.967771 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4396d9-1284-4682-bffd-b92125cb550a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:26.968446 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4396d9-1284-4682-bffd-b92125cb550a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:26.968731 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4396d9-1284-4682-bffd-b92125cb550a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:26.969003 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4396d9-1284-4682-bffd-b92125cb550a admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:26.969758 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4396d9-1284-4682-bffd-b92125cb550a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:26.970061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4396d9-1284-4682-bffd-b92125cb550a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:26.971621 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38972557-f2c1-4de7-b7e7-0c45e49a9ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:26.971740 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4396d9-1284-4682-bffd-b92125cb550a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:26.972275 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38972557-f2c1-4de7-b7e7-0c45e49a9ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:26.972556 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38972557-f2c1-4de7-b7e7-0c45e49a9ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:26.972829 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38972557-f2c1-4de7-b7e7-0c45e49a9ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:26.973575 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38972557-f2c1-4de7-b7e7-0c45e49a9ba5 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:26.973879 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38972557-f2c1-4de7-b7e7-0c45e49a9ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:26.975552 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38972557-f2c1-4de7-b7e7-0c45e49a9ba5 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:26.980854 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 164/324] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:26.984549 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 161/325] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:26.986210 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4396d9-1284-4682-bffd-b92125cb550a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:26.989781 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38972557-f2c1-4de7-b7e7-0c45e49a9ba5 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:26.996432 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4396d9-1284-4682-bffd-b92125cb550a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:26.999714 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38972557-f2c1-4de7-b7e7-0c45e49a9ba5 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:27.000650 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557de6c-c737-40c0-93a7-2957185c8aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:27.001492 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557de6c-c737-40c0-93a7-2957185c8aae admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:27.001771 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557de6c-c737-40c0-93a7-2957185c8aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:27.002043 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557de6c-c737-40c0-93a7-2957185c8aae admin admin] PATH_INFO: `/v3/users/65cea400046c4172a5ceebc48aa417e6` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:27.003222 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557de6c-c737-40c0-93a7-2957185c8aae admin admin] RBAC: Authorizing `identity:get_user(user_id=65cea400046c4172a5ceebc48aa417e6)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:27.004432 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a4ae2-549c-4390-8c59-6da642f74001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:27.005333 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a4ae2-549c-4390-8c59-6da642f74001 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:27.005445 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557de6c-c737-40c0-93a7-2957185c8aae admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:27.005722 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a4ae2-549c-4390-8c59-6da642f74001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:27.006053 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a4ae2-549c-4390-8c59-6da642f74001 admin admin] PATH_INFO: `/v3/users/1ea997de9d184e7ab2db7cee9755f31d` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:27.007473 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 165/326] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:26 2022] GET /identity/v3/users/65cea400046c4172a5ceebc48aa417e6 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:27.008294 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a4ae2-549c-4390-8c59-6da642f74001 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ea997de9d184e7ab2db7cee9755f31d)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:27.010484 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a4ae2-549c-4390-8c59-6da642f74001 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:27.016812 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 162/327] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:26 2022] GET /identity/v3/users/1ea997de9d184e7ab2db7cee9755f31d => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:27.016932 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557de6c-c737-40c0-93a7-2957185c8aae admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:27.017640 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a4ae2-549c-4390-8c59-6da642f74001 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:27.022034 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557de6c-c737-40c0-93a7-2957185c8aae admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:27.026982 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea669f6d-cd1b-4c9b-8688-ba1a7d437394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:27.027359 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a4ae2-549c-4390-8c59-6da642f74001 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:27.027613 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea669f6d-cd1b-4c9b-8688-ba1a7d437394 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:27.027929 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea669f6d-cd1b-4c9b-8688-ba1a7d437394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:27.028205 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea669f6d-cd1b-4c9b-8688-ba1a7d437394 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:27.029032 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea669f6d-cd1b-4c9b-8688-ba1a7d437394 admin admin] RBAC: Adding query filter params (role.id=419ebcf5b1d8470394e463c9f01cb154, user.id=65cea400046c4172a5ceebc48aa417e6, scope.system=all) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:27.029341 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea669f6d-cd1b-4c9b-8688-ba1a7d437394 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:27.031146 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea669f6d-cd1b-4c9b-8688-ba1a7d437394 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:27.032035 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f376e-111c-4f15-81da-edd97d32d3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:27.032920 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f376e-111c-4f15-81da-edd97d32d3fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:27.033266 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f376e-111c-4f15-81da-edd97d32d3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:27.033607 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f376e-111c-4f15-81da-edd97d32d3fc admin admin] PATH_INFO: `/v3/system/users/1ea997de9d184e7ab2db7cee9755f31d/roles/d73ea8a0130d4158afa3b074bb2a4ccb` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:27.035124 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f376e-111c-4f15-81da-edd97d32d3fc admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1ea997de9d184e7ab2db7cee9755f31d, role_id=d73ea8a0130d4158afa3b074bb2a4ccb)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:27.036222 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING py.warnings [None req-462f376e-111c-4f15-81da-edd97d32d3fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:03:27.036222 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: warnings.warn(msg) Feb 10 23:03:27.036222 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: Feb 10 23:03:27.037215 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f376e-111c-4f15-81da-edd97d32d3fc admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:27.046744 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 166/328] 10.222.0.77 () {56 vars in 1329 bytes} [Thu Feb 10 23:03:27 2022] GET /identity/v3/role_assignments?user.id=65cea400046c4172a5ceebc48aa417e6&scope.system=all&role.id=419ebcf5b1d8470394e463c9f01cb154 => generated 510 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:27.056161 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 163/329] 10.222.0.77 () {58 vars in 1355 bytes} [Thu Feb 10 23:03:27 2022] PUT /identity/v3/system/users/1ea997de9d184e7ab2db7cee9755f31d/roles/d73ea8a0130d4158afa3b074bb2a4ccb => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:03:27.081559 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a8236-456f-4822-9b6a-ab08465f9ec3 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:27.081849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a8236-456f-4822-9b6a-ab08465f9ec3 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:27.082127 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a8236-456f-4822-9b6a-ab08465f9ec3 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:27.087859 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 167/330] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:27.090525 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50a76d-c93d-455c-9907-bea9f83c7d0e None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:27.090814 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50a76d-c93d-455c-9907-bea9f83c7d0e None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:27.091089 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50a76d-c93d-455c-9907-bea9f83c7d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:27.110593 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-0a50a76d-c93d-455c-9907-bea9f83c7d0e None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:27.112061 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-0a50a76d-c93d-455c-9907-bea9f83c7d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:27.121098 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 164/331] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:27.146112 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a8236-456f-4822-9b6a-ab08465f9ec3 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:27.160181 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a8236-456f-4822-9b6a-ab08465f9ec3 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:27.165512 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32aff0-b9b3-40f0-be92-d201a977c9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:27.166341 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32aff0-b9b3-40f0-be92-d201a977c9dd admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:27.166624 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32aff0-b9b3-40f0-be92-d201a977c9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:27.166897 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32aff0-b9b3-40f0-be92-d201a977c9dd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:27.168204 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32aff0-b9b3-40f0-be92-d201a977c9dd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:27.169943 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32aff0-b9b3-40f0-be92-d201a977c9dd admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:27.171799 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 168/332] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:27.177473 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50a76d-c93d-455c-9907-bea9f83c7d0e None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:27.188111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50a76d-c93d-455c-9907-bea9f83c7d0e None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:27.192798 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46e5a8-83bd-44cc-ae63-57a72a6839a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:27.193594 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46e5a8-83bd-44cc-ae63-57a72a6839a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:27.193954 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46e5a8-83bd-44cc-ae63-57a72a6839a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:27.194366 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46e5a8-83bd-44cc-ae63-57a72a6839a2 admin admin] PATH_INFO: `/v3/groups` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:27.195174 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46e5a8-83bd-44cc-ae63-57a72a6839a2 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:27.197258 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46e5a8-83bd-44cc-ae63-57a72a6839a2 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:27.212909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 165/333] 10.222.0.77 () {60 vars in 1155 bytes} [Thu Feb 10 23:03:27 2022] POST /identity/v3/groups => generated 226 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:03:29.504861 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc2b86-9279-4062-ac3d-641f9aa28a0f None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:29.505880 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc2b86-9279-4062-ac3d-641f9aa28a0f None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:29.506420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc2b86-9279-4062-ac3d-641f9aa28a0f None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:29.508667 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 169/334] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:29.514313 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6dc63-f074-47ce-9361-86e268bde0a2 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:29.515183 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6dc63-f074-47ce-9361-86e268bde0a2 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:29.515672 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6dc63-f074-47ce-9361-86e268bde0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:29.534614 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-f6d6dc63-f074-47ce-9361-86e268bde0a2 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:29.536142 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-f6d6dc63-f074-47ce-9361-86e268bde0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:29.544836 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 166/335] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:29.569450 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc2b86-9279-4062-ac3d-641f9aa28a0f None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:29.583742 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc2b86-9279-4062-ac3d-641f9aa28a0f None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:29.588685 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab3c7b-0def-4d81-9b06-d8d6cb51c859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:29.589722 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3c7b-0def-4d81-9b06-d8d6cb51c859 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:29.590216 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3c7b-0def-4d81-9b06-d8d6cb51c859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:29.590677 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3c7b-0def-4d81-9b06-d8d6cb51c859 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:29.603612 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab3c7b-0def-4d81-9b06-d8d6cb51c859 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:29.611377 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-9cab3c7b-0def-4d81-9b06-d8d6cb51c859 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 23:03:29.612819 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 170/336] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:29.619681 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6dc63-f074-47ce-9361-86e268bde0a2 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:29.629028 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6dc63-f074-47ce-9361-86e268bde0a2 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:29.635731 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93ff75-6cfa-455d-83f9-1aa2e44f8526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:29.636716 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93ff75-6cfa-455d-83f9-1aa2e44f8526 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:29.637192 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93ff75-6cfa-455d-83f9-1aa2e44f8526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:29.637655 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93ff75-6cfa-455d-83f9-1aa2e44f8526 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:29.638780 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93ff75-6cfa-455d-83f9-1aa2e44f8526 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:29.639299 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93ff75-6cfa-455d-83f9-1aa2e44f8526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:29.641117 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93ff75-6cfa-455d-83f9-1aa2e44f8526 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:29.651063 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 167/337] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:29.656872 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab3c7b-0def-4d81-9b06-d8d6cb51c859 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:29.666933 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab3c7b-0def-4d81-9b06-d8d6cb51c859 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:29.671518 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be5cd2-eb40-4d4c-8789-1a59d06dcf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:29.672642 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be5cd2-eb40-4d4c-8789-1a59d06dcf0a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:29.673117 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be5cd2-eb40-4d4c-8789-1a59d06dcf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:29.673580 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be5cd2-eb40-4d4c-8789-1a59d06dcf0a admin admin] PATH_INFO: `/v3/users/1ea997de9d184e7ab2db7cee9755f31d` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:29.674959 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be5cd2-eb40-4d4c-8789-1a59d06dcf0a admin admin] RBAC: Authorizing `identity:get_user(user_id=1ea997de9d184e7ab2db7cee9755f31d)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:29.677325 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be5cd2-eb40-4d4c-8789-1a59d06dcf0a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:29.680441 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 171/338] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:03:29 2022] GET /identity/v3/users/1ea997de9d184e7ab2db7cee9755f31d => generated 293 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:29.686175 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93ff75-6cfa-455d-83f9-1aa2e44f8526 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:29.696757 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93ff75-6cfa-455d-83f9-1aa2e44f8526 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:29.701407 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12003f91-4cf7-4de8-90f5-a2cbeefc024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:29.702318 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12003f91-4cf7-4de8-90f5-a2cbeefc024d admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:29.702793 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12003f91-4cf7-4de8-90f5-a2cbeefc024d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:29.703257 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12003f91-4cf7-4de8-90f5-a2cbeefc024d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:29.704324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12003f91-4cf7-4de8-90f5-a2cbeefc024d admin admin] RBAC: Adding query filter params (role.id=d73ea8a0130d4158afa3b074bb2a4ccb, user.id=1ea997de9d184e7ab2db7cee9755f31d, scope.system=all) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:29.704842 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12003f91-4cf7-4de8-90f5-a2cbeefc024d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:29.706979 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12003f91-4cf7-4de8-90f5-a2cbeefc024d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:29.723218 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 168/339] 10.222.0.77 () {56 vars in 1329 bytes} [Thu Feb 10 23:03:29 2022] GET /identity/v3/role_assignments?user.id=1ea997de9d184e7ab2db7cee9755f31d&scope.system=all&role.id=d73ea8a0130d4158afa3b074bb2a4ccb => generated 510 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:29.923087 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e737a8-2fd2-413f-b994-f8639d6339c6 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:29.923768 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e737a8-2fd2-413f-b994-f8639d6339c6 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:29.924274 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e737a8-2fd2-413f-b994-f8639d6339c6 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:29.926489 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 172/340] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:29.932200 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a62c5-38a0-4595-934c-5bf113f21f6a None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:29.932750 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a62c5-38a0-4595-934c-5bf113f21f6a None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:29.933216 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a62c5-38a0-4595-934c-5bf113f21f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:29.956362 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-817a62c5-38a0-4595-934c-5bf113f21f6a None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:29.957891 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-817a62c5-38a0-4595-934c-5bf113f21f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:29.971806 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 169/341] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:30.017637 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e737a8-2fd2-413f-b994-f8639d6339c6 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:30.036486 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e737a8-2fd2-413f-b994-f8639d6339c6 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:30.042058 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ecfcf-81a0-4534-9567-3e59712d0ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:30.043122 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ecfcf-81a0-4534-9567-3e59712d0ccf admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.043595 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ecfcf-81a0-4534-9567-3e59712d0ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.044085 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ecfcf-81a0-4534-9567-3e59712d0ccf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.062566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ecfcf-81a0-4534-9567-3e59712d0ccf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:30.071390 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-dd5ecfcf-81a0-4534-9567-3e59712d0ccf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 23:03:30.072910 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 173/342] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:03:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:30.078674 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a62c5-38a0-4595-934c-5bf113f21f6a None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:30.095463 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a62c5-38a0-4595-934c-5bf113f21f6a None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:30.100633 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c2497-34be-4228-a07a-f94c0328beef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:30.101322 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c2497-34be-4228-a07a-f94c0328beef admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.101784 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c2497-34be-4228-a07a-f94c0328beef admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.102059 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c2497-34be-4228-a07a-f94c0328beef admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.102826 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c2497-34be-4228-a07a-f94c0328beef admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:30.103131 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c2497-34be-4228-a07a-f94c0328beef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:30.104760 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c2497-34be-4228-a07a-f94c0328beef admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:30.114165 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 170/343] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:30.120099 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ecfcf-81a0-4534-9567-3e59712d0ccf admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:30.130049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ecfcf-81a0-4534-9567-3e59712d0ccf admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:30.138865 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6aea45-bff7-4edc-8d12-46aadad3b364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:30.139515 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6aea45-bff7-4edc-8d12-46aadad3b364 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.139859 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6aea45-bff7-4edc-8d12-46aadad3b364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.140091 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6aea45-bff7-4edc-8d12-46aadad3b364 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.148769 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6aea45-bff7-4edc-8d12-46aadad3b364 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:30.150585 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6aea45-bff7-4edc-8d12-46aadad3b364 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:30.154914 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a8100-51e3-4832-8826-3e83a5a30252 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.155198 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a8100-51e3-4832-8826-3e83a5a30252 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.155468 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a8100-51e3-4832-8826-3e83a5a30252 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.157406 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 171/344] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:30.162383 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cb5b9-b611-455f-b2f1-61f825a15130 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.163272 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cb5b9-b611-455f-b2f1-61f825a15130 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.163542 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cb5b9-b611-455f-b2f1-61f825a15130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.175194 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 174/345] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:30.184409 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6aea45-bff7-4edc-8d12-46aadad3b364 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:30.195451 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6aea45-bff7-4edc-8d12-46aadad3b364 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:30.196968 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-1b4cb5b9-b611-455f-b2f1-61f825a15130 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:30.198206 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-1b4cb5b9-b611-455f-b2f1-61f825a15130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:30.202808 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea68967-4ee1-403f-a253-2b0af82ab07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:30.203669 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea68967-4ee1-403f-a253-2b0af82ab07e admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.204037 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea68967-4ee1-403f-a253-2b0af82ab07e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.204306 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea68967-4ee1-403f-a253-2b0af82ab07e admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.210973 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea68967-4ee1-403f-a253-2b0af82ab07e admin admin] RBAC: Authorizing `identity:get_project(project_id=ff1d62262d6348b39c63a74a5afe64bd)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:30.213060 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea68967-4ee1-403f-a253-2b0af82ab07e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:30.215061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 175/346] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:30 2022] GET /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:30.222265 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 172/347] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:30.225209 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea68967-4ee1-403f-a253-2b0af82ab07e admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:30.235547 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea68967-4ee1-403f-a253-2b0af82ab07e admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:30.240393 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098dd7c-3bcd-42f6-a216-ff3e1dfa80bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:30.241790 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098dd7c-3bcd-42f6-a216-ff3e1dfa80bf admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.242070 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098dd7c-3bcd-42f6-a216-ff3e1dfa80bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.242396 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098dd7c-3bcd-42f6-a216-ff3e1dfa80bf admin admin] PATH_INFO: `/v3/groups/10032563c1f745fe943b5899f986408b` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.249164 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098dd7c-3bcd-42f6-a216-ff3e1dfa80bf admin admin] RBAC: Authorizing `identity:get_group(group_id=10032563c1f745fe943b5899f986408b)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:30.250187 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING py.warnings [None req-0098dd7c-3bcd-42f6-a216-ff3e1dfa80bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:03:30.250187 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: warnings.warn(msg) Feb 10 23:03:30.250187 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: Feb 10 23:03:30.251452 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098dd7c-3bcd-42f6-a216-ff3e1dfa80bf admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:30.253369 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 176/348] 10.222.0.77 () {56 vars in 1201 bytes} [Thu Feb 10 23:03:30 2022] GET /identity/v3/groups/10032563c1f745fe943b5899f986408b => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:30.259943 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cb5b9-b611-455f-b2f1-61f825a15130 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:30.263404 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098dd7c-3bcd-42f6-a216-ff3e1dfa80bf admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:30.280365 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cb5b9-b611-455f-b2f1-61f825a15130 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:30.282139 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098dd7c-3bcd-42f6-a216-ff3e1dfa80bf admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:30.289892 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023b65f-3d7f-47f7-8df7-c469d8b8999b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:30.296090 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f770b-efec-4c93-96fe-f0fe283f0a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:30.296950 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f770b-efec-4c93-96fe-f0fe283f0a6f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.297336 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f770b-efec-4c93-96fe-f0fe283f0a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.297658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f770b-efec-4c93-96fe-f0fe283f0a6f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.300442 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023b65f-3d7f-47f7-8df7-c469d8b8999b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.300720 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023b65f-3d7f-47f7-8df7-c469d8b8999b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.302117 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023b65f-3d7f-47f7-8df7-c469d8b8999b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.302989 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023b65f-3d7f-47f7-8df7-c469d8b8999b admin admin] RBAC: Adding query filter params (group.id=10032563c1f745fe943b5899f986408b, role.id=7f727831e261404999a27a5a15b515b1, scope.project.id=ff1d62262d6348b39c63a74a5afe64bd) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:30.305256 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023b65f-3d7f-47f7-8df7-c469d8b8999b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:30.308613 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023b65f-3d7f-47f7-8df7-c469d8b8999b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:30.320287 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 173/349] 10.222.0.77 () {56 vars in 1397 bytes} [Thu Feb 10 23:03:30 2022] GET /identity/v3/role_assignments?group.id=10032563c1f745fe943b5899f986408b&scope.project.id=ff1d62262d6348b39c63a74a5afe64bd&role.id=7f727831e261404999a27a5a15b515b1 => generated 260 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:30.320882 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f770b-efec-4c93-96fe-f0fe283f0a6f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:30.327841 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-d87f770b-efec-4c93-96fe-f0fe283f0a6f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 23:03:30.329074 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 177/350] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:03:30.337009 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023b65f-3d7f-47f7-8df7-c469d8b8999b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:30.349220 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023b65f-3d7f-47f7-8df7-c469d8b8999b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:30.357648 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546dad05-1e45-46e6-851b-e37f523470c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:30.358349 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546dad05-1e45-46e6-851b-e37f523470c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.358629 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546dad05-1e45-46e6-851b-e37f523470c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.358901 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546dad05-1e45-46e6-851b-e37f523470c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.359696 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546dad05-1e45-46e6-851b-e37f523470c4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:30.360045 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546dad05-1e45-46e6-851b-e37f523470c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:30.362001 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546dad05-1e45-46e6-851b-e37f523470c4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:30.376479 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 174/351] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:30.382876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f770b-efec-4c93-96fe-f0fe283f0a6f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:30.393922 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f770b-efec-4c93-96fe-f0fe283f0a6f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:30.404282 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f495791-86ae-4e3f-aa72-de803b70f75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:30.404957 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f495791-86ae-4e3f-aa72-de803b70f75b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.405237 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f495791-86ae-4e3f-aa72-de803b70f75b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.405510 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f495791-86ae-4e3f-aa72-de803b70f75b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.421151 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f495791-86ae-4e3f-aa72-de803b70f75b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:30.422942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f495791-86ae-4e3f-aa72-de803b70f75b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:30.434344 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 178/352] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:30.439746 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546dad05-1e45-46e6-851b-e37f523470c4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:30.450101 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546dad05-1e45-46e6-851b-e37f523470c4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:30.457576 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53961cd8-a8d6-4dd0-94d2-b62c02c41b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:30.458449 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53961cd8-a8d6-4dd0-94d2-b62c02c41b63 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.458728 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53961cd8-a8d6-4dd0-94d2-b62c02c41b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.458998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53961cd8-a8d6-4dd0-94d2-b62c02c41b63 admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.460904 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53961cd8-a8d6-4dd0-94d2-b62c02c41b63 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff1d62262d6348b39c63a74a5afe64bd)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:30.462969 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53961cd8-a8d6-4dd0-94d2-b62c02c41b63 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:30.464989 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 175/353] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:30 2022] GET /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:30.470344 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f495791-86ae-4e3f-aa72-de803b70f75b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:30.480650 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f495791-86ae-4e3f-aa72-de803b70f75b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:30.488512 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b7623-0709-48de-819e-ae4f54bbcee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:30.489466 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b7623-0709-48de-819e-ae4f54bbcee3 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.489746 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b7623-0709-48de-819e-ae4f54bbcee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.490018 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b7623-0709-48de-819e-ae4f54bbcee3 admin admin] PATH_INFO: `/v3/groups/10032563c1f745fe943b5899f986408b` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.492105 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b7623-0709-48de-819e-ae4f54bbcee3 admin admin] RBAC: Authorizing `identity:get_group(group_id=10032563c1f745fe943b5899f986408b)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:30.494048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b7623-0709-48de-819e-ae4f54bbcee3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:30.495990 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 179/354] 10.222.0.77 () {56 vars in 1201 bytes} [Thu Feb 10 23:03:30 2022] GET /identity/v3/groups/10032563c1f745fe943b5899f986408b => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:30.501709 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53961cd8-a8d6-4dd0-94d2-b62c02c41b63 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:30.513701 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53961cd8-a8d6-4dd0-94d2-b62c02c41b63 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:30.518919 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40769b33-69af-433e-9aae-c8b3602bb06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:30.519921 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40769b33-69af-433e-9aae-c8b3602bb06b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.520289 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40769b33-69af-433e-9aae-c8b3602bb06b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.520614 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40769b33-69af-433e-9aae-c8b3602bb06b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.521503 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40769b33-69af-433e-9aae-c8b3602bb06b admin admin] RBAC: Adding query filter params (group.id=10032563c1f745fe943b5899f986408b, role.id=419ebcf5b1d8470394e463c9f01cb154, scope.project.id=ff1d62262d6348b39c63a74a5afe64bd) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:30.521809 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40769b33-69af-433e-9aae-c8b3602bb06b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:30.524678 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40769b33-69af-433e-9aae-c8b3602bb06b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:30.534023 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 176/355] 10.222.0.77 () {56 vars in 1397 bytes} [Thu Feb 10 23:03:30 2022] GET /identity/v3/role_assignments?group.id=10032563c1f745fe943b5899f986408b&scope.project.id=ff1d62262d6348b39c63a74a5afe64bd&role.id=419ebcf5b1d8470394e463c9f01cb154 => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:30.663998 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6808c01-9111-4b15-99f4-a67b782165aa None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.664668 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6808c01-9111-4b15-99f4-a67b782165aa None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.664668 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6808c01-9111-4b15-99f4-a67b782165aa None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.666552 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 180/356] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:30.673552 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c6f47-e51d-4ca3-8366-c3cb11f4b2b6 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.673849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c6f47-e51d-4ca3-8366-c3cb11f4b2b6 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.674102 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c6f47-e51d-4ca3-8366-c3cb11f4b2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.697035 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-b53c6f47-e51d-4ca3-8366-c3cb11f4b2b6 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:30.698176 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-b53c6f47-e51d-4ca3-8366-c3cb11f4b2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:30.713852 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 177/357] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:30.752818 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6808c01-9111-4b15-99f4-a67b782165aa None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:30.768826 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6808c01-9111-4b15-99f4-a67b782165aa None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:30.775061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab286758-706f-4139-bd87-edcc4b34e49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:30.775901 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab286758-706f-4139-bd87-edcc4b34e49b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.776223 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab286758-706f-4139-bd87-edcc4b34e49b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.776491 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab286758-706f-4139-bd87-edcc4b34e49b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.791554 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab286758-706f-4139-bd87-edcc4b34e49b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:30.798894 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-ab286758-706f-4139-bd87-edcc4b34e49b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 23:03:30.800143 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 181/358] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:30.806799 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c6f47-e51d-4ca3-8366-c3cb11f4b2b6 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:30.815970 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c6f47-e51d-4ca3-8366-c3cb11f4b2b6 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:30.822784 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a78567-d328-4c27-a49c-e812cd23c5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:30.823448 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a78567-d328-4c27-a49c-e812cd23c5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.823727 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a78567-d328-4c27-a49c-e812cd23c5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.824117 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a78567-d328-4c27-a49c-e812cd23c5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.824912 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a78567-d328-4c27-a49c-e812cd23c5f7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:30.825174 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a78567-d328-4c27-a49c-e812cd23c5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:30.826763 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a78567-d328-4c27-a49c-e812cd23c5f7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:30.837331 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 178/359] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:30.842458 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab286758-706f-4139-bd87-edcc4b34e49b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:30.853400 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab286758-706f-4139-bd87-edcc4b34e49b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:30.864849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c40562-365f-424c-983d-9f1806615af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:30.865580 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c40562-365f-424c-983d-9f1806615af8 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.866903 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c40562-365f-424c-983d-9f1806615af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.867291 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c40562-365f-424c-983d-9f1806615af8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.880867 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c40562-365f-424c-983d-9f1806615af8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:30.883028 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c40562-365f-424c-983d-9f1806615af8 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:30.894782 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 182/360] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:30.900529 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a78567-d328-4c27-a49c-e812cd23c5f7 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:30.911093 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a78567-d328-4c27-a49c-e812cd23c5f7 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:30.922766 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b538d3-7dcf-4245-a94b-721710b591c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:30.923624 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b538d3-7dcf-4245-a94b-721710b591c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.923932 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b538d3-7dcf-4245-a94b-721710b591c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.924211 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b538d3-7dcf-4245-a94b-721710b591c0 admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.929224 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b538d3-7dcf-4245-a94b-721710b591c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=d3485c2fbadb4400a6eacec1952e81f3)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:30.931424 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b538d3-7dcf-4245-a94b-721710b591c0 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:30.933472 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 179/361] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:30 2022] GET /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:30.938629 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c40562-365f-424c-983d-9f1806615af8 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:30.950385 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c40562-365f-424c-983d-9f1806615af8 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:30.957968 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca107df8-f40e-4037-908c-bf1d2cf907fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:30.958857 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca107df8-f40e-4037-908c-bf1d2cf907fc admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.959159 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca107df8-f40e-4037-908c-bf1d2cf907fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.959579 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca107df8-f40e-4037-908c-bf1d2cf907fc admin admin] PATH_INFO: `/v3/groups/10032563c1f745fe943b5899f986408b` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.961627 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca107df8-f40e-4037-908c-bf1d2cf907fc admin admin] RBAC: Authorizing `identity:get_group(group_id=10032563c1f745fe943b5899f986408b)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:30.963578 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca107df8-f40e-4037-908c-bf1d2cf907fc admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:30.965300 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 183/362] 10.222.0.77 () {56 vars in 1201 bytes} [Thu Feb 10 23:03:30 2022] GET /identity/v3/groups/10032563c1f745fe943b5899f986408b => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:30.971195 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b538d3-7dcf-4245-a94b-721710b591c0 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:30.981315 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b538d3-7dcf-4245-a94b-721710b591c0 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:30.992151 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2bee1-de62-4b2c-9d77-c1c07426c919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:30.992813 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2bee1-de62-4b2c-9d77-c1c07426c919 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:30.993099 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2bee1-de62-4b2c-9d77-c1c07426c919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:30.993373 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2bee1-de62-4b2c-9d77-c1c07426c919 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:30.994223 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2bee1-de62-4b2c-9d77-c1c07426c919 admin admin] RBAC: Adding query filter params (group.id=10032563c1f745fe943b5899f986408b, role.id=419ebcf5b1d8470394e463c9f01cb154, scope.project.id=d3485c2fbadb4400a6eacec1952e81f3) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:30.994535 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2bee1-de62-4b2c-9d77-c1c07426c919 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:30.996429 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2bee1-de62-4b2c-9d77-c1c07426c919 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:31.002784 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 180/363] 10.222.0.77 () {56 vars in 1397 bytes} [Thu Feb 10 23:03:30 2022] GET /identity/v3/role_assignments?group.id=10032563c1f745fe943b5899f986408b&scope.project.id=d3485c2fbadb4400a6eacec1952e81f3&role.id=419ebcf5b1d8470394e463c9f01cb154 => generated 260 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:31.487163 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39446483-bb7a-42e0-9410-6c4d5492009d None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:31.487918 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39446483-bb7a-42e0-9410-6c4d5492009d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:31.488420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39446483-bb7a-42e0-9410-6c4d5492009d None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:31.490644 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 184/364] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:31.497135 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278fd2b-d4d1-4b87-ba51-f11439cd3afc None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:31.497678 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278fd2b-d4d1-4b87-ba51-f11439cd3afc None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:31.498162 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278fd2b-d4d1-4b87-ba51-f11439cd3afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:31.524808 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-9278fd2b-d4d1-4b87-ba51-f11439cd3afc None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:31.526771 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-9278fd2b-d4d1-4b87-ba51-f11439cd3afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:31.534831 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 181/365] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:31.581349 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39446483-bb7a-42e0-9410-6c4d5492009d None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:31.597847 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39446483-bb7a-42e0-9410-6c4d5492009d None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:31.604173 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1e7c3-5b54-4040-a161-1aa8baf445c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:31.604977 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1e7c3-5b54-4040-a161-1aa8baf445c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:31.605259 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1e7c3-5b54-4040-a161-1aa8baf445c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:31.605533 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1e7c3-5b54-4040-a161-1aa8baf445c1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:31.618275 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1e7c3-5b54-4040-a161-1aa8baf445c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:31.625781 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-8dc1e7c3-5b54-4040-a161-1aa8baf445c1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 23:03:31.627212 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 185/366] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:03:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:31.633214 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278fd2b-d4d1-4b87-ba51-f11439cd3afc None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:31.644984 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278fd2b-d4d1-4b87-ba51-f11439cd3afc None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:31.652031 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a02628-fe3d-4db2-a5de-81f687c964d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:31.652702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a02628-fe3d-4db2-a5de-81f687c964d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:31.652986 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a02628-fe3d-4db2-a5de-81f687c964d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:31.653260 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a02628-fe3d-4db2-a5de-81f687c964d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:31.654024 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a02628-fe3d-4db2-a5de-81f687c964d4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:31.654328 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a02628-fe3d-4db2-a5de-81f687c964d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:31.655973 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a02628-fe3d-4db2-a5de-81f687c964d4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:31.671298 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 182/367] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:31.677136 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1e7c3-5b54-4040-a161-1aa8baf445c1 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:31.690125 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1e7c3-5b54-4040-a161-1aa8baf445c1 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:31.700015 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41878cc-1205-461f-917b-8aae4ece99bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:31.700939 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41878cc-1205-461f-917b-8aae4ece99bd admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:31.701449 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41878cc-1205-461f-917b-8aae4ece99bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:31.701923 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41878cc-1205-461f-917b-8aae4ece99bd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:31.718168 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41878cc-1205-461f-917b-8aae4ece99bd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:31.720392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41878cc-1205-461f-917b-8aae4ece99bd admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:31.733807 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 186/368] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:31.739496 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a02628-fe3d-4db2-a5de-81f687c964d4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:31.756966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a02628-fe3d-4db2-a5de-81f687c964d4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:31.768490 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cd963-dfbe-4716-85b3-abddd3c8df64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:31.769356 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cd963-dfbe-4716-85b3-abddd3c8df64 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:31.769643 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cd963-dfbe-4716-85b3-abddd3c8df64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:31.769921 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cd963-dfbe-4716-85b3-abddd3c8df64 admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:31.771143 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990cd963-dfbe-4716-85b3-abddd3c8df64 admin admin] RBAC: Authorizing `identity:get_project(project_id=d3485c2fbadb4400a6eacec1952e81f3)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:31.773627 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990cd963-dfbe-4716-85b3-abddd3c8df64 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:31.775634 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 183/369] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:31 2022] GET /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3 => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:31.781130 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41878cc-1205-461f-917b-8aae4ece99bd admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:31.793140 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41878cc-1205-461f-917b-8aae4ece99bd admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:31.804766 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a909476-8f1c-40f8-b22a-78aaa7402930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:31.805907 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a909476-8f1c-40f8-b22a-78aaa7402930 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:31.806395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a909476-8f1c-40f8-b22a-78aaa7402930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:31.806870 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a909476-8f1c-40f8-b22a-78aaa7402930 admin admin] PATH_INFO: `/v3/groups/10032563c1f745fe943b5899f986408b` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:31.812573 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a909476-8f1c-40f8-b22a-78aaa7402930 admin admin] RBAC: Authorizing `identity:get_group(group_id=10032563c1f745fe943b5899f986408b)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:31.814698 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a909476-8f1c-40f8-b22a-78aaa7402930 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:31.816859 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 187/370] 10.222.0.77 () {56 vars in 1201 bytes} [Thu Feb 10 23:03:31 2022] GET /identity/v3/groups/10032563c1f745fe943b5899f986408b => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:31.823224 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cd963-dfbe-4716-85b3-abddd3c8df64 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:31.837398 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cd963-dfbe-4716-85b3-abddd3c8df64 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:31.846240 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5276c-d9fe-4cb3-b39f-17871299b312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:31.846890 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5276c-d9fe-4cb3-b39f-17871299b312 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:31.847178 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5276c-d9fe-4cb3-b39f-17871299b312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:31.847455 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5276c-d9fe-4cb3-b39f-17871299b312 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:31.848353 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5276c-d9fe-4cb3-b39f-17871299b312 admin admin] RBAC: Adding query filter params (group.id=10032563c1f745fe943b5899f986408b, role.id=7f727831e261404999a27a5a15b515b1, scope.project.id=d3485c2fbadb4400a6eacec1952e81f3) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:31.848690 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5276c-d9fe-4cb3-b39f-17871299b312 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:31.851070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5276c-d9fe-4cb3-b39f-17871299b312 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:31.864633 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 184/371] 10.222.0.77 () {56 vars in 1397 bytes} [Thu Feb 10 23:03:31 2022] GET /identity/v3/role_assignments?group.id=10032563c1f745fe943b5899f986408b&scope.project.id=d3485c2fbadb4400a6eacec1952e81f3&role.id=7f727831e261404999a27a5a15b515b1 => generated 260 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:32.186971 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3ac88-59c6-4add-b5cd-35df95e14c09 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:32.187680 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3ac88-59c6-4add-b5cd-35df95e14c09 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:32.188255 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3ac88-59c6-4add-b5cd-35df95e14c09 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:32.190535 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 188/372] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:32.198677 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51284d39-0c6f-45fa-8995-92ece85d9c15 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:32.198677 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51284d39-0c6f-45fa-8995-92ece85d9c15 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:32.198677 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51284d39-0c6f-45fa-8995-92ece85d9c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:32.224867 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-51284d39-0c6f-45fa-8995-92ece85d9c15 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:32.226101 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-51284d39-0c6f-45fa-8995-92ece85d9c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:32.236278 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 185/373] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:32.262940 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3ac88-59c6-4add-b5cd-35df95e14c09 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:32.279798 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3ac88-59c6-4add-b5cd-35df95e14c09 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:32.284589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5824b-cd58-4c4a-ab61-c77b76385cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:32.285722 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5824b-cd58-4c4a-ab61-c77b76385cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:32.286209 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5824b-cd58-4c4a-ab61-c77b76385cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:32.286680 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5824b-cd58-4c4a-ab61-c77b76385cf4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:32.300719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5824b-cd58-4c4a-ab61-c77b76385cf4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:32.310530 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-c8e5824b-cd58-4c4a-ab61-c77b76385cf4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:03:32.312363 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 189/374] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:03:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:32.318262 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51284d39-0c6f-45fa-8995-92ece85d9c15 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:32.332919 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51284d39-0c6f-45fa-8995-92ece85d9c15 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:32.342727 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f34b4-21f4-4847-bb15-1d36f17779f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:32.343364 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f34b4-21f4-4847-bb15-1d36f17779f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:32.343642 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f34b4-21f4-4847-bb15-1d36f17779f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:32.344007 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f34b4-21f4-4847-bb15-1d36f17779f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:32.344771 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f34b4-21f4-4847-bb15-1d36f17779f3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:32.345074 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f34b4-21f4-4847-bb15-1d36f17779f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:32.346680 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f34b4-21f4-4847-bb15-1d36f17779f3 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:32.359532 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 186/375] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:32.365356 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5824b-cd58-4c4a-ab61-c77b76385cf4 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:32.382349 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5824b-cd58-4c4a-ab61-c77b76385cf4 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:32.394981 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291df68-4bfd-46a3-938b-6975780e8dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:32.396294 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291df68-4bfd-46a3-938b-6975780e8dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:32.397725 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291df68-4bfd-46a3-938b-6975780e8dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:32.398247 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291df68-4bfd-46a3-938b-6975780e8dd9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:32.412083 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291df68-4bfd-46a3-938b-6975780e8dd9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:32.415077 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291df68-4bfd-46a3-938b-6975780e8dd9 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:32.430162 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 190/376] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:32.435997 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f34b4-21f4-4847-bb15-1d36f17779f3 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:32.450800 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f34b4-21f4-4847-bb15-1d36f17779f3 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:32.458765 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2c184-62aa-429f-9e0c-f822dbb8f2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:32.460249 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2c184-62aa-429f-9e0c-f822dbb8f2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:32.460744 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2c184-62aa-429f-9e0c-f822dbb8f2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:32.461021 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2c184-62aa-429f-9e0c-f822dbb8f2a2 admin admin] PATH_INFO: `/v3/projects/6a8319582f7d4e2b90ad1c11263c01da` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:32.464558 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2c184-62aa-429f-9e0c-f822dbb8f2a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=6a8319582f7d4e2b90ad1c11263c01da)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:32.466363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2c184-62aa-429f-9e0c-f822dbb8f2a2 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:32.468065 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 187/377] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:32 2022] GET /identity/v3/projects/6a8319582f7d4e2b90ad1c11263c01da => generated 344 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:32.473809 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291df68-4bfd-46a3-938b-6975780e8dd9 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:32.484766 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291df68-4bfd-46a3-938b-6975780e8dd9 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:32.493032 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ee7e6-37df-4b6f-ab79-350f51fc2622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:32.494212 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ee7e6-37df-4b6f-ab79-350f51fc2622 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:32.494733 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ee7e6-37df-4b6f-ab79-350f51fc2622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:32.495209 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ee7e6-37df-4b6f-ab79-350f51fc2622 admin admin] PATH_INFO: `/v3/groups/9a43f2b7ec394c3ba052bc3050b7ef2a` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:32.504138 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ee7e6-37df-4b6f-ab79-350f51fc2622 admin admin] RBAC: Authorizing `identity:get_group(group_id=9a43f2b7ec394c3ba052bc3050b7ef2a)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:32.506953 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ee7e6-37df-4b6f-ab79-350f51fc2622 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:32.509091 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 191/378] 10.222.0.77 () {56 vars in 1201 bytes} [Thu Feb 10 23:03:32 2022] GET /identity/v3/groups/9a43f2b7ec394c3ba052bc3050b7ef2a => generated 229 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:32.515135 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2c184-62aa-429f-9e0c-f822dbb8f2a2 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:32.528731 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2c184-62aa-429f-9e0c-f822dbb8f2a2 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:32.538411 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7024e26-3864-4aa3-8622-26160cfd5fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:32.539060 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7024e26-3864-4aa3-8622-26160cfd5fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:32.539347 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7024e26-3864-4aa3-8622-26160cfd5fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:32.539625 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7024e26-3864-4aa3-8622-26160cfd5fc2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:32.540492 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7024e26-3864-4aa3-8622-26160cfd5fc2 admin admin] RBAC: Adding query filter params (group.id=9a43f2b7ec394c3ba052bc3050b7ef2a, role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f, scope.project.id=6a8319582f7d4e2b90ad1c11263c01da) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:32.540805 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7024e26-3864-4aa3-8622-26160cfd5fc2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:32.542639 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7024e26-3864-4aa3-8622-26160cfd5fc2 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:32.552036 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 188/379] 10.222.0.77 () {56 vars in 1397 bytes} [Thu Feb 10 23:03:32 2022] GET /identity/v3/role_assignments?group.id=9a43f2b7ec394c3ba052bc3050b7ef2a&scope.project.id=6a8319582f7d4e2b90ad1c11263c01da&role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:33.235143 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ef3f6-5666-418b-8410-f5124fcb4e32 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:33.235648 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ef3f6-5666-418b-8410-f5124fcb4e32 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:33.236201 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ef3f6-5666-418b-8410-f5124fcb4e32 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:33.237990 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 192/380] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:33.243887 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87560895-5f1f-46d4-b892-ef5aa5d49619 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:33.244182 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87560895-5f1f-46d4-b892-ef5aa5d49619 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:33.244462 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87560895-5f1f-46d4-b892-ef5aa5d49619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:33.273368 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-87560895-5f1f-46d4-b892-ef5aa5d49619 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:33.274570 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-87560895-5f1f-46d4-b892-ef5aa5d49619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:33.285442 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 189/381] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:33.320719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ef3f6-5666-418b-8410-f5124fcb4e32 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:33.337408 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ef3f6-5666-418b-8410-f5124fcb4e32 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:33.341925 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bde25c-5409-4038-b728-f0373f6c5f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:33.342704 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bde25c-5409-4038-b728-f0373f6c5f50 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:33.342987 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bde25c-5409-4038-b728-f0373f6c5f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:33.343260 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bde25c-5409-4038-b728-f0373f6c5f50 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:33.359350 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bde25c-5409-4038-b728-f0373f6c5f50 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:33.367221 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-87bde25c-5409-4038-b728-f0373f6c5f50 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 23:03:33.368790 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 193/382] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:03:33.374357 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87560895-5f1f-46d4-b892-ef5aa5d49619 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:33.388849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87560895-5f1f-46d4-b892-ef5aa5d49619 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:33.394680 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44916e94-26d1-440a-9853-97930a6097c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:33.395342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44916e94-26d1-440a-9853-97930a6097c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:33.395622 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44916e94-26d1-440a-9853-97930a6097c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:33.395918 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44916e94-26d1-440a-9853-97930a6097c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:33.396686 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44916e94-26d1-440a-9853-97930a6097c0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:33.397556 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44916e94-26d1-440a-9853-97930a6097c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:33.399391 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44916e94-26d1-440a-9853-97930a6097c0 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:33.411431 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 190/383] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:33.418359 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bde25c-5409-4038-b728-f0373f6c5f50 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:33.432691 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bde25c-5409-4038-b728-f0373f6c5f50 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:33.439575 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6196a-bb41-47a4-9ae5-792318adad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:33.440503 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6196a-bb41-47a4-9ae5-792318adad1a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:33.440843 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6196a-bb41-47a4-9ae5-792318adad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:33.441121 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6196a-bb41-47a4-9ae5-792318adad1a admin admin] PATH_INFO: `/v3/groups/10032563c1f745fe943b5899f986408b` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:33.443097 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6196a-bb41-47a4-9ae5-792318adad1a admin admin] RBAC: Authorizing `identity:get_group(group_id=10032563c1f745fe943b5899f986408b)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:33.445283 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6196a-bb41-47a4-9ae5-792318adad1a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:33.447404 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 194/384] 10.222.0.77 () {56 vars in 1201 bytes} [Thu Feb 10 23:03:33 2022] GET /identity/v3/groups/10032563c1f745fe943b5899f986408b => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:33.452795 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44916e94-26d1-440a-9853-97930a6097c0 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:33.464927 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44916e94-26d1-440a-9853-97930a6097c0 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:33.475088 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51af321-7733-4846-9226-8268d931e07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:33.476682 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51af321-7733-4846-9226-8268d931e07b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:33.476967 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51af321-7733-4846-9226-8268d931e07b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:33.477243 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51af321-7733-4846-9226-8268d931e07b admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:33.480787 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51af321-7733-4846-9226-8268d931e07b admin admin] RBAC: Authorizing `identity:get_project(project_id=ff1d62262d6348b39c63a74a5afe64bd)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:33.482900 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51af321-7733-4846-9226-8268d931e07b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:33.485004 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 191/385] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:33 2022] GET /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:33.491225 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6196a-bb41-47a4-9ae5-792318adad1a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:33.507102 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6196a-bb41-47a4-9ae5-792318adad1a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:33.513355 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1dbcc-c097-44d9-b466-986cccfd5a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:33.514293 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1dbcc-c097-44d9-b466-986cccfd5a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:33.514578 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1dbcc-c097-44d9-b466-986cccfd5a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:33.514855 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1dbcc-c097-44d9-b466-986cccfd5a92 admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd/groups/10032563c1f745fe943b5899f986408b/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:33.517714 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1dbcc-c097-44d9-b466-986cccfd5a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1d62262d6348b39c63a74a5afe64bd, group_id=10032563c1f745fe943b5899f986408b, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:33.520563 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1dbcc-c097-44d9-b466-986cccfd5a92 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:33.554301 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 195/386] 10.222.0.77 () {58 vars in 1463 bytes} [Thu Feb 10 23:03:33 2022] PUT /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd/groups/10032563c1f745fe943b5899f986408b/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:03:33.805688 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ae795-0ddb-4b6a-b735-8087d638ec91 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:33.806376 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ae795-0ddb-4b6a-b735-8087d638ec91 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:33.806376 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ae795-0ddb-4b6a-b735-8087d638ec91 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:33.808227 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 192/387] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:33.813475 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b45029-765d-49ab-a900-d67f4b36f99c None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:33.813766 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b45029-765d-49ab-a900-d67f4b36f99c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:33.814048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b45029-765d-49ab-a900-d67f4b36f99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:33.841026 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-27b45029-765d-49ab-a900-d67f4b36f99c None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:33.842251 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-27b45029-765d-49ab-a900-d67f4b36f99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:33.906930 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 196/388] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:33.936728 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ae795-0ddb-4b6a-b735-8087d638ec91 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:33.953605 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ae795-0ddb-4b6a-b735-8087d638ec91 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:33.956905 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23e8ff-3bfe-4c00-bbde-c3650c5da04b None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:33.957249 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23e8ff-3bfe-4c00-bbde-c3650c5da04b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:33.957531 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23e8ff-3bfe-4c00-bbde-c3650c5da04b None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:33.958248 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a33127-cbd3-4e02-aeb5-b30ee5308234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:33.959047 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a33127-cbd3-4e02-aeb5-b30ee5308234 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:33.959477 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a33127-cbd3-4e02-aeb5-b30ee5308234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:33.960310 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 197/389] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:33.960468 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a33127-cbd3-4e02-aeb5-b30ee5308234 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:33.966283 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23355ca4-5b83-43e5-bc88-43ddfb9ac32d None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:33.966572 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23355ca4-5b83-43e5-bc88-43ddfb9ac32d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:33.966852 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23355ca4-5b83-43e5-bc88-43ddfb9ac32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:33.975470 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a33127-cbd3-4e02-aeb5-b30ee5308234 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:33.982720 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-81a33127-cbd3-4e02-aeb5-b30ee5308234 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 23:03:33.983934 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 193/390] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:03:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:33.990040 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-23355ca4-5b83-43e5-bc88-43ddfb9ac32d None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:33.990040 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-23355ca4-5b83-43e5-bc88-43ddfb9ac32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:33.990261 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a33127-cbd3-4e02-aeb5-b30ee5308234 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:34.003377 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a33127-cbd3-4e02-aeb5-b30ee5308234 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:34.005255 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 198/391] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:34.010375 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d250d-84c9-44e1-9801-bc63678736db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:34.011035 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d250d-84c9-44e1-9801-bc63678736db admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:34.011316 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d250d-84c9-44e1-9801-bc63678736db admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:34.011588 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d250d-84c9-44e1-9801-bc63678736db admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:34.012751 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d250d-84c9-44e1-9801-bc63678736db admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:34.013069 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d250d-84c9-44e1-9801-bc63678736db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:34.014659 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d250d-84c9-44e1-9801-bc63678736db admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:34.025978 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 194/392] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:34.031170 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23355ca4-5b83-43e5-bc88-43ddfb9ac32d None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:34.033043 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d250d-84c9-44e1-9801-bc63678736db admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:34.045067 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23355ca4-5b83-43e5-bc88-43ddfb9ac32d None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:34.047694 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d250d-84c9-44e1-9801-bc63678736db admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:34.056100 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42979c-92f8-494e-a856-d989c703281d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:34.056862 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42979c-92f8-494e-a856-d989c703281d admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:34.057161 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42979c-92f8-494e-a856-d989c703281d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:34.057408 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42979c-92f8-494e-a856-d989c703281d admin admin] PATH_INFO: `/v3/groups/10032563c1f745fe943b5899f986408b` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:34.058487 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417d873-3c5a-4e2c-af8e-8bca35633ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:34.059357 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417d873-3c5a-4e2c-af8e-8bca35633ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:34.059635 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417d873-3c5a-4e2c-af8e-8bca35633ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:34.059959 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417d873-3c5a-4e2c-af8e-8bca35633ec4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:34.061026 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42979c-92f8-494e-a856-d989c703281d admin admin] RBAC: Authorizing `identity:get_group(group_id=10032563c1f745fe943b5899f986408b)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:34.062941 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42979c-92f8-494e-a856-d989c703281d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:34.069354 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 199/393] 10.222.0.77 () {56 vars in 1201 bytes} [Thu Feb 10 23:03:34 2022] GET /identity/v3/groups/10032563c1f745fe943b5899f986408b => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:34.074433 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42979c-92f8-494e-a856-d989c703281d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:34.089081 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417d873-3c5a-4e2c-af8e-8bca35633ec4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:34.090226 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42979c-92f8-494e-a856-d989c703281d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:34.097039 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-2417d873-3c5a-4e2c-af8e-8bca35633ec4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 23:03:34.098674 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 195/394] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:34.105546 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417d873-3c5a-4e2c-af8e-8bca35633ec4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:34.108550 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30240791-6b34-4131-9163-a0459790c741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:34.109416 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30240791-6b34-4131-9163-a0459790c741 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:34.109695 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30240791-6b34-4131-9163-a0459790c741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:34.109962 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30240791-6b34-4131-9163-a0459790c741 admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:34.111472 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30240791-6b34-4131-9163-a0459790c741 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff1d62262d6348b39c63a74a5afe64bd)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:34.113536 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30240791-6b34-4131-9163-a0459790c741 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:34.115640 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 200/395] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:34 2022] GET /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:34.119323 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417d873-3c5a-4e2c-af8e-8bca35633ec4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:34.122817 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30240791-6b34-4131-9163-a0459790c741 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:34.126636 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5878e-e05b-41d9-91aa-2fb2f1ac3a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:34.127556 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5878e-e05b-41d9-91aa-2fb2f1ac3a16 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:34.128290 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5878e-e05b-41d9-91aa-2fb2f1ac3a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:34.128716 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5878e-e05b-41d9-91aa-2fb2f1ac3a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:34.129794 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5878e-e05b-41d9-91aa-2fb2f1ac3a16 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:34.130253 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5878e-e05b-41d9-91aa-2fb2f1ac3a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:34.135562 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5878e-e05b-41d9-91aa-2fb2f1ac3a16 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:34.144522 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30240791-6b34-4131-9163-a0459790c741 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:34.154464 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 196/396] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:34.154745 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cac9f-afa7-43a6-9649-227b8198fc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:34.155891 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cac9f-afa7-43a6-9649-227b8198fc2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:34.156342 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cac9f-afa7-43a6-9649-227b8198fc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:34.156813 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cac9f-afa7-43a6-9649-227b8198fc2e admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd/groups/10032563c1f745fe943b5899f986408b/roles/7f727831e261404999a27a5a15b515b1` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:34.159352 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cac9f-afa7-43a6-9649-227b8198fc2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1d62262d6348b39c63a74a5afe64bd, group_id=10032563c1f745fe943b5899f986408b, role_id=7f727831e261404999a27a5a15b515b1)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:34.160472 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5878e-e05b-41d9-91aa-2fb2f1ac3a16 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:34.171193 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cac9f-afa7-43a6-9649-227b8198fc2e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:34.177865 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5878e-e05b-41d9-91aa-2fb2f1ac3a16 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:34.192397 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 201/397] 10.222.0.77 () {58 vars in 1463 bytes} [Thu Feb 10 23:03:34 2022] PUT /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd/groups/10032563c1f745fe943b5899f986408b/roles/7f727831e261404999a27a5a15b515b1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:03:34.201383 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dda61f-9569-4e89-ab71-b81b9faf6e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:34.202364 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dda61f-9569-4e89-ab71-b81b9faf6e49 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:34.202719 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dda61f-9569-4e89-ab71-b81b9faf6e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:34.203063 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dda61f-9569-4e89-ab71-b81b9faf6e49 admin admin] PATH_INFO: `/v3/groups/10032563c1f745fe943b5899f986408b` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:34.204495 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dda61f-9569-4e89-ab71-b81b9faf6e49 admin admin] RBAC: Authorizing `identity:get_group(group_id=10032563c1f745fe943b5899f986408b)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:34.205777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING py.warnings [None req-b5dda61f-9569-4e89-ab71-b81b9faf6e49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:03:34.205777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: warnings.warn(msg) Feb 10 23:03:34.205777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: Feb 10 23:03:34.207262 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dda61f-9569-4e89-ab71-b81b9faf6e49 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:34.209101 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 197/398] 10.222.0.77 () {56 vars in 1201 bytes} [Thu Feb 10 23:03:34 2022] GET /identity/v3/groups/10032563c1f745fe943b5899f986408b => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:34.215639 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cac9f-afa7-43a6-9649-227b8198fc2e admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:34.292675 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cac9f-afa7-43a6-9649-227b8198fc2e admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:34.305283 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655fe44-e4c6-47a7-a633-4ad72d81cdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:34.306462 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655fe44-e4c6-47a7-a633-4ad72d81cdc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:34.306774 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655fe44-e4c6-47a7-a633-4ad72d81cdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:34.307123 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655fe44-e4c6-47a7-a633-4ad72d81cdc5 admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:34.308451 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655fe44-e4c6-47a7-a633-4ad72d81cdc5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d3485c2fbadb4400a6eacec1952e81f3)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:34.310661 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655fe44-e4c6-47a7-a633-4ad72d81cdc5 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:34.312560 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 202/399] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:34 2022] GET /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3 => generated 302 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:34.318596 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dda61f-9569-4e89-ab71-b81b9faf6e49 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:34.329743 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dda61f-9569-4e89-ab71-b81b9faf6e49 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:34.338076 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269c453-354b-4ef5-83ae-57d8c9cbcd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:34.339076 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269c453-354b-4ef5-83ae-57d8c9cbcd29 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:34.339435 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269c453-354b-4ef5-83ae-57d8c9cbcd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:34.339782 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269c453-354b-4ef5-83ae-57d8c9cbcd29 admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3/groups/10032563c1f745fe943b5899f986408b/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:34.345253 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269c453-354b-4ef5-83ae-57d8c9cbcd29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3485c2fbadb4400a6eacec1952e81f3, group_id=10032563c1f745fe943b5899f986408b, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:34.348030 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269c453-354b-4ef5-83ae-57d8c9cbcd29 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:34.373604 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 198/400] 10.222.0.77 () {58 vars in 1463 bytes} [Thu Feb 10 23:03:34 2022] PUT /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3/groups/10032563c1f745fe943b5899f986408b/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:03:35.200950 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91929173-7d28-4b40-a7fa-4489b15371d8 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:35.201319 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91929173-7d28-4b40-a7fa-4489b15371d8 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:35.201491 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91929173-7d28-4b40-a7fa-4489b15371d8 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:35.203541 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 203/401] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:03:35.210392 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f65374-c06c-4907-9215-4a99b97c1ba6 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:35.211040 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f65374-c06c-4907-9215-4a99b97c1ba6 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:35.211040 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f65374-c06c-4907-9215-4a99b97c1ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:35.238480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-e8f65374-c06c-4907-9215-4a99b97c1ba6 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:35.239710 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e8f65374-c06c-4907-9215-4a99b97c1ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:35.311509 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 199/402] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:35.336781 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91929173-7d28-4b40-a7fa-4489b15371d8 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:35.349353 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91929173-7d28-4b40-a7fa-4489b15371d8 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:35.354956 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19233c-e131-4cbf-9a67-b1663a56bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:35.355782 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19233c-e131-4cbf-9a67-b1663a56bf31 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:35.356101 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19233c-e131-4cbf-9a67-b1663a56bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:35.356374 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19233c-e131-4cbf-9a67-b1663a56bf31 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:35.369014 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19233c-e131-4cbf-9a67-b1663a56bf31 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:35.376382 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-ae19233c-e131-4cbf-9a67-b1663a56bf31 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 23:03:35.382571 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 204/403] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:03:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:35.383973 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f65374-c06c-4907-9215-4a99b97c1ba6 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:35.395083 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f65374-c06c-4907-9215-4a99b97c1ba6 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:35.399925 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd4eba-89e3-4250-8fe0-6dfc0fbc8c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:35.400656 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd4eba-89e3-4250-8fe0-6dfc0fbc8c7e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:35.400939 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd4eba-89e3-4250-8fe0-6dfc0fbc8c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:35.401216 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd4eba-89e3-4250-8fe0-6dfc0fbc8c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:35.402046 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd4eba-89e3-4250-8fe0-6dfc0fbc8c7e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:35.402355 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd4eba-89e3-4250-8fe0-6dfc0fbc8c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:35.403992 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd4eba-89e3-4250-8fe0-6dfc0fbc8c7e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:35.413539 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 200/404] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:35.419276 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19233c-e131-4cbf-9a67-b1663a56bf31 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:35.430898 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19233c-e131-4cbf-9a67-b1663a56bf31 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:35.435641 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb366d51-f286-472a-9940-8f7194eb9cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:35.436545 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb366d51-f286-472a-9940-8f7194eb9cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:35.436876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb366d51-f286-472a-9940-8f7194eb9cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:35.437150 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb366d51-f286-472a-9940-8f7194eb9cf2 admin admin] PATH_INFO: `/v3/groups/10032563c1f745fe943b5899f986408b` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:35.438367 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb366d51-f286-472a-9940-8f7194eb9cf2 admin admin] RBAC: Authorizing `identity:get_group(group_id=10032563c1f745fe943b5899f986408b)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:35.440315 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb366d51-f286-472a-9940-8f7194eb9cf2 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:35.447123 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 205/405] 10.222.0.77 () {56 vars in 1201 bytes} [Thu Feb 10 23:03:35 2022] GET /identity/v3/groups/10032563c1f745fe943b5899f986408b => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:35.448572 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd4eba-89e3-4250-8fe0-6dfc0fbc8c7e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:35.459183 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd4eba-89e3-4250-8fe0-6dfc0fbc8c7e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:35.469960 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61da645-98b7-4677-95a0-0b0e0a4a4457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:35.470829 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61da645-98b7-4677-95a0-0b0e0a4a4457 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:35.471111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61da645-98b7-4677-95a0-0b0e0a4a4457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:35.471390 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61da645-98b7-4677-95a0-0b0e0a4a4457 admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:35.473522 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61da645-98b7-4677-95a0-0b0e0a4a4457 admin admin] RBAC: Authorizing `identity:get_project(project_id=d3485c2fbadb4400a6eacec1952e81f3)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:35.476339 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61da645-98b7-4677-95a0-0b0e0a4a4457 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:35.478342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 201/406] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:35 2022] GET /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:35.483554 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb366d51-f286-472a-9940-8f7194eb9cf2 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:35.495341 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb366d51-f286-472a-9940-8f7194eb9cf2 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:35.500102 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068aa6bb-d30f-4877-86fb-3b594454551d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:35.501034 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068aa6bb-d30f-4877-86fb-3b594454551d admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:35.501323 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068aa6bb-d30f-4877-86fb-3b594454551d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:35.501598 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068aa6bb-d30f-4877-86fb-3b594454551d admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3/groups/10032563c1f745fe943b5899f986408b/roles/7f727831e261404999a27a5a15b515b1` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:35.503994 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068aa6bb-d30f-4877-86fb-3b594454551d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3485c2fbadb4400a6eacec1952e81f3, group_id=10032563c1f745fe943b5899f986408b, role_id=7f727831e261404999a27a5a15b515b1)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:35.507008 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068aa6bb-d30f-4877-86fb-3b594454551d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:35.524410 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 206/407] 10.222.0.77 () {58 vars in 1463 bytes} [Thu Feb 10 23:03:35 2022] PUT /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3/groups/10032563c1f745fe943b5899f986408b/roles/7f727831e261404999a27a5a15b515b1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:03:35.591713 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728ff27-36fc-48a6-bb95-31965ae9ce03 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:35.592042 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728ff27-36fc-48a6-bb95-31965ae9ce03 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:35.592264 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728ff27-36fc-48a6-bb95-31965ae9ce03 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:35.594531 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 202/408] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:35.600584 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d1134-ff69-4541-b2fa-d426bb5866b5 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:35.600878 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d1134-ff69-4541-b2fa-d426bb5866b5 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:35.601208 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d1134-ff69-4541-b2fa-d426bb5866b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:35.622619 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-b21d1134-ff69-4541-b2fa-d426bb5866b5 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:35.623866 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-b21d1134-ff69-4541-b2fa-d426bb5866b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:35.694748 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 207/409] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:35.734396 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728ff27-36fc-48a6-bb95-31965ae9ce03 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:35.750916 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728ff27-36fc-48a6-bb95-31965ae9ce03 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:35.755681 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cc5ab-cbbf-4eb2-aa70-3acefa7a88e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:35.757303 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cc5ab-cbbf-4eb2-aa70-3acefa7a88e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:35.757725 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cc5ab-cbbf-4eb2-aa70-3acefa7a88e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:35.758021 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cc5ab-cbbf-4eb2-aa70-3acefa7a88e2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:35.770614 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cc5ab-cbbf-4eb2-aa70-3acefa7a88e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:35.778363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-b13cc5ab-cbbf-4eb2-aa70-3acefa7a88e2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:03:35.780005 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 203/410] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:03:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:35.785916 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d1134-ff69-4541-b2fa-d426bb5866b5 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:35.798137 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d1134-ff69-4541-b2fa-d426bb5866b5 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:35.808658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff6c1d-3afc-43fc-9703-2626b8431ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:35.809345 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff6c1d-3afc-43fc-9703-2626b8431ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:35.809629 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff6c1d-3afc-43fc-9703-2626b8431ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:35.809900 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff6c1d-3afc-43fc-9703-2626b8431ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:35.810679 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff6c1d-3afc-43fc-9703-2626b8431ee8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:35.810985 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff6c1d-3afc-43fc-9703-2626b8431ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:35.812626 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff6c1d-3afc-43fc-9703-2626b8431ee8 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:35.824570 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 208/411] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:35.830158 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cc5ab-cbbf-4eb2-aa70-3acefa7a88e2 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:35.845551 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cc5ab-cbbf-4eb2-aa70-3acefa7a88e2 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:35.851001 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ec217-a83d-439b-bb9b-60699cb1ed0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:35.851948 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ec217-a83d-439b-bb9b-60699cb1ed0d admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:35.852231 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ec217-a83d-439b-bb9b-60699cb1ed0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:35.852558 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ec217-a83d-439b-bb9b-60699cb1ed0d admin admin] PATH_INFO: `/v3/groups/9a43f2b7ec394c3ba052bc3050b7ef2a` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:35.853834 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ec217-a83d-439b-bb9b-60699cb1ed0d admin admin] RBAC: Authorizing `identity:get_group(group_id=9a43f2b7ec394c3ba052bc3050b7ef2a)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:35.855888 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ec217-a83d-439b-bb9b-60699cb1ed0d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:35.857716 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 204/412] 10.222.0.77 () {56 vars in 1201 bytes} [Thu Feb 10 23:03:35 2022] GET /identity/v3/groups/9a43f2b7ec394c3ba052bc3050b7ef2a => generated 229 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:35.863685 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff6c1d-3afc-43fc-9703-2626b8431ee8 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:35.876964 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff6c1d-3afc-43fc-9703-2626b8431ee8 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:35.888053 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6bb8c-1070-4d32-b5f1-ee715ad98d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:35.888922 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6bb8c-1070-4d32-b5f1-ee715ad98d00 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:35.889203 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6bb8c-1070-4d32-b5f1-ee715ad98d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:35.889499 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6bb8c-1070-4d32-b5f1-ee715ad98d00 admin admin] PATH_INFO: `/v3/projects/6a8319582f7d4e2b90ad1c11263c01da` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:35.896901 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6bb8c-1070-4d32-b5f1-ee715ad98d00 admin admin] RBAC: Authorizing `identity:get_project(project_id=6a8319582f7d4e2b90ad1c11263c01da)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:35.898846 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6bb8c-1070-4d32-b5f1-ee715ad98d00 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:35.900978 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 209/413] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:35 2022] GET /identity/v3/projects/6a8319582f7d4e2b90ad1c11263c01da => generated 344 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:35.907070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ec217-a83d-439b-bb9b-60699cb1ed0d admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:35.921533 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ec217-a83d-439b-bb9b-60699cb1ed0d admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:35.932867 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60f19c-6f65-4cf3-af38-a143a9d30630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:35.934040 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60f19c-6f65-4cf3-af38-a143a9d30630 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:35.934556 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60f19c-6f65-4cf3-af38-a143a9d30630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:35.935066 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60f19c-6f65-4cf3-af38-a143a9d30630 admin admin] PATH_INFO: `/v3/projects/6a8319582f7d4e2b90ad1c11263c01da/groups/9a43f2b7ec394c3ba052bc3050b7ef2a/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:35.937377 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60f19c-6f65-4cf3-af38-a143a9d30630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8319582f7d4e2b90ad1c11263c01da, group_id=9a43f2b7ec394c3ba052bc3050b7ef2a, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:35.940382 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60f19c-6f65-4cf3-af38-a143a9d30630 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:35.972067 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 205/414] 10.222.0.77 () {58 vars in 1463 bytes} [Thu Feb 10 23:03:35 2022] PUT /identity/v3/projects/6a8319582f7d4e2b90ad1c11263c01da/groups/9a43f2b7ec394c3ba052bc3050b7ef2a/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:03:36.607401 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128bdcf-6836-4cbc-ad9b-f962e77a4e29 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:36.607940 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128bdcf-6836-4cbc-ad9b-f962e77a4e29 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:36.608132 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128bdcf-6836-4cbc-ad9b-f962e77a4e29 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:36.609975 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 210/415] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:36.625529 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e5451-c69c-42ed-9b60-31cb0ce54324 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:36.626142 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e5451-c69c-42ed-9b60-31cb0ce54324 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:36.626142 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e5451-c69c-42ed-9b60-31cb0ce54324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:36.650073 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-e10e5451-c69c-42ed-9b60-31cb0ce54324 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:36.651266 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e10e5451-c69c-42ed-9b60-31cb0ce54324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:36.726830 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 206/416] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:36.763918 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128bdcf-6836-4cbc-ad9b-f962e77a4e29 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:36.780486 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128bdcf-6836-4cbc-ad9b-f962e77a4e29 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:36.785068 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d3e71-cf6e-4c39-903f-5aacc0c4bd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:36.785860 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d3e71-cf6e-4c39-903f-5aacc0c4bd1c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:36.786140 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d3e71-cf6e-4c39-903f-5aacc0c4bd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:36.786418 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d3e71-cf6e-4c39-903f-5aacc0c4bd1c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:36.800842 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d3e71-cf6e-4c39-903f-5aacc0c4bd1c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:36.808512 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-9a2d3e71-cf6e-4c39-903f-5aacc0c4bd1c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 23:03:36.809733 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 211/417] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:36.815510 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e5451-c69c-42ed-9b60-31cb0ce54324 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:36.828914 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e5451-c69c-42ed-9b60-31cb0ce54324 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:36.833547 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f85b3-b2f0-425a-830f-dcab76e5cfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:36.834485 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f85b3-b2f0-425a-830f-dcab76e5cfae admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:36.834775 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f85b3-b2f0-425a-830f-dcab76e5cfae admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:36.835050 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f85b3-b2f0-425a-830f-dcab76e5cfae admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:36.835913 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f85b3-b2f0-425a-830f-dcab76e5cfae admin admin] RBAC: Adding query filter params (name=member) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:36.836223 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f85b3-b2f0-425a-830f-dcab76e5cfae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:36.837889 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f85b3-b2f0-425a-830f-dcab76e5cfae admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:36.848435 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 207/418] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:36.855092 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d3e71-cf6e-4c39-903f-5aacc0c4bd1c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:36.867885 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d3e71-cf6e-4c39-903f-5aacc0c4bd1c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:36.876116 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412124d-44fe-4949-bc6c-f077a5a828ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:36.876771 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412124d-44fe-4949-bc6c-f077a5a828ad admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:36.877055 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412124d-44fe-4949-bc6c-f077a5a828ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:36.877332 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412124d-44fe-4949-bc6c-f077a5a828ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:36.892072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412124d-44fe-4949-bc6c-f077a5a828ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:36.893840 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412124d-44fe-4949-bc6c-f077a5a828ad admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:36.907420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 212/419] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:36.913530 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f85b3-b2f0-425a-830f-dcab76e5cfae admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:36.924872 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f85b3-b2f0-425a-830f-dcab76e5cfae admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:36.931067 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef0063-17db-4e2e-b42c-d5434cbaac1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:36.932027 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef0063-17db-4e2e-b42c-d5434cbaac1c admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:36.932314 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef0063-17db-4e2e-b42c-d5434cbaac1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:36.932591 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef0063-17db-4e2e-b42c-d5434cbaac1c admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:36.933843 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef0063-17db-4e2e-b42c-d5434cbaac1c admin admin] RBAC: Authorizing `identity:get_project(project_id=ff1d62262d6348b39c63a74a5afe64bd)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:36.936200 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef0063-17db-4e2e-b42c-d5434cbaac1c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:36.938273 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 208/420] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:36 2022] GET /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:36.943450 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412124d-44fe-4949-bc6c-f077a5a828ad admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:36.953822 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412124d-44fe-4949-bc6c-f077a5a828ad admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:36.960149 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5b719-17ef-460a-bd60-27969d34752c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:36.961018 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5b719-17ef-460a-bd60-27969d34752c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:36.961350 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5b719-17ef-460a-bd60-27969d34752c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:36.961683 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5b719-17ef-460a-bd60-27969d34752c admin admin] PATH_INFO: `/v3/groups/10032563c1f745fe943b5899f986408b` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:36.964568 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5b719-17ef-460a-bd60-27969d34752c admin admin] RBAC: Authorizing `identity:get_group(group_id=10032563c1f745fe943b5899f986408b)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:36.966610 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5b719-17ef-460a-bd60-27969d34752c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:36.968817 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 213/421] 10.222.0.77 () {56 vars in 1201 bytes} [Thu Feb 10 23:03:36 2022] GET /identity/v3/groups/10032563c1f745fe943b5899f986408b => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:36.974346 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef0063-17db-4e2e-b42c-d5434cbaac1c admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:36.988011 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef0063-17db-4e2e-b42c-d5434cbaac1c admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:36.994777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81ffcf-257e-409d-9b34-42b879a63aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:36.995446 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81ffcf-257e-409d-9b34-42b879a63aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:36.995734 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81ffcf-257e-409d-9b34-42b879a63aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:36.996100 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81ffcf-257e-409d-9b34-42b879a63aa7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:36.996960 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81ffcf-257e-409d-9b34-42b879a63aa7 admin admin] RBAC: Adding query filter params (group.id=10032563c1f745fe943b5899f986408b, role.id=419ebcf5b1d8470394e463c9f01cb154, scope.project.id=ff1d62262d6348b39c63a74a5afe64bd) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:36.997317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81ffcf-257e-409d-9b34-42b879a63aa7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:36.999280 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81ffcf-257e-409d-9b34-42b879a63aa7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:37.008955 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 209/422] 10.222.0.77 () {56 vars in 1397 bytes} [Thu Feb 10 23:03:36 2022] GET /identity/v3/role_assignments?group.id=10032563c1f745fe943b5899f986408b&scope.project.id=ff1d62262d6348b39c63a74a5afe64bd&role.id=419ebcf5b1d8470394e463c9f01cb154 => generated 611 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:37.269956 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3523d-0fdb-40ec-bb69-c1f290416580 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:37.270383 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3523d-0fdb-40ec-bb69-c1f290416580 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:37.270566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3523d-0fdb-40ec-bb69-c1f290416580 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:37.272976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 214/423] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:37.281206 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faabde2-62dd-4099-91cb-c9f272b87a82 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:37.281206 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faabde2-62dd-4099-91cb-c9f272b87a82 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:37.281206 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faabde2-62dd-4099-91cb-c9f272b87a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:37.305089 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-0faabde2-62dd-4099-91cb-c9f272b87a82 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:37.306695 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-0faabde2-62dd-4099-91cb-c9f272b87a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:37.314765 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 210/424] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:37.339468 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3523d-0fdb-40ec-bb69-c1f290416580 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:37.352225 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3523d-0fdb-40ec-bb69-c1f290416580 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:37.359153 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc317c22-43f7-4895-b66a-c20c87e1c7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:37.360219 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc317c22-43f7-4895-b66a-c20c87e1c7dd admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:37.360968 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc317c22-43f7-4895-b66a-c20c87e1c7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:37.361445 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc317c22-43f7-4895-b66a-c20c87e1c7dd admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:37.375394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc317c22-43f7-4895-b66a-c20c87e1c7dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:37.383562 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-bc317c22-43f7-4895-b66a-c20c87e1c7dd admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 23:03:37.385373 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 215/425] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:03:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:37.390664 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faabde2-62dd-4099-91cb-c9f272b87a82 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:37.400735 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faabde2-62dd-4099-91cb-c9f272b87a82 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:37.405538 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae1b56-1bb5-433b-8ac5-8984905e2e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:37.406504 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae1b56-1bb5-433b-8ac5-8984905e2e27 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:37.407039 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae1b56-1bb5-433b-8ac5-8984905e2e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:37.407523 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae1b56-1bb5-433b-8ac5-8984905e2e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:37.408539 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae1b56-1bb5-433b-8ac5-8984905e2e27 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:37.409058 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae1b56-1bb5-433b-8ac5-8984905e2e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:37.410968 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae1b56-1bb5-433b-8ac5-8984905e2e27 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:37.422173 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 211/426] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:37.427546 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc317c22-43f7-4895-b66a-c20c87e1c7dd admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:37.438388 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc317c22-43f7-4895-b66a-c20c87e1c7dd admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:37.445413 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf3215-1b63-4dde-9731-ccbb244bbe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:37.446316 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf3215-1b63-4dde-9731-ccbb244bbe11 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:37.446918 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf3215-1b63-4dde-9731-ccbb244bbe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:37.447414 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf3215-1b63-4dde-9731-ccbb244bbe11 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:37.457129 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf3215-1b63-4dde-9731-ccbb244bbe11 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:37.459197 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf3215-1b63-4dde-9731-ccbb244bbe11 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:37.471880 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 216/427] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 23:03:37.474965 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae1b56-1bb5-433b-8ac5-8984905e2e27 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:37.486311 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae1b56-1bb5-433b-8ac5-8984905e2e27 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:37.493882 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e714e5-fbbf-4139-8006-5b9564be531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:37.495071 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e714e5-fbbf-4139-8006-5b9564be531f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:37.495629 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e714e5-fbbf-4139-8006-5b9564be531f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:37.496195 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e714e5-fbbf-4139-8006-5b9564be531f admin admin] PATH_INFO: `/v3/projects/ff1d62262d6348b39c63a74a5afe64bd` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:37.497646 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e714e5-fbbf-4139-8006-5b9564be531f admin admin] RBAC: Authorizing `identity:get_project(project_id=ff1d62262d6348b39c63a74a5afe64bd)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:37.499980 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e714e5-fbbf-4139-8006-5b9564be531f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:37.501911 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 212/428] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:37 2022] GET /identity/v3/projects/ff1d62262d6348b39c63a74a5afe64bd => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:37.508067 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf3215-1b63-4dde-9731-ccbb244bbe11 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:37.517456 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf3215-1b63-4dde-9731-ccbb244bbe11 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:37.523568 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2acde-9a9e-4030-b1c8-7c2f71d71190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:37.524821 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2acde-9a9e-4030-b1c8-7c2f71d71190 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:37.525407 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2acde-9a9e-4030-b1c8-7c2f71d71190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:37.525883 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2acde-9a9e-4030-b1c8-7c2f71d71190 admin admin] PATH_INFO: `/v3/groups/10032563c1f745fe943b5899f986408b` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:37.527431 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2acde-9a9e-4030-b1c8-7c2f71d71190 admin admin] RBAC: Authorizing `identity:get_group(group_id=10032563c1f745fe943b5899f986408b)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:37.529682 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2acde-9a9e-4030-b1c8-7c2f71d71190 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:37.531705 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 217/429] 10.222.0.77 () {56 vars in 1201 bytes} [Thu Feb 10 23:03:37 2022] GET /identity/v3/groups/10032563c1f745fe943b5899f986408b => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:37.538666 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e714e5-fbbf-4139-8006-5b9564be531f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:37.557273 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e714e5-fbbf-4139-8006-5b9564be531f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:37.563870 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ca77d-c674-483d-b5b7-052b9ab01ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:37.564538 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ca77d-c674-483d-b5b7-052b9ab01ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:37.564814 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ca77d-c674-483d-b5b7-052b9ab01ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:37.565089 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ca77d-c674-483d-b5b7-052b9ab01ec0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:37.565939 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ca77d-c674-483d-b5b7-052b9ab01ec0 admin admin] RBAC: Adding query filter params (group.id=10032563c1f745fe943b5899f986408b, role.id=7f727831e261404999a27a5a15b515b1, scope.project.id=ff1d62262d6348b39c63a74a5afe64bd) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:37.566254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ca77d-c674-483d-b5b7-052b9ab01ec0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:37.568174 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ca77d-c674-483d-b5b7-052b9ab01ec0 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:37.579281 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 213/430] 10.222.0.77 () {56 vars in 1397 bytes} [Thu Feb 10 23:03:37 2022] GET /identity/v3/role_assignments?group.id=10032563c1f745fe943b5899f986408b&scope.project.id=ff1d62262d6348b39c63a74a5afe64bd&role.id=7f727831e261404999a27a5a15b515b1 => generated 611 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:37.870122 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd405f7-9bc8-443f-ba2c-f498047d3e65 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:37.871141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd405f7-9bc8-443f-ba2c-f498047d3e65 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:37.871653 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd405f7-9bc8-443f-ba2c-f498047d3e65 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:37.873816 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 218/431] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:37.879380 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772138bc-114e-453a-b15c-60e9084abc83 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:37.880269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772138bc-114e-453a-b15c-60e9084abc83 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:37.880759 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772138bc-114e-453a-b15c-60e9084abc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:37.900707 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-772138bc-114e-453a-b15c-60e9084abc83 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:37.901888 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-772138bc-114e-453a-b15c-60e9084abc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:37.911350 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 214/432] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:37.937007 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd405f7-9bc8-443f-ba2c-f498047d3e65 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:37.952836 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd405f7-9bc8-443f-ba2c-f498047d3e65 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:37.957862 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0c05a-758e-483d-80f3-efe6c0bcb449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:37.958940 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0c05a-758e-483d-80f3-efe6c0bcb449 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:37.960031 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0c05a-758e-483d-80f3-efe6c0bcb449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:37.960734 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0c05a-758e-483d-80f3-efe6c0bcb449 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:37.973627 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0c05a-758e-483d-80f3-efe6c0bcb449 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:37.981138 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-65e0c05a-758e-483d-80f3-efe6c0bcb449 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 23:03:37.982672 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 219/433] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:37.988654 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772138bc-114e-453a-b15c-60e9084abc83 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:37.998511 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772138bc-114e-453a-b15c-60e9084abc83 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:38.005170 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d17234-0854-4aff-b46d-a5a2b149d898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:38.005921 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d17234-0854-4aff-b46d-a5a2b149d898 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:38.006439 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d17234-0854-4aff-b46d-a5a2b149d898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:38.006792 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d17234-0854-4aff-b46d-a5a2b149d898 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:38.007630 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d17234-0854-4aff-b46d-a5a2b149d898 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:38.008041 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d17234-0854-4aff-b46d-a5a2b149d898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:38.009811 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d17234-0854-4aff-b46d-a5a2b149d898 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:38.019321 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 215/434] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:03:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:38.025195 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0c05a-758e-483d-80f3-efe6c0bcb449 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:38.035239 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0c05a-758e-483d-80f3-efe6c0bcb449 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:38.040174 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824e00d-2095-4376-b41b-546f26d2f442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:38.041069 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824e00d-2095-4376-b41b-546f26d2f442 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:38.041553 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824e00d-2095-4376-b41b-546f26d2f442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:38.042035 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824e00d-2095-4376-b41b-546f26d2f442 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:38.050926 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824e00d-2095-4376-b41b-546f26d2f442 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:38.052918 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824e00d-2095-4376-b41b-546f26d2f442 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:38.063686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 220/435] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:38.070099 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d17234-0854-4aff-b46d-a5a2b149d898 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:38.081970 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d17234-0854-4aff-b46d-a5a2b149d898 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:38.087809 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a095ce1-1463-45e1-a965-e32b98be30ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:38.088777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a095ce1-1463-45e1-a965-e32b98be30ef admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:38.089060 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a095ce1-1463-45e1-a965-e32b98be30ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:38.089384 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a095ce1-1463-45e1-a965-e32b98be30ef admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:38.090725 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a095ce1-1463-45e1-a965-e32b98be30ef admin admin] RBAC: Authorizing `identity:get_project(project_id=d3485c2fbadb4400a6eacec1952e81f3)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:38.092862 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a095ce1-1463-45e1-a965-e32b98be30ef admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:38.094975 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 216/436] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:38 2022] GET /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:38.100676 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824e00d-2095-4376-b41b-546f26d2f442 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:38.111062 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824e00d-2095-4376-b41b-546f26d2f442 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:38.117988 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6bec4-019a-441c-a240-187c14286155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:38.118856 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6bec4-019a-441c-a240-187c14286155 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:38.119139 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6bec4-019a-441c-a240-187c14286155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:38.119411 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6bec4-019a-441c-a240-187c14286155 admin admin] PATH_INFO: `/v3/groups/10032563c1f745fe943b5899f986408b` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:38.120778 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6bec4-019a-441c-a240-187c14286155 admin admin] RBAC: Authorizing `identity:get_group(group_id=10032563c1f745fe943b5899f986408b)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:38.122595 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6bec4-019a-441c-a240-187c14286155 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:38.124524 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 221/437] 10.222.0.77 () {56 vars in 1201 bytes} [Thu Feb 10 23:03:38 2022] GET /identity/v3/groups/10032563c1f745fe943b5899f986408b => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:38.130194 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a095ce1-1463-45e1-a965-e32b98be30ef admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:38.140857 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a095ce1-1463-45e1-a965-e32b98be30ef admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:38.145267 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c236e-346c-44bf-b190-f0b57e631462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:38.145926 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c236e-346c-44bf-b190-f0b57e631462 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:38.146208 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c236e-346c-44bf-b190-f0b57e631462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:38.146491 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c236e-346c-44bf-b190-f0b57e631462 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:38.147428 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c236e-346c-44bf-b190-f0b57e631462 admin admin] RBAC: Adding query filter params (group.id=10032563c1f745fe943b5899f986408b, role.id=419ebcf5b1d8470394e463c9f01cb154, scope.project.id=d3485c2fbadb4400a6eacec1952e81f3) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:38.147754 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c236e-346c-44bf-b190-f0b57e631462 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:38.149636 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c236e-346c-44bf-b190-f0b57e631462 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:38.156468 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 217/438] 10.222.0.77 () {56 vars in 1397 bytes} [Thu Feb 10 23:03:38 2022] GET /identity/v3/role_assignments?group.id=10032563c1f745fe943b5899f986408b&scope.project.id=d3485c2fbadb4400a6eacec1952e81f3&role.id=419ebcf5b1d8470394e463c9f01cb154 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:38.378957 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a6f62-ba0c-4e24-9d11-28a817cd5dd3 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:38.379125 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a6f62-ba0c-4e24-9d11-28a817cd5dd3 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:38.379400 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a6f62-ba0c-4e24-9d11-28a817cd5dd3 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:38.382107 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 222/439] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:38.387661 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e0e8e-040a-47bd-9a8e-b1477bafd893 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:38.387984 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e0e8e-040a-47bd-9a8e-b1477bafd893 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:38.388268 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e0e8e-040a-47bd-9a8e-b1477bafd893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:38.408866 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-a06e0e8e-040a-47bd-9a8e-b1477bafd893 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:38.410033 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a06e0e8e-040a-47bd-9a8e-b1477bafd893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:38.418150 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 218/440] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:38.440931 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a6f62-ba0c-4e24-9d11-28a817cd5dd3 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:38.453750 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a6f62-ba0c-4e24-9d11-28a817cd5dd3 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:38.459041 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd04df-8b46-4d99-90d5-00d840d3ee68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:38.460849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd04df-8b46-4d99-90d5-00d840d3ee68 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:38.461128 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd04df-8b46-4d99-90d5-00d840d3ee68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:38.461395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd04df-8b46-4d99-90d5-00d840d3ee68 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:38.472228 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd04df-8b46-4d99-90d5-00d840d3ee68 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:38.479659 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-d7cd04df-8b46-4d99-90d5-00d840d3ee68 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 23:03:38.480881 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 223/441] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:03:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:38.486794 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e0e8e-040a-47bd-9a8e-b1477bafd893 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:38.495995 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e0e8e-040a-47bd-9a8e-b1477bafd893 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:38.500377 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d844f2-508a-4099-a671-c5a4c4ca2b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:38.501033 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d844f2-508a-4099-a671-c5a4c4ca2b8f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:38.501320 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d844f2-508a-4099-a671-c5a4c4ca2b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:38.501595 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d844f2-508a-4099-a671-c5a4c4ca2b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:38.503085 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d844f2-508a-4099-a671-c5a4c4ca2b8f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:38.503085 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d844f2-508a-4099-a671-c5a4c4ca2b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:38.504380 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d844f2-508a-4099-a671-c5a4c4ca2b8f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:38.513396 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 219/442] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:38.518821 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd04df-8b46-4d99-90d5-00d840d3ee68 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:38.529804 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd04df-8b46-4d99-90d5-00d840d3ee68 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:38.534244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bcf07-e1fe-45e8-b0df-ad75c4e99d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:38.534879 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bcf07-e1fe-45e8-b0df-ad75c4e99d68 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:38.535158 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bcf07-e1fe-45e8-b0df-ad75c4e99d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:38.535427 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bcf07-e1fe-45e8-b0df-ad75c4e99d68 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:38.545447 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bcf07-e1fe-45e8-b0df-ad75c4e99d68 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:38.547214 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bcf07-e1fe-45e8-b0df-ad75c4e99d68 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:38.558179 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 224/443] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:38.564115 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d844f2-508a-4099-a671-c5a4c4ca2b8f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:38.574693 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d844f2-508a-4099-a671-c5a4c4ca2b8f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:38.579210 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a5164-85a9-42ac-aeff-e58277100dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:38.580227 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a5164-85a9-42ac-aeff-e58277100dcd admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:38.580597 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a5164-85a9-42ac-aeff-e58277100dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:38.580961 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a5164-85a9-42ac-aeff-e58277100dcd admin admin] PATH_INFO: `/v3/projects/d3485c2fbadb4400a6eacec1952e81f3` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:38.582254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a5164-85a9-42ac-aeff-e58277100dcd admin admin] RBAC: Authorizing `identity:get_project(project_id=d3485c2fbadb4400a6eacec1952e81f3)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:38.585081 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a5164-85a9-42ac-aeff-e58277100dcd admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:38.587278 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 220/444] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:38 2022] GET /identity/v3/projects/d3485c2fbadb4400a6eacec1952e81f3 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:38.592600 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bcf07-e1fe-45e8-b0df-ad75c4e99d68 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:38.602288 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bcf07-e1fe-45e8-b0df-ad75c4e99d68 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:38.606744 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e22a8-debf-41fa-8301-cb5e9400549e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:38.607700 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e22a8-debf-41fa-8301-cb5e9400549e admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:38.608119 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e22a8-debf-41fa-8301-cb5e9400549e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:38.608489 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e22a8-debf-41fa-8301-cb5e9400549e admin admin] PATH_INFO: `/v3/groups/10032563c1f745fe943b5899f986408b` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:38.609758 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e22a8-debf-41fa-8301-cb5e9400549e admin admin] RBAC: Authorizing `identity:get_group(group_id=10032563c1f745fe943b5899f986408b)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:38.612039 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e22a8-debf-41fa-8301-cb5e9400549e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:38.613593 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 225/445] 10.222.0.77 () {56 vars in 1201 bytes} [Thu Feb 10 23:03:38 2022] GET /identity/v3/groups/10032563c1f745fe943b5899f986408b => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:38.620141 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a5164-85a9-42ac-aeff-e58277100dcd admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:38.630657 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a5164-85a9-42ac-aeff-e58277100dcd admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:38.635044 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79d80f-bdc6-42b4-8a50-69a5346fedba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:38.635772 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79d80f-bdc6-42b4-8a50-69a5346fedba admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:38.636196 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79d80f-bdc6-42b4-8a50-69a5346fedba admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:38.636567 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79d80f-bdc6-42b4-8a50-69a5346fedba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:38.637499 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79d80f-bdc6-42b4-8a50-69a5346fedba admin admin] RBAC: Adding query filter params (group.id=10032563c1f745fe943b5899f986408b, role.id=7f727831e261404999a27a5a15b515b1, scope.project.id=d3485c2fbadb4400a6eacec1952e81f3) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:38.637813 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79d80f-bdc6-42b4-8a50-69a5346fedba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:38.639638 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79d80f-bdc6-42b4-8a50-69a5346fedba admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:38.645865 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 221/446] 10.222.0.77 () {56 vars in 1397 bytes} [Thu Feb 10 23:03:38 2022] GET /identity/v3/role_assignments?group.id=10032563c1f745fe943b5899f986408b&scope.project.id=d3485c2fbadb4400a6eacec1952e81f3&role.id=7f727831e261404999a27a5a15b515b1 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:38.834899 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52661b41-f335-44f6-b946-3407ea2b8787 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:38.835179 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52661b41-f335-44f6-b946-3407ea2b8787 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:38.835463 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52661b41-f335-44f6-b946-3407ea2b8787 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:38.837320 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 226/447] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:38.842697 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea1e3b-b3ba-43db-9bdf-8ded3ea2d41e None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:38.842982 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea1e3b-b3ba-43db-9bdf-8ded3ea2d41e None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:38.843255 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea1e3b-b3ba-43db-9bdf-8ded3ea2d41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:38.862054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-acea1e3b-b3ba-43db-9bdf-8ded3ea2d41e None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:38.863203 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-acea1e3b-b3ba-43db-9bdf-8ded3ea2d41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:38.870699 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 222/448] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:38.894131 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52661b41-f335-44f6-b946-3407ea2b8787 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:38.907293 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52661b41-f335-44f6-b946-3407ea2b8787 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:38.911448 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edd84c-6951-47bb-991c-20fd299426fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:38.912239 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edd84c-6951-47bb-991c-20fd299426fd admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:38.913145 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edd84c-6951-47bb-991c-20fd299426fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:38.913452 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edd84c-6951-47bb-991c-20fd299426fd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:38.923715 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edd84c-6951-47bb-991c-20fd299426fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:38.931096 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-34edd84c-6951-47bb-991c-20fd299426fd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:03:38.932277 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 227/449] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:03:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:38.938163 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea1e3b-b3ba-43db-9bdf-8ded3ea2d41e None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:38.947900 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea1e3b-b3ba-43db-9bdf-8ded3ea2d41e None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:38.952478 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d8f1d-55f9-4af3-8400-580d372368c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:38.953137 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d8f1d-55f9-4af3-8400-580d372368c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:38.953422 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d8f1d-55f9-4af3-8400-580d372368c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:38.953705 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d8f1d-55f9-4af3-8400-580d372368c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:38.954466 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d8f1d-55f9-4af3-8400-580d372368c2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:38.954773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d8f1d-55f9-4af3-8400-580d372368c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:38.956487 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d8f1d-55f9-4af3-8400-580d372368c2 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:38.965085 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 223/450] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:38.970736 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edd84c-6951-47bb-991c-20fd299426fd admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:38.980443 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edd84c-6951-47bb-991c-20fd299426fd admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:38.984778 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072a7bd-e2a5-4fb7-a533-7c1109200160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:38.985405 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072a7bd-e2a5-4fb7-a533-7c1109200160 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:38.985688 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072a7bd-e2a5-4fb7-a533-7c1109200160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:38.986228 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072a7bd-e2a5-4fb7-a533-7c1109200160 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:38.995261 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072a7bd-e2a5-4fb7-a533-7c1109200160 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:38.997130 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072a7bd-e2a5-4fb7-a533-7c1109200160 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:39.005949 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 228/451] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 23:03:39.012095 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d8f1d-55f9-4af3-8400-580d372368c2 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:39.021631 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d8f1d-55f9-4af3-8400-580d372368c2 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:39.026267 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53bcde-1e03-4d95-99b7-b046e63165b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:39.027099 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53bcde-1e03-4d95-99b7-b046e63165b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:39.027383 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53bcde-1e03-4d95-99b7-b046e63165b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:39.027659 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53bcde-1e03-4d95-99b7-b046e63165b1 admin admin] PATH_INFO: `/v3/projects/6a8319582f7d4e2b90ad1c11263c01da` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:39.028859 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53bcde-1e03-4d95-99b7-b046e63165b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=6a8319582f7d4e2b90ad1c11263c01da)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:39.030645 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53bcde-1e03-4d95-99b7-b046e63165b1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:39.032289 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 224/452] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:03:39 2022] GET /identity/v3/projects/6a8319582f7d4e2b90ad1c11263c01da => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:39.037294 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072a7bd-e2a5-4fb7-a533-7c1109200160 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:39.045976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072a7bd-e2a5-4fb7-a533-7c1109200160 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:39.050278 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63f500-1d37-4ff4-bd06-73ad921cf214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:39.051086 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63f500-1d37-4ff4-bd06-73ad921cf214 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:39.051363 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63f500-1d37-4ff4-bd06-73ad921cf214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:39.051632 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63f500-1d37-4ff4-bd06-73ad921cf214 admin admin] PATH_INFO: `/v3/groups/9a43f2b7ec394c3ba052bc3050b7ef2a` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:39.052824 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63f500-1d37-4ff4-bd06-73ad921cf214 admin admin] RBAC: Authorizing `identity:get_group(group_id=9a43f2b7ec394c3ba052bc3050b7ef2a)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:39.055470 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63f500-1d37-4ff4-bd06-73ad921cf214 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:39.057138 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 229/453] 10.222.0.77 () {56 vars in 1201 bytes} [Thu Feb 10 23:03:39 2022] GET /identity/v3/groups/9a43f2b7ec394c3ba052bc3050b7ef2a => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:39.062241 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53bcde-1e03-4d95-99b7-b046e63165b1 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:39.072480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53bcde-1e03-4d95-99b7-b046e63165b1 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:39.076764 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfa941-13fa-450f-8469-353123c21f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:39.077385 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfa941-13fa-450f-8469-353123c21f55 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:39.077668 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfa941-13fa-450f-8469-353123c21f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:39.077944 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfa941-13fa-450f-8469-353123c21f55 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:39.078780 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfa941-13fa-450f-8469-353123c21f55 admin admin] RBAC: Adding query filter params (group.id=9a43f2b7ec394c3ba052bc3050b7ef2a, role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f, scope.project.id=6a8319582f7d4e2b90ad1c11263c01da) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:39.079084 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfa941-13fa-450f-8469-353123c21f55 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:39.080927 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfa941-13fa-450f-8469-353123c21f55 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:39.086862 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 225/454] 10.222.0.77 () {56 vars in 1397 bytes} [Thu Feb 10 23:03:39 2022] GET /identity/v3/role_assignments?group.id=9a43f2b7ec394c3ba052bc3050b7ef2a&scope.project.id=6a8319582f7d4e2b90ad1c11263c01da&role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:41.943947 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a6005-74bb-4ced-a868-cd7994a1593e None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:41.944611 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a6005-74bb-4ced-a868-cd7994a1593e None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:41.944611 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a6005-74bb-4ced-a868-cd7994a1593e None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:41.946883 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 230/455] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:41.952182 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c6388-a9e9-4a3b-ba4d-3f13d4a01d36 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:41.952620 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c6388-a9e9-4a3b-ba4d-3f13d4a01d36 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:41.952799 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c6388-a9e9-4a3b-ba4d-3f13d4a01d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:41.972791 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-5e2c6388-a9e9-4a3b-ba4d-3f13d4a01d36 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:41.974017 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-5e2c6388-a9e9-4a3b-ba4d-3f13d4a01d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:41.990058 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 226/456] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:42.005144 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b716547-8b86-42f0-b7cc-b9e2c7f0d60b None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:42.005424 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b716547-8b86-42f0-b7cc-b9e2c7f0d60b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:42.005693 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b716547-8b86-42f0-b7cc-b9e2c7f0d60b None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:42.008094 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 231/457] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:42.020272 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c6388-a9e9-4a3b-ba4d-3f13d4a01d36 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:42.029771 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c6388-a9e9-4a3b-ba4d-3f13d4a01d36 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:42.036410 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab61e1-2ee4-44c5-9536-047e015036b8 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:42.036696 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab61e1-2ee4-44c5-9536-047e015036b8 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:42.036973 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab61e1-2ee4-44c5-9536-047e015036b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:42.038274 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625fc32-53d3-41f4-8864-73ccf3c0dff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:42.039155 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625fc32-53d3-41f4-8864-73ccf3c0dff8 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:42.039440 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625fc32-53d3-41f4-8864-73ccf3c0dff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:42.039710 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625fc32-53d3-41f4-8864-73ccf3c0dff8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:42.050930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625fc32-53d3-41f4-8864-73ccf3c0dff8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:42.052782 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625fc32-53d3-41f4-8864-73ccf3c0dff8 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:42.072531 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-1bab61e1-2ee4-44c5-9536-047e015036b8 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:42.072824 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-2625fc32-53d3-41f4-8864-73ccf3c0dff8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:42.073725 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-1bab61e1-2ee4-44c5-9536-047e015036b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:42.073977 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 227/458] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:42.079998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6dea7-ea34-440a-9383-b6c4eb89d4be None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:42.080160 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6dea7-ea34-440a-9383-b6c4eb89d4be None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:42.080332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6dea7-ea34-440a-9383-b6c4eb89d4be None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:42.084380 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 228/459] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:42.084380 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6dea7-ea34-440a-9383-b6c4eb89d4be None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:42.091159 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 232/460] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:42.092598 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657d808-0f5f-440f-8234-0fbedf11fe69 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:42.092880 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657d808-0f5f-440f-8234-0fbedf11fe69 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:42.093157 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657d808-0f5f-440f-8234-0fbedf11fe69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:42.111394 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6dea7-ea34-440a-9383-b6c4eb89d4be None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:42.119237 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-a657d808-0f5f-440f-8234-0fbedf11fe69 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:42.119899 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1a0f3-7b2c-4481-877c-af48f0aa9edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:42.120479 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a657d808-0f5f-440f-8234-0fbedf11fe69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:42.120596 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1a0f3-7b2c-4481-877c-af48f0aa9edc admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:42.120817 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1a0f3-7b2c-4481-877c-af48f0aa9edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:42.121091 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1a0f3-7b2c-4481-877c-af48f0aa9edc admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:42.121924 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1a0f3-7b2c-4481-877c-af48f0aa9edc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:42.122334 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1a0f3-7b2c-4481-877c-af48f0aa9edc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:42.124463 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1a0f3-7b2c-4481-877c-af48f0aa9edc admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:42.128842 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 233/461] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:42.129615 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657d808-0f5f-440f-8234-0fbedf11fe69 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:42.138820 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657d808-0f5f-440f-8234-0fbedf11fe69 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:42.144629 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcf8b2-187b-4a94-bae4-13684d009907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:42.145392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcf8b2-187b-4a94-bae4-13684d009907 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:42.145648 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 229/462] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:42.145762 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcf8b2-187b-4a94-bae4-13684d009907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:42.145914 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcf8b2-187b-4a94-bae4-13684d009907 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:42.152083 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1a0f3-7b2c-4481-877c-af48f0aa9edc admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:42.162037 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcf8b2-187b-4a94-bae4-13684d009907 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:42.164547 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcf8b2-187b-4a94-bae4-13684d009907 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:42.167389 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1a0f3-7b2c-4481-877c-af48f0aa9edc admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:42.175283 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfd9fe-bc56-48ce-ae67-66ae753e2f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:42.175961 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfd9fe-bc56-48ce-ae67-66ae753e2f42 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:42.176245 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfd9fe-bc56-48ce-ae67-66ae753e2f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:42.176516 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfd9fe-bc56-48ce-ae67-66ae753e2f42 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:42.177237 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfd9fe-bc56-48ce-ae67-66ae753e2f42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:42.179720 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfd9fe-bc56-48ce-ae67-66ae753e2f42 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:42.182218 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-05dcf8b2-187b-4a94-bae4-13684d009907 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:42.183392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 234/463] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:42.187988 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcf8b2-187b-4a94-bae4-13684d009907 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:42.199305 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcf8b2-187b-4a94-bae4-13684d009907 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:42.203908 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacd402-72a4-4f9c-b104-2f9f93b07155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:42.204670 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacd402-72a4-4f9c-b104-2f9f93b07155 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:42.204855 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 230/464] 10.222.0.77 () {60 vars in 1153 bytes} [Thu Feb 10 23:03:42 2022] POST /identity/v3/users => generated 248 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:03:42.205055 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacd402-72a4-4f9c-b104-2f9f93b07155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:42.205335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacd402-72a4-4f9c-b104-2f9f93b07155 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:42.207960 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfd9fe-bc56-48ce-ae67-66ae753e2f42 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:42.221516 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacd402-72a4-4f9c-b104-2f9f93b07155 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:42.223499 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacd402-72a4-4f9c-b104-2f9f93b07155 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:42.227349 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfd9fe-bc56-48ce-ae67-66ae753e2f42 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:42.244780 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-dbacd402-72a4-4f9c-b104-2f9f93b07155 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:42.245742 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cb6f3-632a-40aa-af1a-3118faaa7ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:42.246686 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cb6f3-632a-40aa-af1a-3118faaa7ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:42.247172 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cb6f3-632a-40aa-af1a-3118faaa7ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:42.247649 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cb6f3-632a-40aa-af1a-3118faaa7ca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:42.248655 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cb6f3-632a-40aa-af1a-3118faaa7ca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:42.249213 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cb6f3-632a-40aa-af1a-3118faaa7ca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:42.251103 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cb6f3-632a-40aa-af1a-3118faaa7ca0 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:42.251221 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 235/465] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:42.252732 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacd402-72a4-4f9c-b104-2f9f93b07155 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:42.265391 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacd402-72a4-4f9c-b104-2f9f93b07155 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:42.275867 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea05f89-af1c-49c2-a36a-70984c3e0cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:42.276823 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea05f89-af1c-49c2-a36a-70984c3e0cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:42.277107 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea05f89-af1c-49c2-a36a-70984c3e0cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:42.278490 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea05f89-af1c-49c2-a36a-70984c3e0cf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:42.279593 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea05f89-af1c-49c2-a36a-70984c3e0cf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:42.280091 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea05f89-af1c-49c2-a36a-70984c3e0cf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:42.281167 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING py.warnings [None req-2ea05f89-af1c-49c2-a36a-70984c3e0cf5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:03:42.281167 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: warnings.warn(msg) Feb 10 23:03:42.281167 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: Feb 10 23:03:42.287995 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 231/466] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:42.289168 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea05f89-af1c-49c2-a36a-70984c3e0cf5 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:42.296105 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cb6f3-632a-40aa-af1a-3118faaa7ca0 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:42.311858 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cb6f3-632a-40aa-af1a-3118faaa7ca0 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:42.323467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243982f6-26a0-4ee2-9698-c7b396d489a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:42.324218 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243982f6-26a0-4ee2-9698-c7b396d489a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:42.324551 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243982f6-26a0-4ee2-9698-c7b396d489a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:42.324824 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243982f6-26a0-4ee2-9698-c7b396d489a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:42.325549 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243982f6-26a0-4ee2-9698-c7b396d489a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:42.327495 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243982f6-26a0-4ee2-9698-c7b396d489a1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:42.343517 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 236/467] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:42.346014 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea05f89-af1c-49c2-a36a-70984c3e0cf5 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:42.358034 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea05f89-af1c-49c2-a36a-70984c3e0cf5 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:42.363330 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48edb34-9df1-4b64-9d33-6ef807afb758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:42.364106 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48edb34-9df1-4b64-9d33-6ef807afb758 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:42.364392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48edb34-9df1-4b64-9d33-6ef807afb758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:42.364664 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48edb34-9df1-4b64-9d33-6ef807afb758 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:42.365613 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48edb34-9df1-4b64-9d33-6ef807afb758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:42.367807 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48edb34-9df1-4b64-9d33-6ef807afb758 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:42.382242 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 232/468] 10.222.0.77 () {60 vars in 1153 bytes} [Thu Feb 10 23:03:42 2022] POST /identity/v3/users => generated 246 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:03:42.411395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 237/469] 10.222.0.77 () {60 vars in 1153 bytes} [Thu Feb 10 23:03:42 2022] POST /identity/v3/users => generated 248 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:03:42.761552 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcb07f-12d5-43ea-b034-84cccc3fbbcf None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:42.762013 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcb07f-12d5-43ea-b034-84cccc3fbbcf None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:42.762283 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcb07f-12d5-43ea-b034-84cccc3fbbcf None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:42.764202 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 233/470] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:42.769752 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7ce01-7971-411b-8579-211e23cea589 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:42.770036 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7ce01-7971-411b-8579-211e23cea589 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:42.770314 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7ce01-7971-411b-8579-211e23cea589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:42.792103 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-c9e7ce01-7971-411b-8579-211e23cea589 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:42.793635 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-c9e7ce01-7971-411b-8579-211e23cea589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:42.806762 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 238/471] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:42.835781 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcb07f-12d5-43ea-b034-84cccc3fbbcf None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:42.848883 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcb07f-12d5-43ea-b034-84cccc3fbbcf None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:42.854790 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a33a10-9223-466d-86ae-0c69e9dc6849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:42.855974 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a33a10-9223-466d-86ae-0c69e9dc6849 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:42.856461 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a33a10-9223-466d-86ae-0c69e9dc6849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:42.856960 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a33a10-9223-466d-86ae-0c69e9dc6849 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:42.869912 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a33a10-9223-466d-86ae-0c69e9dc6849 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:42.872190 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a33a10-9223-466d-86ae-0c69e9dc6849 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:42.889843 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-03a33a10-9223-466d-86ae-0c69e9dc6849 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:42.891654 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 234/472] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:42.897946 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7ce01-7971-411b-8579-211e23cea589 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:42.911362 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7ce01-7971-411b-8579-211e23cea589 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:42.919313 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb72d28-f243-42a5-8238-956f5562c3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:42.920234 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72d28-f243-42a5-8238-956f5562c3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:42.920749 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72d28-f243-42a5-8238-956f5562c3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:42.921215 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72d28-f243-42a5-8238-956f5562c3f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:42.922147 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb72d28-f243-42a5-8238-956f5562c3f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:42.922664 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb72d28-f243-42a5-8238-956f5562c3f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:42.924562 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb72d28-f243-42a5-8238-956f5562c3f7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:42.941579 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 239/473] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:42.947658 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a33a10-9223-466d-86ae-0c69e9dc6849 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:42.958773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a33a10-9223-466d-86ae-0c69e9dc6849 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:42.966179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ee144-41bb-419a-b404-7635e9d4c994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:42.967100 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ee144-41bb-419a-b404-7635e9d4c994 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:42.967582 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ee144-41bb-419a-b404-7635e9d4c994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:42.968082 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ee144-41bb-419a-b404-7635e9d4c994 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:42.969002 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ee144-41bb-419a-b404-7635e9d4c994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:42.971111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ee144-41bb-419a-b404-7635e9d4c994 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:42.997630 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 235/474] 10.222.0.77 () {60 vars in 1153 bytes} [Thu Feb 10 23:03:42 2022] POST /identity/v3/users => generated 249 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:03:43.122545 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a07fb-372c-4273-9d85-67365ec40f9c None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:43.123054 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a07fb-372c-4273-9d85-67365ec40f9c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:43.123158 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a07fb-372c-4273-9d85-67365ec40f9c None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:43.125204 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 240/475] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:43.130832 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301c407-1458-4745-9601-a9e8077b2f8a None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:43.131178 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301c407-1458-4745-9601-a9e8077b2f8a None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:43.131550 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301c407-1458-4745-9601-a9e8077b2f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:43.156911 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-b301c407-1458-4745-9601-a9e8077b2f8a None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:43.158116 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-b301c407-1458-4745-9601-a9e8077b2f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:43.166910 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 236/476] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:43.190450 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a07fb-372c-4273-9d85-67365ec40f9c None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:43.202856 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a07fb-372c-4273-9d85-67365ec40f9c None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:43.207210 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe4a11-90f7-44c6-9c66-8b9dab9a688c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:43.207912 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe4a11-90f7-44c6-9c66-8b9dab9a688c admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:43.208197 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe4a11-90f7-44c6-9c66-8b9dab9a688c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:43.208471 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe4a11-90f7-44c6-9c66-8b9dab9a688c admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:43.209847 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe4a11-90f7-44c6-9c66-8b9dab9a688c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:43.211482 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe4a11-90f7-44c6-9c66-8b9dab9a688c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:43.219049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.sql.core [None req-a4fe4a11-90f7-44c6-9c66-8b9dab9a688c admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 10 23:03:43.219049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 10 23:03:43.219049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [parameters: {'id': 'ba1bc93629214e6b9a027be52a325594', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 10 23:03:43.219049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79313) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 10 23:03:43.235449 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-a4fe4a11-90f7-44c6-9c66-8b9dab9a688c admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 10 23:03:43.237527 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 241/477] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:03:43 2022] POST /identity/v3/roles => generated 144 bytes in 47 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:43.243683 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301c407-1458-4745-9601-a9e8077b2f8a None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:43.257609 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301c407-1458-4745-9601-a9e8077b2f8a None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:43.266870 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2f25e-2bf6-48ab-883b-14ad411c299c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:43.267698 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2f25e-2bf6-48ab-883b-14ad411c299c admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:43.268006 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2f25e-2bf6-48ab-883b-14ad411c299c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:43.268283 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2f25e-2bf6-48ab-883b-14ad411c299c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:43.285591 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2f25e-2bf6-48ab-883b-14ad411c299c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:43.294192 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-7cd2f25e-2bf6-48ab-883b-14ad411c299c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 23:03:43.295552 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 237/478] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:03:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:43.301508 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe4a11-90f7-44c6-9c66-8b9dab9a688c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:43.315246 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe4a11-90f7-44c6-9c66-8b9dab9a688c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:43.323906 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bef80-3262-4c9f-aede-4d80a1b05659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:43.324833 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bef80-3262-4c9f-aede-4d80a1b05659 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:43.325311 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bef80-3262-4c9f-aede-4d80a1b05659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:43.325782 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bef80-3262-4c9f-aede-4d80a1b05659 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:43.326755 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bef80-3262-4c9f-aede-4d80a1b05659 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:43.327235 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bef80-3262-4c9f-aede-4d80a1b05659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:43.329181 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bef80-3262-4c9f-aede-4d80a1b05659 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:43.339342 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 242/479] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:44.945456 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb415937-cdf3-4969-88b9-3d782c63ed00 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:44.945998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb415937-cdf3-4969-88b9-3d782c63ed00 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:44.945998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb415937-cdf3-4969-88b9-3d782c63ed00 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:44.948049 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 238/480] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:44.965520 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cfb63-932b-4c62-b164-cc7281efc6bd None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:44.966009 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cfb63-932b-4c62-b164-cc7281efc6bd None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:44.966095 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cfb63-932b-4c62-b164-cc7281efc6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:44.988946 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-170cfb63-932b-4c62-b164-cc7281efc6bd None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:44.990597 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-170cfb63-932b-4c62-b164-cc7281efc6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:45.001233 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 243/481] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:45.036796 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb415937-cdf3-4969-88b9-3d782c63ed00 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:45.054687 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb415937-cdf3-4969-88b9-3d782c63ed00 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:45.063855 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccbcc2-6e4c-4cc7-8521-910816ac9390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:45.064655 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccbcc2-6e4c-4cc7-8521-910816ac9390 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.064935 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccbcc2-6e4c-4cc7-8521-910816ac9390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.065207 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccbcc2-6e4c-4cc7-8521-910816ac9390 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.098207 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccbcc2-6e4c-4cc7-8521-910816ac9390 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:45.106118 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-55ccbcc2-6e4c-4cc7-8521-910816ac9390 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:03:45.111950 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 239/482] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:03:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:45.113207 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cfb63-932b-4c62-b164-cc7281efc6bd None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:45.132221 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cfb63-932b-4c62-b164-cc7281efc6bd None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:45.140413 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abc466-fd9d-4074-afdf-1b6c50f1b5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:45.141305 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abc466-fd9d-4074-afdf-1b6c50f1b5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.141796 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abc466-fd9d-4074-afdf-1b6c50f1b5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.142294 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abc466-fd9d-4074-afdf-1b6c50f1b5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.143265 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abc466-fd9d-4074-afdf-1b6c50f1b5c1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:45.143770 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abc466-fd9d-4074-afdf-1b6c50f1b5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:45.145603 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abc466-fd9d-4074-afdf-1b6c50f1b5c1 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:45.154479 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 244/483] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:03:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:45.159905 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccbcc2-6e4c-4cc7-8521-910816ac9390 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:45.176764 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccbcc2-6e4c-4cc7-8521-910816ac9390 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:45.183913 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01874cb3-635b-4762-92b6-0993a19184fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:45.184698 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01874cb3-635b-4762-92b6-0993a19184fc admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.184983 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01874cb3-635b-4762-92b6-0993a19184fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.185256 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01874cb3-635b-4762-92b6-0993a19184fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.199389 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01874cb3-635b-4762-92b6-0993a19184fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:45.201188 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01874cb3-635b-4762-92b6-0993a19184fc admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:45.225712 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-01874cb3-635b-4762-92b6-0993a19184fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:45.227203 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 240/484] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:45.232589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abc466-fd9d-4074-afdf-1b6c50f1b5c1 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:45.247844 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abc466-fd9d-4074-afdf-1b6c50f1b5c1 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:45.255498 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5035d6b-4104-414a-8b82-b5542807b848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:45.256632 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5035d6b-4104-414a-8b82-b5542807b848 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.257214 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5035d6b-4104-414a-8b82-b5542807b848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.257692 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5035d6b-4104-414a-8b82-b5542807b848 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.258644 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5035d6b-4104-414a-8b82-b5542807b848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:45.259242 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5035d6b-4104-414a-8b82-b5542807b848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:45.261056 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5035d6b-4104-414a-8b82-b5542807b848 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:45.282820 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 245/485] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:45.288476 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01874cb3-635b-4762-92b6-0993a19184fc admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:45.301084 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01874cb3-635b-4762-92b6-0993a19184fc admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:45.310792 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2a856-7eb1-45f1-8e9d-c6a3e80970d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:45.311583 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2a856-7eb1-45f1-8e9d-c6a3e80970d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.311885 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2a856-7eb1-45f1-8e9d-c6a3e80970d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.312164 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2a856-7eb1-45f1-8e9d-c6a3e80970d5 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.323149 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2a856-7eb1-45f1-8e9d-c6a3e80970d5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:45.326498 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2a856-7eb1-45f1-8e9d-c6a3e80970d5 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:45.347433 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-1fd2a856-7eb1-45f1-8e9d-c6a3e80970d5 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 10 23:03:45.348944 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 241/486] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:45.355197 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5035d6b-4104-414a-8b82-b5542807b848 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:45.371870 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5035d6b-4104-414a-8b82-b5542807b848 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:45.382342 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9ec85-c2f9-4be4-853d-41be980a4d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:45.383330 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9ec85-c2f9-4be4-853d-41be980a4d33 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.383902 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9ec85-c2f9-4be4-853d-41be980a4d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.384397 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9ec85-c2f9-4be4-853d-41be980a4d33 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.385459 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9ec85-c2f9-4be4-853d-41be980a4d33 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:45.385996 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9ec85-c2f9-4be4-853d-41be980a4d33 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:45.387218 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING py.warnings [None req-50d9ec85-c2f9-4be4-853d-41be980a4d33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:03:45.387218 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: warnings.warn(msg) Feb 10 23:03:45.387218 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: Feb 10 23:03:45.388726 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9ec85-c2f9-4be4-853d-41be980a4d33 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:45.449137 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 246/487] 10.222.0.77 () {56 vars in 1158 bytes} [Thu Feb 10 23:03:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:45.454538 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2a856-7eb1-45f1-8e9d-c6a3e80970d5 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:45.456625 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a3999-8c9d-4b77-856d-65ad5191b38a None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.457153 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a3999-8c9d-4b77-856d-65ad5191b38a None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.457661 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a3999-8c9d-4b77-856d-65ad5191b38a None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.460444 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 247/488] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:45.465674 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4952e5-eb3f-4b3e-a641-8a9de443a9c6 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.466193 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4952e5-eb3f-4b3e-a641-8a9de443a9c6 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.466690 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4952e5-eb3f-4b3e-a641-8a9de443a9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.475232 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2a856-7eb1-45f1-8e9d-c6a3e80970d5 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:45.486307 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-2e4952e5-eb3f-4b3e-a641-8a9de443a9c6 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:45.487741 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2e4952e5-eb3f-4b3e-a641-8a9de443a9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:45.492482 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeab07e-e084-4ed4-9890-70067b9d1acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:45.493136 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeab07e-e084-4ed4-9890-70067b9d1acc admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.493415 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeab07e-e084-4ed4-9890-70067b9d1acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.493697 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeab07e-e084-4ed4-9890-70067b9d1acc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.497539 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 248/489] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:45.510252 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeab07e-e084-4ed4-9890-70067b9d1acc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:45.512097 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeab07e-e084-4ed4-9890-70067b9d1acc admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:45.526399 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 242/490] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:45.532111 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4952e5-eb3f-4b3e-a641-8a9de443a9c6 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:45.545374 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeab07e-e084-4ed4-9890-70067b9d1acc admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:45.549011 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4952e5-eb3f-4b3e-a641-8a9de443a9c6 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:45.554707 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b3b44-80ff-4e76-8132-bf29910382f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:45.555775 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b3b44-80ff-4e76-8132-bf29910382f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.556296 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b3b44-80ff-4e76-8132-bf29910382f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.556768 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b3b44-80ff-4e76-8132-bf29910382f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.560799 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeab07e-e084-4ed4-9890-70067b9d1acc admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:45.568140 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b3b44-80ff-4e76-8132-bf29910382f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:45.571111 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b3b44-80ff-4e76-8132-bf29910382f0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:45.580510 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a539a-6e29-4bac-bafe-a9602decd139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:45.581309 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a539a-6e29-4bac-bafe-a9602decd139 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.581591 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a539a-6e29-4bac-bafe-a9602decd139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.581867 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a539a-6e29-4bac-bafe-a9602decd139 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.590026 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-3d6b3b44-80ff-4e76-8132-bf29910382f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:45.591747 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 249/491] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:45.599854 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b3b44-80ff-4e76-8132-bf29910382f0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:45.610700 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a539a-6e29-4bac-bafe-a9602decd139 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:45.621275 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b3b44-80ff-4e76-8132-bf29910382f0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:45.626363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-c65a539a-6e29-4bac-bafe-a9602decd139 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:03:45.628613 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bee8a-755c-4485-8230-8d3473492273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:45.630160 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 243/492] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:03:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:03:45.630271 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bee8a-755c-4485-8230-8d3473492273 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.630501 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bee8a-755c-4485-8230-8d3473492273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.630776 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bee8a-755c-4485-8230-8d3473492273 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.636383 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bee8a-755c-4485-8230-8d3473492273 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:45.636700 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bee8a-755c-4485-8230-8d3473492273 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:45.638420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bee8a-755c-4485-8230-8d3473492273 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:45.641636 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a539a-6e29-4bac-bafe-a9602decd139 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:45.656337 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a539a-6e29-4bac-bafe-a9602decd139 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:45.666628 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117633c-46f8-476d-af0f-f0f7e0606111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:45.667949 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 250/493] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:45.668064 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117633c-46f8-476d-af0f-f0f7e0606111 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.668327 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117633c-46f8-476d-af0f-f0f7e0606111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.668646 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117633c-46f8-476d-af0f-f0f7e0606111 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.669403 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117633c-46f8-476d-af0f-f0f7e0606111 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:45.669702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117633c-46f8-476d-af0f-f0f7e0606111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:45.675558 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117633c-46f8-476d-af0f-f0f7e0606111 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:45.677625 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bee8a-755c-4485-8230-8d3473492273 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:45.694468 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bee8a-755c-4485-8230-8d3473492273 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:45.696538 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 244/494] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:03:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:45.703026 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117633c-46f8-476d-af0f-f0f7e0606111 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:45.711294 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349a049-41d4-435f-ba85-e5865492c8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:45.712821 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349a049-41d4-435f-ba85-e5865492c8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.713101 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349a049-41d4-435f-ba85-e5865492c8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.713370 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349a049-41d4-435f-ba85-e5865492c8a6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.720348 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117633c-46f8-476d-af0f-f0f7e0606111 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:45.728591 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349a049-41d4-435f-ba85-e5865492c8a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:45.731662 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349a049-41d4-435f-ba85-e5865492c8a6 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:45.733642 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b781d-6077-406e-a1c5-a2970f77588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:45.735363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b781d-6077-406e-a1c5-a2970f77588f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.735643 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b781d-6077-406e-a1c5-a2970f77588f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.736828 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b781d-6077-406e-a1c5-a2970f77588f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.757922 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b781d-6077-406e-a1c5-a2970f77588f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:45.759829 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b781d-6077-406e-a1c5-a2970f77588f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:45.761972 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-e349a049-41d4-435f-ba85-e5865492c8a6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:03:45.763513 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 251/495] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:45.781430 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349a049-41d4-435f-ba85-e5865492c8a6 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:45.782927 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-8b2b781d-6077-406e-a1c5-a2970f77588f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:45.784412 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 245/496] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:45.790485 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b781d-6077-406e-a1c5-a2970f77588f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:45.804070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b781d-6077-406e-a1c5-a2970f77588f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:45.808742 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349a049-41d4-435f-ba85-e5865492c8a6 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:45.813504 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc3fc8-edb3-4fc9-9f60-e56858477edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:45.813942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd1e14-0cb8-4bd6-8990-01f67fffbe0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:45.814185 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc3fc8-edb3-4fc9-9f60-e56858477edb admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.814468 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc3fc8-edb3-4fc9-9f60-e56858477edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.814651 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd1e14-0cb8-4bd6-8990-01f67fffbe0c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.814805 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc3fc8-edb3-4fc9-9f60-e56858477edb admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.814948 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd1e14-0cb8-4bd6-8990-01f67fffbe0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.815176 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd1e14-0cb8-4bd6-8990-01f67fffbe0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.815468 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc3fc8-edb3-4fc9-9f60-e56858477edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:45.815772 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc3fc8-edb3-4fc9-9f60-e56858477edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:45.816057 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd1e14-0cb8-4bd6-8990-01f67fffbe0c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:45.816369 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd1e14-0cb8-4bd6-8990-01f67fffbe0c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:45.817455 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING py.warnings [None req-c5fd1e14-0cb8-4bd6-8990-01f67fffbe0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:03:45.817455 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: warnings.warn(msg) Feb 10 23:03:45.817455 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: Feb 10 23:03:45.817928 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc3fc8-edb3-4fc9-9f60-e56858477edb admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:45.819262 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd1e14-0cb8-4bd6-8990-01f67fffbe0c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:45.835757 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 246/497] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:45.837220 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2273fc5-28bd-4f94-bfb6-d1076eb42977 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.837824 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2273fc5-28bd-4f94-bfb6-d1076eb42977 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.837824 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2273fc5-28bd-4f94-bfb6-d1076eb42977 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.839755 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 247/498] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:45.840257 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 252/499] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:03:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:45.841778 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2273fc5-28bd-4f94-bfb6-d1076eb42977 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:45.845936 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd1e14-0cb8-4bd6-8990-01f67fffbe0c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:45.857306 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd1e14-0cb8-4bd6-8990-01f67fffbe0c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:45.859191 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2273fc5-28bd-4f94-bfb6-d1076eb42977 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:45.861997 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c77761-196e-421c-a866-67019b46e086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:45.862636 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c77761-196e-421c-a866-67019b46e086 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.862914 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c77761-196e-421c-a866-67019b46e086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.863182 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c77761-196e-421c-a866-67019b46e086 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.864048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c77761-196e-421c-a866-67019b46e086 admin admin] RBAC: Adding query filter params (role.id=9924d70543a845cdb7643026789244c3, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=d367d4b48c634351a427f2f1b468d4ca) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:45.864515 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c77761-196e-421c-a866-67019b46e086 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:45.864667 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09a93b-8ee0-4b58-819a-122b8eae5767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:45.866212 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09a93b-8ee0-4b58-819a-122b8eae5767 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.866763 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09a93b-8ee0-4b58-819a-122b8eae5767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.866960 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c77761-196e-421c-a866-67019b46e086 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:45.867204 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09a93b-8ee0-4b58-819a-122b8eae5767 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.873290 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 253/500] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:45 2022] GET /identity/v3/role_assignments?user.id=d367d4b48c634351a427f2f1b468d4ca&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=9924d70543a845cdb7643026789244c3 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:45.876182 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6487282-d5ae-4c0a-adbd-1c248ef4d410 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.876483 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6487282-d5ae-4c0a-adbd-1c248ef4d410 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.876764 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6487282-d5ae-4c0a-adbd-1c248ef4d410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.885007 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09a93b-8ee0-4b58-819a-122b8eae5767 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:45.887254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09a93b-8ee0-4b58-819a-122b8eae5767 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:45.903603 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-2b09a93b-8ee0-4b58-819a-122b8eae5767 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 10 23:03:45.905148 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 248/501] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:45.910805 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09a93b-8ee0-4b58-819a-122b8eae5767 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:45.914163 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-e6487282-d5ae-4c0a-adbd-1c248ef4d410 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:45.915384 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e6487282-d5ae-4c0a-adbd-1c248ef4d410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:45.922217 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09a93b-8ee0-4b58-819a-122b8eae5767 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:45.933306 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ceb98e-4ba1-4e62-a8cc-cccc1227d66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:45.934054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceb98e-4ba1-4e62-a8cc-cccc1227d66e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:45.934336 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceb98e-4ba1-4e62-a8cc-cccc1227d66e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:45.934609 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceb98e-4ba1-4e62-a8cc-cccc1227d66e admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:45.936199 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ceb98e-4ba1-4e62-a8cc-cccc1227d66e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:45.937262 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ceb98e-4ba1-4e62-a8cc-cccc1227d66e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:45.944068 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 254/502] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:45.944498 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING py.warnings [None req-e5ceb98e-4ba1-4e62-a8cc-cccc1227d66e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:03:45.944498 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: warnings.warn(msg) Feb 10 23:03:45.944498 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: Feb 10 23:03:45.946104 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ceb98e-4ba1-4e62-a8cc-cccc1227d66e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.000102 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 249/503] 10.222.0.77 () {56 vars in 1158 bytes} [Thu Feb 10 23:03:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:46.002275 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6487282-d5ae-4c0a-adbd-1c248ef4d410 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.013868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ceb98e-4ba1-4e62-a8cc-cccc1227d66e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.015502 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6487282-d5ae-4c0a-adbd-1c248ef4d410 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.020496 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71b9ca-3b97-4c72-9278-fc7302ff295b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.021163 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71b9ca-3b97-4c72-9278-fc7302ff295b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.021471 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71b9ca-3b97-4c72-9278-fc7302ff295b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.022291 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71b9ca-3b97-4c72-9278-fc7302ff295b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.029843 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ceb98e-4ba1-4e62-a8cc-cccc1227d66e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.032115 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71b9ca-3b97-4c72-9278-fc7302ff295b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.034011 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71b9ca-3b97-4c72-9278-fc7302ff295b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.044638 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694afce-2f26-47de-98da-81d3e4c18614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.045473 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694afce-2f26-47de-98da-81d3e4c18614 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.045755 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694afce-2f26-47de-98da-81d3e4c18614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.046031 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694afce-2f26-47de-98da-81d3e4c18614 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.050551 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 255/504] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:46.052000 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71b9ca-3b97-4c72-9278-fc7302ff295b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.062589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71b9ca-3b97-4c72-9278-fc7302ff295b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.068058 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae604b-4cf0-409c-addc-9e625da5c70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.069051 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae604b-4cf0-409c-addc-9e625da5c70c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.069547 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae604b-4cf0-409c-addc-9e625da5c70c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.069834 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae604b-4cf0-409c-addc-9e625da5c70c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.075031 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694afce-2f26-47de-98da-81d3e4c18614 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:46.083415 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-9694afce-2f26-47de-98da-81d3e4c18614 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:03:46.083673 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 250/505] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:46.089683 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694afce-2f26-47de-98da-81d3e4c18614 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.093248 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae604b-4cf0-409c-addc-9e625da5c70c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.095395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae604b-4cf0-409c-addc-9e625da5c70c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.103586 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694afce-2f26-47de-98da-81d3e4c18614 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.108669 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7998ba-56b2-42b7-b7ab-ab6b0bfc0cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.108851 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7998ba-56b2-42b7-b7ab-ab6b0bfc0cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.109231 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7998ba-56b2-42b7-b7ab-ab6b0bfc0cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.110620 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7998ba-56b2-42b7-b7ab-ab6b0bfc0cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.111711 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7998ba-56b2-42b7-b7ab-ab6b0bfc0cc5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:46.112109 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7998ba-56b2-42b7-b7ab-ab6b0bfc0cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.113781 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7998ba-56b2-42b7-b7ab-ab6b0bfc0cc5 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.118734 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-eaae604b-4cf0-409c-addc-9e625da5c70c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:46.120274 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 256/506] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:03:46.125565 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 251/507] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:46.126144 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae604b-4cf0-409c-addc-9e625da5c70c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.130679 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7998ba-56b2-42b7-b7ab-ab6b0bfc0cc5 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.141610 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae604b-4cf0-409c-addc-9e625da5c70c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.144138 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7998ba-56b2-42b7-b7ab-ab6b0bfc0cc5 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.149907 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f76d5-6a27-4fa6-91ea-c1358deae3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.150584 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22a60a-eeda-4422-992b-9715bdc6c7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.150803 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f76d5-6a27-4fa6-91ea-c1358deae3fc admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.151065 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f76d5-6a27-4fa6-91ea-c1358deae3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.151254 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22a60a-eeda-4422-992b-9715bdc6c7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.151349 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f76d5-6a27-4fa6-91ea-c1358deae3fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.151860 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22a60a-eeda-4422-992b-9715bdc6c7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.151860 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22a60a-eeda-4422-992b-9715bdc6c7e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.152759 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22a60a-eeda-4422-992b-9715bdc6c7e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:46.153070 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22a60a-eeda-4422-992b-9715bdc6c7e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.154682 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22a60a-eeda-4422-992b-9715bdc6c7e0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.163394 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f76d5-6a27-4fa6-91ea-c1358deae3fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.166090 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f76d5-6a27-4fa6-91ea-c1358deae3fc admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.167612 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 257/508] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:46.169043 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997bd72-7eeb-4656-9887-3b788d19a9f3 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.169333 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997bd72-7eeb-4656-9887-3b788d19a9f3 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.169611 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997bd72-7eeb-4656-9887-3b788d19a9f3 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.171458 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 258/509] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:46.176343 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997bd72-7eeb-4656-9887-3b788d19a9f3 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.189850 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997bd72-7eeb-4656-9887-3b788d19a9f3 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.192692 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-b96f76d5-6a27-4fa6-91ea-c1358deae3fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:46.194633 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515889fb-8bd5-4696-8a1f-3674b06f18e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.195077 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 252/510] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:46.195491 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515889fb-8bd5-4696-8a1f-3674b06f18e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.195781 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515889fb-8bd5-4696-8a1f-3674b06f18e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.196077 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515889fb-8bd5-4696-8a1f-3674b06f18e1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.197234 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728165e8-4306-47c9-b269-e59c6d984a4f None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.197717 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728165e8-4306-47c9-b269-e59c6d984a4f None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.198188 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728165e8-4306-47c9-b269-e59c6d984a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.204301 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515889fb-8bd5-4696-8a1f-3674b06f18e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.207483 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515889fb-8bd5-4696-8a1f-3674b06f18e1 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.217795 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-728165e8-4306-47c9-b269-e59c6d984a4f None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:46.219254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-728165e8-4306-47c9-b269-e59c6d984a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:46.226526 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-515889fb-8bd5-4696-8a1f-3674b06f18e1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:03:46.232449 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 259/511] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:46.232449 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515889fb-8bd5-4696-8a1f-3674b06f18e1 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.233170 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 253/512] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:46.234510 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728165e8-4306-47c9-b269-e59c6d984a4f None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.245717 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728165e8-4306-47c9-b269-e59c6d984a4f None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.248909 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515889fb-8bd5-4696-8a1f-3674b06f18e1 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.254014 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f687f-8ae2-42fa-b0b4-31cd9f27c17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.255227 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f687f-8ae2-42fa-b0b4-31cd9f27c17d admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.256382 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f687f-8ae2-42fa-b0b4-31cd9f27c17d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.257507 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f687f-8ae2-42fa-b0b4-31cd9f27c17d admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.258925 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f687f-8ae2-42fa-b0b4-31cd9f27c17d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:46.259762 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f687f-8ae2-42fa-b0b4-31cd9f27c17d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.261505 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING py.warnings [None req-708f687f-8ae2-42fa-b0b4-31cd9f27c17d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:03:46.261505 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: warnings.warn(msg) Feb 10 23:03:46.261505 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: Feb 10 23:03:46.262418 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3a256-477a-4fa6-a3ff-7737531e5d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.263297 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3a256-477a-4fa6-a3ff-7737531e5d90 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.264659 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f687f-8ae2-42fa-b0b4-31cd9f27c17d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.265164 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3a256-477a-4fa6-a3ff-7737531e5d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.265635 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3a256-477a-4fa6-a3ff-7737531e5d90 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.266572 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3a256-477a-4fa6-a3ff-7737531e5d90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:46.268282 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3a256-477a-4fa6-a3ff-7737531e5d90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.270255 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3a256-477a-4fa6-a3ff-7737531e5d90 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.284797 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 260/513] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:46.285641 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3a256-477a-4fa6-a3ff-7737531e5d90 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.287786 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 254/514] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:46.291056 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f687f-8ae2-42fa-b0b4-31cd9f27c17d admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.296258 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3a256-477a-4fa6-a3ff-7737531e5d90 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.300855 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f687f-8ae2-42fa-b0b4-31cd9f27c17d admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.301955 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a9b87-3b3d-42cc-98af-64120ef89ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.303449 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a9b87-3b3d-42cc-98af-64120ef89ede admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.303856 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a9b87-3b3d-42cc-98af-64120ef89ede admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.304288 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a9b87-3b3d-42cc-98af-64120ef89ede admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.306425 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66462d14-8a14-4277-96d5-eaafb0997505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.307358 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66462d14-8a14-4277-96d5-eaafb0997505 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.307797 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66462d14-8a14-4277-96d5-eaafb0997505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.308113 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66462d14-8a14-4277-96d5-eaafb0997505 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.315850 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66462d14-8a14-4277-96d5-eaafb0997505 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.317539 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a9b87-3b3d-42cc-98af-64120ef89ede admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:46.317879 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66462d14-8a14-4277-96d5-eaafb0997505 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.324564 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-7b7a9b87-3b3d-42cc-98af-64120ef89ede admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:03:46.325758 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 261/515] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:46.326521 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a9b87-3b3d-42cc-98af-64120ef89ede admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.332905 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-66462d14-8a14-4277-96d5-eaafb0997505 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 23:03:46.337277 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 255/516] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:46.337277 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845236f-2e3c-468b-a461-fc9d37228071 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.337277 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845236f-2e3c-468b-a461-fc9d37228071 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.337277 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845236f-2e3c-468b-a461-fc9d37228071 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.339241 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 256/517] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:46.339864 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845236f-2e3c-468b-a461-fc9d37228071 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.343392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a9b87-3b3d-42cc-98af-64120ef89ede admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.348335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6584a-32fb-4e3b-bd4d-ae675532dd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.349160 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6584a-32fb-4e3b-bd4d-ae675532dd15 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.349446 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6584a-32fb-4e3b-bd4d-ae675532dd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.350370 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6584a-32fb-4e3b-bd4d-ae675532dd15 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.351212 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6584a-32fb-4e3b-bd4d-ae675532dd15 admin admin] RBAC: Adding query filter params (role.id=9924d70543a845cdb7643026789244c3, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=d4899bdd65bb4cccae615cc5e8192388) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:46.351523 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6584a-32fb-4e3b-bd4d-ae675532dd15 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.352893 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845236f-2e3c-468b-a461-fc9d37228071 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.353390 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6584a-32fb-4e3b-bd4d-ae675532dd15 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.357149 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fa343-00d0-4ad6-92d2-25e2197c76c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.357786 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fa343-00d0-4ad6-92d2-25e2197c76c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.358065 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fa343-00d0-4ad6-92d2-25e2197c76c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.358337 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fa343-00d0-4ad6-92d2-25e2197c76c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.359210 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 262/518] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/role_assignments?user.id=d4899bdd65bb4cccae615cc5e8192388&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=9924d70543a845cdb7643026789244c3 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:46.359377 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fa343-00d0-4ad6-92d2-25e2197c76c7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:46.359566 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fa343-00d0-4ad6-92d2-25e2197c76c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.359812 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6584a-32fb-4e3b-bd4d-ae675532dd15 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.361480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fa343-00d0-4ad6-92d2-25e2197c76c7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.374696 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6584a-32fb-4e3b-bd4d-ae675532dd15 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.375174 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 257/519] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:46.376851 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96605a-cb97-414c-b58e-7b3166399eb6 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.377396 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96605a-cb97-414c-b58e-7b3166399eb6 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.377881 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96605a-cb97-414c-b58e-7b3166399eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.385287 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374a463-0dc1-45f2-960b-5bd589d7acc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.386404 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374a463-0dc1-45f2-960b-5bd589d7acc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.386701 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374a463-0dc1-45f2-960b-5bd589d7acc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.387040 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374a463-0dc1-45f2-960b-5bd589d7acc1 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.388566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374a463-0dc1-45f2-960b-5bd589d7acc1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:46.392214 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374a463-0dc1-45f2-960b-5bd589d7acc1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.395169 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374a463-0dc1-45f2-960b-5bd589d7acc1 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.400387 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-7f96605a-cb97-414c-b58e-7b3166399eb6 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:46.401742 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-7f96605a-cb97-414c-b58e-7b3166399eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:46.415754 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 258/520] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:46.416900 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96605a-cb97-414c-b58e-7b3166399eb6 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.417530 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 263/521] 10.222.0.77 () {56 vars in 1154 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:46.425142 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374a463-0dc1-45f2-960b-5bd589d7acc1 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.438208 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96605a-cb97-414c-b58e-7b3166399eb6 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.441454 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374a463-0dc1-45f2-960b-5bd589d7acc1 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.447217 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328d254-1803-4cb2-86ab-ce457af252fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.448069 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328d254-1803-4cb2-86ab-ce457af252fe admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.448355 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328d254-1803-4cb2-86ab-ce457af252fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.448634 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328d254-1803-4cb2-86ab-ce457af252fe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.452962 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119a40f-9a63-424b-b22c-180b913d4fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.454014 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119a40f-9a63-424b-b22c-180b913d4fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.454623 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119a40f-9a63-424b-b22c-180b913d4fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.455100 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119a40f-9a63-424b-b22c-180b913d4fc0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.460715 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328d254-1803-4cb2-86ab-ce457af252fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.463367 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328d254-1803-4cb2-86ab-ce457af252fe admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.465826 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119a40f-9a63-424b-b22c-180b913d4fc0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.467991 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119a40f-9a63-424b-b22c-180b913d4fc0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.483172 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-b328d254-1803-4cb2-86ab-ce457af252fe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:46.483777 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 264/522] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 23:03:46.484050 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 259/523] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:46.484835 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328d254-1803-4cb2-86ab-ce457af252fe admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.485478 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119a40f-9a63-424b-b22c-180b913d4fc0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.496996 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119a40f-9a63-424b-b22c-180b913d4fc0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.501302 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328d254-1803-4cb2-86ab-ce457af252fe admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.502430 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1069deb-81fe-4248-9af5-91bc62c3a283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.503803 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1069deb-81fe-4248-9af5-91bc62c3a283 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.504440 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1069deb-81fe-4248-9af5-91bc62c3a283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.505030 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1069deb-81fe-4248-9af5-91bc62c3a283 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.506697 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4917f-3619-4ae9-9d2e-478fd6e51f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.507759 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4917f-3619-4ae9-9d2e-478fd6e51f65 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.508170 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4917f-3619-4ae9-9d2e-478fd6e51f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.508547 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4917f-3619-4ae9-9d2e-478fd6e51f65 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.518867 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1069deb-81fe-4248-9af5-91bc62c3a283 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.521045 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1069deb-81fe-4248-9af5-91bc62c3a283 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.521878 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4917f-3619-4ae9-9d2e-478fd6e51f65 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.524046 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4917f-3619-4ae9-9d2e-478fd6e51f65 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.542359 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-c1069deb-81fe-4248-9af5-91bc62c3a283 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:46.543070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-30b4917f-3619-4ae9-9d2e-478fd6e51f65 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:46.543945 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 265/524] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:46.551899 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 260/525] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:46.552046 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1069deb-81fe-4248-9af5-91bc62c3a283 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.556836 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4917f-3619-4ae9-9d2e-478fd6e51f65 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.562777 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1069deb-81fe-4248-9af5-91bc62c3a283 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.567424 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1174a3-11d0-48d4-bf51-6fd989949f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.568250 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1174a3-11d0-48d4-bf51-6fd989949f68 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.569546 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1174a3-11d0-48d4-bf51-6fd989949f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.569985 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1174a3-11d0-48d4-bf51-6fd989949f68 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.570848 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1174a3-11d0-48d4-bf51-6fd989949f68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:46.571253 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1174a3-11d0-48d4-bf51-6fd989949f68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.571919 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4917f-3619-4ae9-9d2e-478fd6e51f65 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.573110 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1174a3-11d0-48d4-bf51-6fd989949f68 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.577555 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d2fbf-472c-4566-9c7f-a749eeef7b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.578367 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d2fbf-472c-4566-9c7f-a749eeef7b05 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.578792 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d2fbf-472c-4566-9c7f-a749eeef7b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.579230 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d2fbf-472c-4566-9c7f-a749eeef7b05 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.580127 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d2fbf-472c-4566-9c7f-a749eeef7b05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:46.580574 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d2fbf-472c-4566-9c7f-a749eeef7b05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.583216 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d2fbf-472c-4566-9c7f-a749eeef7b05 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.586380 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 266/526] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:46.591395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1174a3-11d0-48d4-bf51-6fd989949f68 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.596922 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 261/527] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:46.602347 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d2fbf-472c-4566-9c7f-a749eeef7b05 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.609566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1174a3-11d0-48d4-bf51-6fd989949f68 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.614424 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d2fbf-472c-4566-9c7f-a749eeef7b05 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.614990 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d90d95-ff5a-438c-b713-8b3e1cf6e8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.616368 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d90d95-ff5a-438c-b713-8b3e1cf6e8ef admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.616958 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d90d95-ff5a-438c-b713-8b3e1cf6e8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.617239 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d90d95-ff5a-438c-b713-8b3e1cf6e8ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.618080 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d90d95-ff5a-438c-b713-8b3e1cf6e8ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:46.618388 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d90d95-ff5a-438c-b713-8b3e1cf6e8ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.620107 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d90d95-ff5a-438c-b713-8b3e1cf6e8ef admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.621549 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89d5bd-dc04-46e5-82e1-5c2fe66b6c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.622625 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89d5bd-dc04-46e5-82e1-5c2fe66b6c2d admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.623172 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89d5bd-dc04-46e5-82e1-5c2fe66b6c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.623662 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89d5bd-dc04-46e5-82e1-5c2fe66b6c2d admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.632557 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89d5bd-dc04-46e5-82e1-5c2fe66b6c2d admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.634958 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89d5bd-dc04-46e5-82e1-5c2fe66b6c2d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.638229 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 267/528] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:46.639623 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d90d95-ff5a-438c-b713-8b3e1cf6e8ef admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.649830 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d90d95-ff5a-438c-b713-8b3e1cf6e8ef admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.652118 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-aa89d5bd-dc04-46e5-82e1-5c2fe66b6c2d admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 10 23:03:46.653850 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 262/529] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:46.654863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89d5bd-dc04-46e5-82e1-5c2fe66b6c2d admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.656515 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699de89-25b5-400b-9341-235bd3094a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.657419 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699de89-25b5-400b-9341-235bd3094a62 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.657959 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699de89-25b5-400b-9341-235bd3094a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.658840 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699de89-25b5-400b-9341-235bd3094a62 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.659701 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699de89-25b5-400b-9341-235bd3094a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.661745 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699de89-25b5-400b-9341-235bd3094a62 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.672815 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89d5bd-dc04-46e5-82e1-5c2fe66b6c2d admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.677640 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb39db-6a67-4f9c-8b74-15102a658c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.679232 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb39db-6a67-4f9c-8b74-15102a658c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.679417 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb39db-6a67-4f9c-8b74-15102a658c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.679785 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb39db-6a67-4f9c-8b74-15102a658c22 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.687964 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb39db-6a67-4f9c-8b74-15102a658c22 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.690026 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb39db-6a67-4f9c-8b74-15102a658c22 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.700184 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 268/530] 10.222.0.77 () {60 vars in 1153 bytes} [Thu Feb 10 23:03:46 2022] POST /identity/v3/users => generated 247 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:03:46.701208 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699de89-25b5-400b-9341-235bd3094a62 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.717635 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-2ffb39db-6a67-4f9c-8b74-15102a658c22 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:03:46.718494 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 263/531] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:46.722176 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699de89-25b5-400b-9341-235bd3094a62 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.725111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb39db-6a67-4f9c-8b74-15102a658c22 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.735294 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61f893-0045-44da-94bc-ec7692e2c223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.735649 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61f893-0045-44da-94bc-ec7692e2c223 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.737297 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61f893-0045-44da-94bc-ec7692e2c223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.737642 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61f893-0045-44da-94bc-ec7692e2c223 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.738795 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61f893-0045-44da-94bc-ec7692e2c223 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:46.740692 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61f893-0045-44da-94bc-ec7692e2c223 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.743530 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb39db-6a67-4f9c-8b74-15102a658c22 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.744434 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61f893-0045-44da-94bc-ec7692e2c223 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.753474 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22154c0-a146-4f08-84f2-906342d195eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.754982 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22154c0-a146-4f08-84f2-906342d195eb admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.755480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22154c0-a146-4f08-84f2-906342d195eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.757591 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22154c0-a146-4f08-84f2-906342d195eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.758488 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22154c0-a146-4f08-84f2-906342d195eb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:46.758807 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22154c0-a146-4f08-84f2-906342d195eb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.761852 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22154c0-a146-4f08-84f2-906342d195eb admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.784342 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 269/532] 10.222.0.77 () {56 vars in 1160 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:46.788360 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 264/533] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:46.790014 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61f893-0045-44da-94bc-ec7692e2c223 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.795746 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22154c0-a146-4f08-84f2-906342d195eb admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.808338 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61f893-0045-44da-94bc-ec7692e2c223 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.812532 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22154c0-a146-4f08-84f2-906342d195eb admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.815238 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5745fa1-fcc4-443d-922d-158d5782463c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.816110 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5745fa1-fcc4-443d-922d-158d5782463c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.816489 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5745fa1-fcc4-443d-922d-158d5782463c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.816886 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5745fa1-fcc4-443d-922d-158d5782463c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.825139 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e46445-d304-4a4a-93e4-6dfe0e126e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.826080 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e46445-d304-4a4a-93e4-6dfe0e126e13 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.826505 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e46445-d304-4a4a-93e4-6dfe0e126e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.826920 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e46445-d304-4a4a-93e4-6dfe0e126e13 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.827613 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5745fa1-fcc4-443d-922d-158d5782463c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.828147 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e46445-d304-4a4a-93e4-6dfe0e126e13 admin admin] RBAC: Adding query filter params (role.id=9924d70543a845cdb7643026789244c3, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=551da2c9fab74cb8b14287a5634adb25) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:46.828619 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e46445-d304-4a4a-93e4-6dfe0e126e13 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.829832 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5745fa1-fcc4-443d-922d-158d5782463c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.830788 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e46445-d304-4a4a-93e4-6dfe0e126e13 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.841070 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 270/534] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 23:03:46.845746 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 265/535] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/role_assignments?user.id=551da2c9fab74cb8b14287a5634adb25&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=9924d70543a845cdb7643026789244c3 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:46.846590 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5745fa1-fcc4-443d-922d-158d5782463c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.856939 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5745fa1-fcc4-443d-922d-158d5782463c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.862118 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b138fcb-4461-490d-90c6-1e2adb2572bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.862965 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b138fcb-4461-490d-90c6-1e2adb2572bc admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.863254 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b138fcb-4461-490d-90c6-1e2adb2572bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.863632 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b138fcb-4461-490d-90c6-1e2adb2572bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.883778 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b138fcb-4461-490d-90c6-1e2adb2572bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.885798 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b138fcb-4461-490d-90c6-1e2adb2572bc admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.908941 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-3b138fcb-4461-490d-90c6-1e2adb2572bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:46.910532 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 271/536] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:46.916951 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e46445-d304-4a4a-93e4-6dfe0e126e13 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.927728 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e46445-d304-4a4a-93e4-6dfe0e126e13 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.933260 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fc65d-ab06-4418-b6ee-0d11ce101d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.934044 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fc65d-ab06-4418-b6ee-0d11ce101d2b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.934337 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fc65d-ab06-4418-b6ee-0d11ce101d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.934616 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fc65d-ab06-4418-b6ee-0d11ce101d2b admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.935454 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fc65d-ab06-4418-b6ee-0d11ce101d2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:46.935765 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fc65d-ab06-4418-b6ee-0d11ce101d2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.937623 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fc65d-ab06-4418-b6ee-0d11ce101d2b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:46.951917 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 266/537] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:46.960923 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b138fcb-4461-490d-90c6-1e2adb2572bc admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:46.973105 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b138fcb-4461-490d-90c6-1e2adb2572bc admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:46.980063 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f7633-3e15-4d66-88a8-dbc8129b4485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:46.980931 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f7633-3e15-4d66-88a8-dbc8129b4485 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:46.981216 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f7633-3e15-4d66-88a8-dbc8129b4485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:46.981488 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f7633-3e15-4d66-88a8-dbc8129b4485 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:46.992668 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f7633-3e15-4d66-88a8-dbc8129b4485 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:46.994768 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f7633-3e15-4d66-88a8-dbc8129b4485 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:47.013560 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-0c9f7633-3e15-4d66-88a8-dbc8129b4485 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:03:47.020265 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 272/538] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:47.022375 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fc65d-ab06-4418-b6ee-0d11ce101d2b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:47.040177 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fc65d-ab06-4418-b6ee-0d11ce101d2b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:47.047173 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ae766-43be-4455-b7b9-f6052dd3b9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:47.047848 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ae766-43be-4455-b7b9-f6052dd3b9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:47.048148 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ae766-43be-4455-b7b9-f6052dd3b9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:47.048425 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ae766-43be-4455-b7b9-f6052dd3b9c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:47.049224 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ae766-43be-4455-b7b9-f6052dd3b9c7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:47.049532 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ae766-43be-4455-b7b9-f6052dd3b9c7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:47.051402 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ae766-43be-4455-b7b9-f6052dd3b9c7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:47.070239 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 267/539] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:03:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:47.078002 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f7633-3e15-4d66-88a8-dbc8129b4485 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:47.087137 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f7633-3e15-4d66-88a8-dbc8129b4485 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:47.094745 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4d32d-a33c-4991-a942-e5156fac706c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:47.095434 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4d32d-a33c-4991-a942-e5156fac706c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:47.095716 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4d32d-a33c-4991-a942-e5156fac706c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:47.096032 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4d32d-a33c-4991-a942-e5156fac706c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:47.096935 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4d32d-a33c-4991-a942-e5156fac706c admin admin] RBAC: Adding query filter params (role.id=9924d70543a845cdb7643026789244c3, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=0d2af52f48dc435ca9a48cc0a32c31e2) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:47.097242 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4d32d-a33c-4991-a942-e5156fac706c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:47.099186 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4d32d-a33c-4991-a942-e5156fac706c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:47.112319 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 273/540] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:47 2022] GET /identity/v3/role_assignments?user.id=0d2af52f48dc435ca9a48cc0a32c31e2&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=9924d70543a845cdb7643026789244c3 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:48.603726 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b31039-fb45-40e7-b4d6-227145ff8622 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:48.604301 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b31039-fb45-40e7-b4d6-227145ff8622 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:48.604375 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b31039-fb45-40e7-b4d6-227145ff8622 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:48.606477 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 268/541] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:48.612777 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b79bd8-9131-4743-88ba-1b437e8d475a None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:48.613709 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b79bd8-9131-4743-88ba-1b437e8d475a None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:48.614182 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b79bd8-9131-4743-88ba-1b437e8d475a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:48.640904 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-12b79bd8-9131-4743-88ba-1b437e8d475a None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:48.642458 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-12b79bd8-9131-4743-88ba-1b437e8d475a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:48.651776 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 274/542] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:48.691062 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b31039-fb45-40e7-b4d6-227145ff8622 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:48.710530 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b31039-fb45-40e7-b4d6-227145ff8622 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:48.716390 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8e931-0146-488c-9a9e-e08df62fb160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:48.717430 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8e931-0146-488c-9a9e-e08df62fb160 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:48.717908 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8e931-0146-488c-9a9e-e08df62fb160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:48.718393 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8e931-0146-488c-9a9e-e08df62fb160 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:48.735527 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8e931-0146-488c-9a9e-e08df62fb160 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:48.743771 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-1dd8e931-0146-488c-9a9e-e08df62fb160 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:03:48.745224 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 269/543] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:03:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:48.750874 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b79bd8-9131-4743-88ba-1b437e8d475a None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:48.764896 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b79bd8-9131-4743-88ba-1b437e8d475a None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:48.775440 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51298f01-1b0f-416c-816b-cec2fa91370a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:48.776387 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51298f01-1b0f-416c-816b-cec2fa91370a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:48.776890 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51298f01-1b0f-416c-816b-cec2fa91370a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:48.777381 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51298f01-1b0f-416c-816b-cec2fa91370a admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:48.778349 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51298f01-1b0f-416c-816b-cec2fa91370a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:48.778850 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51298f01-1b0f-416c-816b-cec2fa91370a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:48.780672 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51298f01-1b0f-416c-816b-cec2fa91370a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:48.795269 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 275/544] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:03:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:48.800640 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8e931-0146-488c-9a9e-e08df62fb160 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:48.811070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8e931-0146-488c-9a9e-e08df62fb160 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:48.821470 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43009d5a-d9f2-44a0-aa05-554906acf4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:48.822268 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43009d5a-d9f2-44a0-aa05-554906acf4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:48.822554 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43009d5a-d9f2-44a0-aa05-554906acf4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:48.822829 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43009d5a-d9f2-44a0-aa05-554906acf4b3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:48.843455 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43009d5a-d9f2-44a0-aa05-554906acf4b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:48.845326 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43009d5a-d9f2-44a0-aa05-554906acf4b3 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:48.875001 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-43009d5a-d9f2-44a0-aa05-554906acf4b3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:48.876450 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 270/545] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:48.882455 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51298f01-1b0f-416c-816b-cec2fa91370a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:48.901757 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51298f01-1b0f-416c-816b-cec2fa91370a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:48.909246 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f81000-3133-402b-9b1f-75961d10be91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:48.910161 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f81000-3133-402b-9b1f-75961d10be91 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:48.910665 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f81000-3133-402b-9b1f-75961d10be91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:48.911132 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f81000-3133-402b-9b1f-75961d10be91 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:48.912128 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f81000-3133-402b-9b1f-75961d10be91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:48.912927 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f81000-3133-402b-9b1f-75961d10be91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:48.914783 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f81000-3133-402b-9b1f-75961d10be91 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:48.933521 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 276/546] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:48.938815 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43009d5a-d9f2-44a0-aa05-554906acf4b3 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:48.952788 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43009d5a-d9f2-44a0-aa05-554906acf4b3 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:48.962865 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d0620-43d4-4c9e-aeea-d65f81b48c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:48.963659 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d0620-43d4-4c9e-aeea-d65f81b48c57 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:48.963972 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d0620-43d4-4c9e-aeea-d65f81b48c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:48.964248 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d0620-43d4-4c9e-aeea-d65f81b48c57 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:48.975759 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d0620-43d4-4c9e-aeea-d65f81b48c57 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:48.978108 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d0620-43d4-4c9e-aeea-d65f81b48c57 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:48.979454 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa81f68-c8f7-4e1e-bed0-073ee89ce098 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:48.980017 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa81f68-c8f7-4e1e-bed0-073ee89ce098 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:48.980497 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa81f68-c8f7-4e1e-bed0-073ee89ce098 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:48.982470 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 277/547] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:03:48.987574 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd0758-256c-4d42-acb8-8b142f33ea5a None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:48.987874 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd0758-256c-4d42-acb8-8b142f33ea5a None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:48.988153 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd0758-256c-4d42-acb8-8b142f33ea5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:48.997963 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-b03d0620-43d4-4c9e-aeea-d65f81b48c57 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 10 23:03:49.003934 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 271/548] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:49.008838 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d0620-43d4-4c9e-aeea-d65f81b48c57 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.026613 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-54bd0758-256c-4d42-acb8-8b142f33ea5a None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:49.027806 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-54bd0758-256c-4d42-acb8-8b142f33ea5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:49.031454 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d0620-43d4-4c9e-aeea-d65f81b48c57 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.040266 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c218c-e51c-4f69-b9c2-6d5629357b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.041514 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c218c-e51c-4f69-b9c2-6d5629357b50 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.041791 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c218c-e51c-4f69-b9c2-6d5629357b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.042499 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c218c-e51c-4f69-b9c2-6d5629357b50 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.045071 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c218c-e51c-4f69-b9c2-6d5629357b50 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:49.045395 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c218c-e51c-4f69-b9c2-6d5629357b50 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:49.046378 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 278/549] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:49.048036 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c218c-e51c-4f69-b9c2-6d5629357b50 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:49.067320 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 272/550] 10.222.0.77 () {56 vars in 1158 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:49.073041 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd0758-256c-4d42-acb8-8b142f33ea5a None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.085702 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd0758-256c-4d42-acb8-8b142f33ea5a None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.089507 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c218c-e51c-4f69-b9c2-6d5629357b50 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.101573 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec80cc-f397-451e-8637-d811a657bc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.102616 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec80cc-f397-451e-8637-d811a657bc24 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.103049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec80cc-f397-451e-8637-d811a657bc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.103469 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec80cc-f397-451e-8637-d811a657bc24 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.108916 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c218c-e51c-4f69-b9c2-6d5629357b50 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.121178 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82633fc9-f82b-4359-8a78-f68d59069405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.122214 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82633fc9-f82b-4359-8a78-f68d59069405 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.122641 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82633fc9-f82b-4359-8a78-f68d59069405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.123352 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82633fc9-f82b-4359-8a78-f68d59069405 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.124341 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec80cc-f397-451e-8637-d811a657bc24 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:49.129773 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec80cc-f397-451e-8637-d811a657bc24 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:49.145451 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82633fc9-f82b-4359-8a78-f68d59069405 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:49.161343 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-82633fc9-f82b-4359-8a78-f68d59069405 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:03:49.163545 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 273/551] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:49.169567 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-a2ec80cc-f397-451e-8637-d811a657bc24 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:49.171251 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 279/552] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:49.173066 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82633fc9-f82b-4359-8a78-f68d59069405 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.176373 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec80cc-f397-451e-8637-d811a657bc24 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.192323 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82633fc9-f82b-4359-8a78-f68d59069405 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.195347 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec80cc-f397-451e-8637-d811a657bc24 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.201849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4e286-9624-4ba3-a8c4-541e5b532efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.203137 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4e286-9624-4ba3-a8c4-541e5b532efc admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.203966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4e286-9624-4ba3-a8c4-541e5b532efc admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.205273 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13514d-417c-4b7e-93a1-12b2667cd811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.205648 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4e286-9624-4ba3-a8c4-541e5b532efc admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.206473 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13514d-417c-4b7e-93a1-12b2667cd811 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.207439 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4e286-9624-4ba3-a8c4-541e5b532efc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:49.207945 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13514d-417c-4b7e-93a1-12b2667cd811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.208427 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4e286-9624-4ba3-a8c4-541e5b532efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:49.209395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13514d-417c-4b7e-93a1-12b2667cd811 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.211941 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4e286-9624-4ba3-a8c4-541e5b532efc admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:49.212222 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13514d-417c-4b7e-93a1-12b2667cd811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:49.212694 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13514d-417c-4b7e-93a1-12b2667cd811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:49.216177 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13514d-417c-4b7e-93a1-12b2667cd811 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:49.232586 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 274/553] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:49.238968 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 280/554] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:49.244138 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4e286-9624-4ba3-a8c4-541e5b532efc admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.253895 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13514d-417c-4b7e-93a1-12b2667cd811 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.260461 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4e286-9624-4ba3-a8c4-541e5b532efc admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.273592 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bf080-cd2e-48f6-902f-ad5079f205bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.274547 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13514d-417c-4b7e-93a1-12b2667cd811 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.275135 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bf080-cd2e-48f6-902f-ad5079f205bf admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.276289 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bf080-cd2e-48f6-902f-ad5079f205bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.277124 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bf080-cd2e-48f6-902f-ad5079f205bf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.284927 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbafe31-3161-4449-a910-dbe408af7a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.287792 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbafe31-3161-4449-a910-dbe408af7a71 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.288675 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbafe31-3161-4449-a910-dbe408af7a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.289529 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbafe31-3161-4449-a910-dbe408af7a71 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.293695 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bf080-cd2e-48f6-902f-ad5079f205bf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:49.297178 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bf080-cd2e-48f6-902f-ad5079f205bf admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:49.318082 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbafe31-3161-4449-a910-dbe408af7a71 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:49.328633 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-6a0bf080-cd2e-48f6-902f-ad5079f205bf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:03:49.328789 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbafe31-3161-4449-a910-dbe408af7a71 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:49.330418 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 275/555] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:49.336472 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bf080-cd2e-48f6-902f-ad5079f205bf admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.354320 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bf080-cd2e-48f6-902f-ad5079f205bf admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.359400 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-3fbafe31-3161-4449-a910-dbe408af7a71 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:49.369306 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 281/556] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:49.373008 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e78c82-15de-4b6c-a946-ef6ede8f0e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.376223 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbafe31-3161-4449-a910-dbe408af7a71 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.376587 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e78c82-15de-4b6c-a946-ef6ede8f0e3c admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.377365 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e78c82-15de-4b6c-a946-ef6ede8f0e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.378832 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e78c82-15de-4b6c-a946-ef6ede8f0e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.382030 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e78c82-15de-4b6c-a946-ef6ede8f0e3c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:49.388466 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e78c82-15de-4b6c-a946-ef6ede8f0e3c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:49.390597 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e78c82-15de-4b6c-a946-ef6ede8f0e3c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:49.405568 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbafe31-3161-4449-a910-dbe408af7a71 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.410488 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 276/557] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:49.413690 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1d12d-3aa5-4552-a893-2a0e4a27d98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.414553 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1d12d-3aa5-4552-a893-2a0e4a27d98c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.414984 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1d12d-3aa5-4552-a893-2a0e4a27d98c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.415404 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1d12d-3aa5-4552-a893-2a0e4a27d98c admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.416420 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e78c82-15de-4b6c-a946-ef6ede8f0e3c admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.417672 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1d12d-3aa5-4552-a893-2a0e4a27d98c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:49.422615 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1d12d-3aa5-4552-a893-2a0e4a27d98c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:49.424420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1d12d-3aa5-4552-a893-2a0e4a27d98c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:49.437074 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e78c82-15de-4b6c-a946-ef6ede8f0e3c admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.445786 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 282/558] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:49.451226 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d1fb2-9efa-43de-aa85-f412ebca4b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.452350 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d1fb2-9efa-43de-aa85-f412ebca4b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.452782 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d1fb2-9efa-43de-aa85-f412ebca4b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.453206 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d1fb2-9efa-43de-aa85-f412ebca4b9d admin admin] PATH_INFO: `/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/d367d4b48c634351a427f2f1b468d4ca/roles/9924d70543a845cdb7643026789244c3` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.456811 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1d12d-3aa5-4552-a893-2a0e4a27d98c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.469613 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d1fb2-9efa-43de-aa85-f412ebca4b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ab195cc240497c9ac12843d738c4b9, user_id=d367d4b48c634351a427f2f1b468d4ca, role_id=9924d70543a845cdb7643026789244c3)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:49.471235 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1d12d-3aa5-4552-a893-2a0e4a27d98c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.472701 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d1fb2-9efa-43de-aa85-f412ebca4b9d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:49.488946 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 277/559] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:03:49 2022] PUT /identity/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/d367d4b48c634351a427f2f1b468d4ca/roles/9924d70543a845cdb7643026789244c3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:03:49.489413 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc9996-5659-4752-85dc-29e3c1fc59c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.490743 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc9996-5659-4752-85dc-29e3c1fc59c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.491019 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc9996-5659-4752-85dc-29e3c1fc59c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.491288 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc9996-5659-4752-85dc-29e3c1fc59c8 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.517374 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc9996-5659-4752-85dc-29e3c1fc59c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:49.519410 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc9996-5659-4752-85dc-29e3c1fc59c8 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:49.543596 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-ffcc9996-5659-4752-85dc-29e3c1fc59c8 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 10 23:03:49.545117 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 283/560] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:49.546642 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5a2c0-59e1-496d-a62f-512e4f5a5c8e None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.546937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5a2c0-59e1-496d-a62f-512e4f5a5c8e None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.547219 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5a2c0-59e1-496d-a62f-512e4f5a5c8e None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.549466 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 278/561] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:03:49.551216 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc9996-5659-4752-85dc-29e3c1fc59c8 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.556383 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d7bdc-ef20-44bc-8bbd-863724a83526 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.556672 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d7bdc-ef20-44bc-8bbd-863724a83526 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.556956 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d7bdc-ef20-44bc-8bbd-863724a83526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.575080 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc9996-5659-4752-85dc-29e3c1fc59c8 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.594969 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-532d7bdc-ef20-44bc-8bbd-863724a83526 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:49.597696 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-532d7bdc-ef20-44bc-8bbd-863724a83526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:49.666208 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2af1e-2e96-4bd7-8f0a-2b1acf492bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.666798 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2af1e-2e96-4bd7-8f0a-2b1acf492bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.667086 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2af1e-2e96-4bd7-8f0a-2b1acf492bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.667369 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2af1e-2e96-4bd7-8f0a-2b1acf492bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.668269 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2af1e-2e96-4bd7-8f0a-2b1acf492bd0 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:49.668582 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2af1e-2e96-4bd7-8f0a-2b1acf492bd0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:49.671468 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2af1e-2e96-4bd7-8f0a-2b1acf492bd0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:49.702218 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 284/562] 10.222.0.77 () {56 vars in 1158 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:49.707243 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643b500-0667-42ba-8108-3ccc16da2151 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.707544 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643b500-0667-42ba-8108-3ccc16da2151 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.707842 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643b500-0667-42ba-8108-3ccc16da2151 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.710189 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 285/563] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:03:49.711009 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643b500-0667-42ba-8108-3ccc16da2151 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.716922 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 279/564] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:49.718255 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5993e-3e38-4726-93a3-70c07d19eb91 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.718544 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5993e-3e38-4726-93a3-70c07d19eb91 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.718819 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5993e-3e38-4726-93a3-70c07d19eb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.726034 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643b500-0667-42ba-8108-3ccc16da2151 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.730943 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872d7d3-a1ec-44d8-9a8a-09a3074642df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.731746 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872d7d3-a1ec-44d8-9a8a-09a3074642df admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.732113 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872d7d3-a1ec-44d8-9a8a-09a3074642df admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.732390 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872d7d3-a1ec-44d8-9a8a-09a3074642df admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.739407 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-66a5993e-3e38-4726-93a3-70c07d19eb91 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:49.741296 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-66a5993e-3e38-4726-93a3-70c07d19eb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:49.746446 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872d7d3-a1ec-44d8-9a8a-09a3074642df admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:49.748638 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872d7d3-a1ec-44d8-9a8a-09a3074642df admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:49.749467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 280/565] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:49.750291 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5993e-3e38-4726-93a3-70c07d19eb91 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.760021 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5993e-3e38-4726-93a3-70c07d19eb91 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.764416 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ce977-f72f-4242-acfa-f5ed5746163a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.765250 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ce977-f72f-4242-acfa-f5ed5746163a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.765533 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ce977-f72f-4242-acfa-f5ed5746163a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.765807 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ce977-f72f-4242-acfa-f5ed5746163a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.769206 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-4872d7d3-a1ec-44d8-9a8a-09a3074642df admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:49.770822 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 286/566] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:49.777042 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872d7d3-a1ec-44d8-9a8a-09a3074642df admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.777267 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ce977-f72f-4242-acfa-f5ed5746163a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:49.783865 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-4b1ce977-f72f-4242-acfa-f5ed5746163a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:03:49.785342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 281/567] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:49.787459 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872d7d3-a1ec-44d8-9a8a-09a3074642df admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.792058 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ce977-f72f-4242-acfa-f5ed5746163a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.793192 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359035a-4d89-43f0-8828-30766c120efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.793854 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359035a-4d89-43f0-8828-30766c120efb admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.794140 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359035a-4d89-43f0-8828-30766c120efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.794417 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359035a-4d89-43f0-8828-30766c120efb admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.795164 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359035a-4d89-43f0-8828-30766c120efb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:49.795472 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359035a-4d89-43f0-8828-30766c120efb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:49.797086 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359035a-4d89-43f0-8828-30766c120efb admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:49.803970 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ce977-f72f-4242-acfa-f5ed5746163a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.809419 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd533147-219c-4d97-8b2e-f8e27ff9fdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.810319 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd533147-219c-4d97-8b2e-f8e27ff9fdac admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.810773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd533147-219c-4d97-8b2e-f8e27ff9fdac admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.810874 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 287/568] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:49.811312 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd533147-219c-4d97-8b2e-f8e27ff9fdac admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.811657 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359035a-4d89-43f0-8828-30766c120efb admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.812561 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd533147-219c-4d97-8b2e-f8e27ff9fdac admin admin] RBAC: Adding query filter params (name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:49.813033 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd533147-219c-4d97-8b2e-f8e27ff9fdac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:49.814923 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd533147-219c-4d97-8b2e-f8e27ff9fdac admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:49.822908 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359035a-4d89-43f0-8828-30766c120efb admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.826023 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 282/569] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:49.827011 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd533147-219c-4d97-8b2e-f8e27ff9fdac admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.827703 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d66ede-d173-4b7b-8ef6-0df9faa64251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.828640 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d66ede-d173-4b7b-8ef6-0df9faa64251 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.828924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d66ede-d173-4b7b-8ef6-0df9faa64251 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.829200 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d66ede-d173-4b7b-8ef6-0df9faa64251 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.838382 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd533147-219c-4d97-8b2e-f8e27ff9fdac admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.842120 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d66ede-d173-4b7b-8ef6-0df9faa64251 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:49.843340 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db29107-e876-446c-981f-3f2960746037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.844394 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db29107-e876-446c-981f-3f2960746037 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.844843 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db29107-e876-446c-981f-3f2960746037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.845364 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db29107-e876-446c-981f-3f2960746037 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.849916 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-f5d66ede-d173-4b7b-8ef6-0df9faa64251 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:03:49.851394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 288/570] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:49.856519 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d66ede-d173-4b7b-8ef6-0df9faa64251 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.858429 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db29107-e876-446c-981f-3f2960746037 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:49.860763 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db29107-e876-446c-981f-3f2960746037 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:49.866515 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d66ede-d173-4b7b-8ef6-0df9faa64251 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.877476 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-4db29107-e876-446c-981f-3f2960746037 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:03:49.879166 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 283/571] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:49.879787 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157573e-9805-4d65-9b81-0eedf2a5a1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.880450 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db29107-e876-446c-981f-3f2960746037 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.881740 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157573e-9805-4d65-9b81-0eedf2a5a1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.882026 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157573e-9805-4d65-9b81-0eedf2a5a1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.882304 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157573e-9805-4d65-9b81-0eedf2a5a1c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.891883 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db29107-e876-446c-981f-3f2960746037 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.895332 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157573e-9805-4d65-9b81-0eedf2a5a1c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:49.897827 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abdcd1-7b35-43b4-9a2f-ca2840c73d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.898323 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157573e-9805-4d65-9b81-0eedf2a5a1c0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:49.898965 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abdcd1-7b35-43b4-9a2f-ca2840c73d5a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.899438 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abdcd1-7b35-43b4-9a2f-ca2840c73d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.899958 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abdcd1-7b35-43b4-9a2f-ca2840c73d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.900984 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abdcd1-7b35-43b4-9a2f-ca2840c73d5a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:49.901496 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abdcd1-7b35-43b4-9a2f-ca2840c73d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:49.903374 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abdcd1-7b35-43b4-9a2f-ca2840c73d5a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:49.912201 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 284/572] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:49.917572 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-2157573e-9805-4d65-9b81-0eedf2a5a1c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:49.917829 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abdcd1-7b35-43b4-9a2f-ca2840c73d5a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.920027 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 289/573] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:49.920027 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157573e-9805-4d65-9b81-0eedf2a5a1c0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.931144 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157573e-9805-4d65-9b81-0eedf2a5a1c0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.933216 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abdcd1-7b35-43b4-9a2f-ca2840c73d5a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.936179 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc500f-211a-468e-a8cf-889de303c2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.937093 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc500f-211a-468e-a8cf-889de303c2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.937394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc500f-211a-468e-a8cf-889de303c2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.937741 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc500f-211a-468e-a8cf-889de303c2b4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.938870 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fda817-0d61-43b2-87f8-a2e91e0a93d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.939772 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fda817-0d61-43b2-87f8-a2e91e0a93d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.940297 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fda817-0d61-43b2-87f8-a2e91e0a93d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.940805 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fda817-0d61-43b2-87f8-a2e91e0a93d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.941885 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fda817-0d61-43b2-87f8-a2e91e0a93d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:49.942392 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fda817-0d61-43b2-87f8-a2e91e0a93d6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:49.945175 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fda817-0d61-43b2-87f8-a2e91e0a93d6 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:49.950261 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc500f-211a-468e-a8cf-889de303c2b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:49.952116 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc500f-211a-468e-a8cf-889de303c2b4 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:49.958428 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 285/574] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:49.959487 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fda817-0d61-43b2-87f8-a2e91e0a93d6 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.969022 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fda817-0d61-43b2-87f8-a2e91e0a93d6 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.973089 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-dbfc500f-211a-468e-a8cf-889de303c2b4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:49.974070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b6efb-ce6c-4a84-9228-fd7818d2ade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.978956 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 290/575] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:49.978956 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc500f-211a-468e-a8cf-889de303c2b4 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:49.979770 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b6efb-ce6c-4a84-9228-fd7818d2ade7 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.980422 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b6efb-ce6c-4a84-9228-fd7818d2ade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.980890 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b6efb-ce6c-4a84-9228-fd7818d2ade7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:49.981866 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b6efb-ce6c-4a84-9228-fd7818d2ade7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:49.982360 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b6efb-ce6c-4a84-9228-fd7818d2ade7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:49.984267 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b6efb-ce6c-4a84-9228-fd7818d2ade7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:49.985338 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc500f-211a-468e-a8cf-889de303c2b4 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:49.991174 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9c6bb-089c-4e9d-aa42-54df1483aa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:49.992078 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9c6bb-089c-4e9d-aa42-54df1483aa2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:49.992362 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9c6bb-089c-4e9d-aa42-54df1483aa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:49.992637 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9c6bb-089c-4e9d-aa42-54df1483aa2d admin admin] PATH_INFO: `/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/d4899bdd65bb4cccae615cc5e8192388/roles/9924d70543a845cdb7643026789244c3` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.000344 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 286/576] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:50.005543 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b6efb-ce6c-4a84-9228-fd7818d2ade7 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.010243 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9c6bb-089c-4e9d-aa42-54df1483aa2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ab195cc240497c9ac12843d738c4b9, user_id=d4899bdd65bb4cccae615cc5e8192388, role_id=9924d70543a845cdb7643026789244c3)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.013649 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9c6bb-089c-4e9d-aa42-54df1483aa2d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.016360 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b6efb-ce6c-4a84-9228-fd7818d2ade7 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.022081 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1c0c2-c58a-48cb-bf93-bf1039fd0d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.023142 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1c0c2-c58a-48cb-bf93-bf1039fd0d48 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.023614 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1c0c2-c58a-48cb-bf93-bf1039fd0d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.024134 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1c0c2-c58a-48cb-bf93-bf1039fd0d48 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.025157 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1c0c2-c58a-48cb-bf93-bf1039fd0d48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:50.025663 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1c0c2-c58a-48cb-bf93-bf1039fd0d48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.027593 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1c0c2-c58a-48cb-bf93-bf1039fd0d48 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.029075 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 291/577] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:03:49 2022] PUT /identity/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/d4899bdd65bb4cccae615cc5e8192388/roles/9924d70543a845cdb7643026789244c3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:03:50.030155 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9c6bb-089c-4e9d-aa42-54df1483aa2d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.044397 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 287/578] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:50.055208 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1c0c2-c58a-48cb-bf93-bf1039fd0d48 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.065974 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1c0c2-c58a-48cb-bf93-bf1039fd0d48 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.128082 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9c6bb-089c-4e9d-aa42-54df1483aa2d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.134153 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07ff5d-02c3-41ba-8da2-d4749ed71cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.134959 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07ff5d-02c3-41ba-8da2-d4749ed71cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.135249 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07ff5d-02c3-41ba-8da2-d4749ed71cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.135512 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07ff5d-02c3-41ba-8da2-d4749ed71cf4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.143869 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07ff5d-02c3-41ba-8da2-d4749ed71cf4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.146048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07ff5d-02c3-41ba-8da2-d4749ed71cf4 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.147790 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bce78-a384-4717-bf3f-99367b246245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.148839 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bce78-a384-4717-bf3f-99367b246245 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.149274 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bce78-a384-4717-bf3f-99367b246245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.149696 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bce78-a384-4717-bf3f-99367b246245 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.158045 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bce78-a384-4717-bf3f-99367b246245 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.160373 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bce78-a384-4717-bf3f-99367b246245 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.161852 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-ce07ff5d-02c3-41ba-8da2-d4749ed71cf4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 23:03:50.163976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 292/579] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 134 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:50.165448 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efcff6-6521-4414-a7a2-fe82eaaed910 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.165833 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efcff6-6521-4414-a7a2-fe82eaaed910 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.166229 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efcff6-6521-4414-a7a2-fe82eaaed910 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.169094 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 293/580] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:50.174883 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efcff6-6521-4414-a7a2-fe82eaaed910 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.179476 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-d33bce78-a384-4717-bf3f-99367b246245 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 10 23:03:50.181383 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 288/581] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 127 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:50.187290 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61375898-54ae-4b46-98f3-2184915e1497 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.188404 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61375898-54ae-4b46-98f3-2184915e1497 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.188836 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61375898-54ae-4b46-98f3-2184915e1497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.192364 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efcff6-6521-4414-a7a2-fe82eaaed910 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.198863 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3110a5-0cc6-4c09-8781-818a120d0864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.199847 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3110a5-0cc6-4c09-8781-818a120d0864 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.200306 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3110a5-0cc6-4c09-8781-818a120d0864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.200699 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3110a5-0cc6-4c09-8781-818a120d0864 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.202193 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3110a5-0cc6-4c09-8781-818a120d0864 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:50.202509 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3110a5-0cc6-4c09-8781-818a120d0864 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.204830 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3110a5-0cc6-4c09-8781-818a120d0864 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.211464 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-61375898-54ae-4b46-98f3-2184915e1497 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:50.212937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-61375898-54ae-4b46-98f3-2184915e1497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:50.221211 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 289/582] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:50.222370 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61375898-54ae-4b46-98f3-2184915e1497 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.233682 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 294/583] 10.222.0.77 () {56 vars in 1154 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:50.233906 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61375898-54ae-4b46-98f3-2184915e1497 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.239012 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465d9f1-1367-4b3f-835a-cd2cd1d50e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.239424 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3110a5-0cc6-4c09-8781-818a120d0864 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.240145 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465d9f1-1367-4b3f-835a-cd2cd1d50e69 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.240674 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465d9f1-1367-4b3f-835a-cd2cd1d50e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.241101 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465d9f1-1367-4b3f-835a-cd2cd1d50e69 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.242087 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465d9f1-1367-4b3f-835a-cd2cd1d50e69 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:50.242546 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465d9f1-1367-4b3f-835a-cd2cd1d50e69 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.244571 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465d9f1-1367-4b3f-835a-cd2cd1d50e69 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.251122 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3110a5-0cc6-4c09-8781-818a120d0864 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.256726 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c56df7-d415-4db3-8d53-1d6162bd044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.257116 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c56df7-d415-4db3-8d53-1d6162bd044a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.257488 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c56df7-d415-4db3-8d53-1d6162bd044a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.257851 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c56df7-d415-4db3-8d53-1d6162bd044a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.266035 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 290/584] 10.222.0.77 () {56 vars in 1156 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:50.267081 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465d9f1-1367-4b3f-835a-cd2cd1d50e69 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.269314 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c56df7-d415-4db3-8d53-1d6162bd044a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.272032 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c56df7-d415-4db3-8d53-1d6162bd044a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.277965 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465d9f1-1367-4b3f-835a-cd2cd1d50e69 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.282483 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982dcbcb-34fb-4f8d-a071-01e284521023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.283287 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982dcbcb-34fb-4f8d-a071-01e284521023 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.283571 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982dcbcb-34fb-4f8d-a071-01e284521023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.283923 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982dcbcb-34fb-4f8d-a071-01e284521023 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.292710 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-e6c56df7-d415-4db3-8d53-1d6162bd044a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:50.294189 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 295/585] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:03:50.295144 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c56df7-d415-4db3-8d53-1d6162bd044a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.300824 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982dcbcb-34fb-4f8d-a071-01e284521023 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:50.309981 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c56df7-d415-4db3-8d53-1d6162bd044a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.310298 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-982dcbcb-34fb-4f8d-a071-01e284521023 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:03:50.311522 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 291/586] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:50.315203 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f215a-1a40-490e-aee3-022fbb49abe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.316086 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f215a-1a40-490e-aee3-022fbb49abe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.316613 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f215a-1a40-490e-aee3-022fbb49abe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.316887 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982dcbcb-34fb-4f8d-a071-01e284521023 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.317326 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f215a-1a40-490e-aee3-022fbb49abe8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.326524 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f215a-1a40-490e-aee3-022fbb49abe8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.328541 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f215a-1a40-490e-aee3-022fbb49abe8 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.329190 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982dcbcb-34fb-4f8d-a071-01e284521023 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.335120 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b3a42-9f76-426a-ab0b-8494b869522c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.336042 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b3a42-9f76-426a-ab0b-8494b869522c admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.336328 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b3a42-9f76-426a-ab0b-8494b869522c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.336607 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b3a42-9f76-426a-ab0b-8494b869522c admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.337627 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b3a42-9f76-426a-ab0b-8494b869522c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:50.337922 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b3a42-9f76-426a-ab0b-8494b869522c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.339492 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b3a42-9f76-426a-ab0b-8494b869522c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.340509 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 296/587] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:50.341476 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f215a-1a40-490e-aee3-022fbb49abe8 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.351709 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f215a-1a40-490e-aee3-022fbb49abe8 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.354180 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 292/588] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:50.358967 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b3a42-9f76-426a-ab0b-8494b869522c admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.361401 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5bef6-33e4-4fa1-bc84-5c41d7dc5fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.362336 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5bef6-33e4-4fa1-bc84-5c41d7dc5fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.362837 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5bef6-33e4-4fa1-bc84-5c41d7dc5fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.363340 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5bef6-33e4-4fa1-bc84-5c41d7dc5fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.364392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5bef6-33e4-4fa1-bc84-5c41d7dc5fd3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:50.364805 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b3a42-9f76-426a-ab0b-8494b869522c admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.365755 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5bef6-33e4-4fa1-bc84-5c41d7dc5fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.367743 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5bef6-33e4-4fa1-bc84-5c41d7dc5fd3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.370463 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64e69f-05d8-4564-a953-68612434b752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.371658 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64e69f-05d8-4564-a953-68612434b752 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.372041 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64e69f-05d8-4564-a953-68612434b752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.372392 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64e69f-05d8-4564-a953-68612434b752 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.378290 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 297/589] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:50.379302 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5bef6-33e4-4fa1-bc84-5c41d7dc5fd3 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.389566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5bef6-33e4-4fa1-bc84-5c41d7dc5fd3 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.390259 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64e69f-05d8-4564-a953-68612434b752 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.392201 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64e69f-05d8-4564-a953-68612434b752 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.395110 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92c888-c302-4416-8115-892863cabc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.396250 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92c888-c302-4416-8115-892863cabc0a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.396775 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92c888-c302-4416-8115-892863cabc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.397222 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92c888-c302-4416-8115-892863cabc0a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.405348 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92c888-c302-4416-8115-892863cabc0a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.407542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92c888-c302-4416-8115-892863cabc0a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.411772 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-ca64e69f-05d8-4564-a953-68612434b752 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:50.414256 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 293/590] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:50.415184 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64e69f-05d8-4564-a953-68612434b752 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.423894 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-ce92c888-c302-4416-8115-892863cabc0a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:03:50.425331 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64e69f-05d8-4564-a953-68612434b752 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.425757 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 298/591] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:50.426715 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92c888-c302-4416-8115-892863cabc0a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.441087 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92c888-c302-4416-8115-892863cabc0a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.441817 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd60908-b5ce-4e4d-8df9-e5355dfb6f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.442968 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd60908-b5ce-4e4d-8df9-e5355dfb6f27 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.443623 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd60908-b5ce-4e4d-8df9-e5355dfb6f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.444197 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd60908-b5ce-4e4d-8df9-e5355dfb6f27 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.445926 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73103b77-c2c0-40c6-998a-abcd96bc109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.446567 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73103b77-c2c0-40c6-998a-abcd96bc109d admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.446849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73103b77-c2c0-40c6-998a-abcd96bc109d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.447123 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73103b77-c2c0-40c6-998a-abcd96bc109d admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.448105 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73103b77-c2c0-40c6-998a-abcd96bc109d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:50.448412 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73103b77-c2c0-40c6-998a-abcd96bc109d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.450365 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73103b77-c2c0-40c6-998a-abcd96bc109d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.457687 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd60908-b5ce-4e4d-8df9-e5355dfb6f27 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.461187 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd60908-b5ce-4e4d-8df9-e5355dfb6f27 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.465531 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 299/592] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:50.466337 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73103b77-c2c0-40c6-998a-abcd96bc109d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.478373 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73103b77-c2c0-40c6-998a-abcd96bc109d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.482409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-3cd60908-b5ce-4e4d-8df9-e5355dfb6f27 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:50.483153 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b917c-1b42-4489-a34d-7aa1fcb27ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.484099 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b917c-1b42-4489-a34d-7aa1fcb27ded admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.484230 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 294/593] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:50.484637 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b917c-1b42-4489-a34d-7aa1fcb27ded admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.485159 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd60908-b5ce-4e4d-8df9-e5355dfb6f27 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.485293 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b917c-1b42-4489-a34d-7aa1fcb27ded admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.486571 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b917c-1b42-4489-a34d-7aa1fcb27ded admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:50.487018 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b917c-1b42-4489-a34d-7aa1fcb27ded admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.489325 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b917c-1b42-4489-a34d-7aa1fcb27ded admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.497313 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd60908-b5ce-4e4d-8df9-e5355dfb6f27 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.502929 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b461f-6ba5-48b0-80c0-e361f9343c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.503909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b461f-6ba5-48b0-80c0-e361f9343c4f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.504292 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b461f-6ba5-48b0-80c0-e361f9343c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.504663 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b461f-6ba5-48b0-80c0-e361f9343c4f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.505958 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 300/594] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:50.507362 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b917c-1b42-4489-a34d-7aa1fcb27ded admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.516992 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b461f-6ba5-48b0-80c0-e361f9343c4f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.519926 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b461f-6ba5-48b0-80c0-e361f9343c4f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.521478 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b917c-1b42-4489-a34d-7aa1fcb27ded admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.527295 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35c3a0-e25a-4a1d-be91-b0377e86ad4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.528204 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35c3a0-e25a-4a1d-be91-b0377e86ad4b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.528715 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35c3a0-e25a-4a1d-be91-b0377e86ad4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.529133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35c3a0-e25a-4a1d-be91-b0377e86ad4b admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.530021 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35c3a0-e25a-4a1d-be91-b0377e86ad4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:50.530483 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35c3a0-e25a-4a1d-be91-b0377e86ad4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.532353 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35c3a0-e25a-4a1d-be91-b0377e86ad4b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.534197 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-f39b461f-6ba5-48b0-80c0-e361f9343c4f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:03:50.536218 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 295/595] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:50.537653 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b461f-6ba5-48b0-80c0-e361f9343c4f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.546887 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 301/596] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:50.548071 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35c3a0-e25a-4a1d-be91-b0377e86ad4b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.549264 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b461f-6ba5-48b0-80c0-e361f9343c4f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.554818 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1792fdf-addc-4ae6-b3dd-de25369f4c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.555802 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1792fdf-addc-4ae6-b3dd-de25369f4c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.556691 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1792fdf-addc-4ae6-b3dd-de25369f4c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.557089 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1792fdf-addc-4ae6-b3dd-de25369f4c84 admin admin] PATH_INFO: `/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/551da2c9fab74cb8b14287a5634adb25/roles/9924d70543a845cdb7643026789244c3` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.560132 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35c3a0-e25a-4a1d-be91-b0377e86ad4b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.568311 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b66f8-1132-4a22-8caf-5d77732f484b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.569668 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b66f8-1132-4a22-8caf-5d77732f484b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.570405 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b66f8-1132-4a22-8caf-5d77732f484b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.571136 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b66f8-1132-4a22-8caf-5d77732f484b admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.572156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b66f8-1132-4a22-8caf-5d77732f484b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:50.572741 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b66f8-1132-4a22-8caf-5d77732f484b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.573176 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1792fdf-addc-4ae6-b3dd-de25369f4c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ab195cc240497c9ac12843d738c4b9, user_id=551da2c9fab74cb8b14287a5634adb25, role_id=9924d70543a845cdb7643026789244c3)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.575068 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b66f8-1132-4a22-8caf-5d77732f484b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.576114 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1792fdf-addc-4ae6-b3dd-de25369f4c84 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.590023 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 302/597] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:50.591567 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b66f8-1132-4a22-8caf-5d77732f484b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.594717 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 296/598] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:03:50 2022] PUT /identity/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/551da2c9fab74cb8b14287a5634adb25/roles/9924d70543a845cdb7643026789244c3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:03:50.601136 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1792fdf-addc-4ae6-b3dd-de25369f4c84 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.607762 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b66f8-1132-4a22-8caf-5d77732f484b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.720913 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1792fdf-addc-4ae6-b3dd-de25369f4c84 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.729328 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eec9ad-c10e-4fe7-a0ed-5ede3bc91820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.730145 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eec9ad-c10e-4fe7-a0ed-5ede3bc91820 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.730425 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eec9ad-c10e-4fe7-a0ed-5ede3bc91820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.730692 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eec9ad-c10e-4fe7-a0ed-5ede3bc91820 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.733918 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51e5a7-e9c2-4bde-aada-54b37d8c0c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.734582 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51e5a7-e9c2-4bde-aada-54b37d8c0c70 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.734859 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51e5a7-e9c2-4bde-aada-54b37d8c0c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.735136 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51e5a7-e9c2-4bde-aada-54b37d8c0c70 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.741006 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51e5a7-e9c2-4bde-aada-54b37d8c0c70 admin admin] RBAC: Adding query filter params (role.id=9924d70543a845cdb7643026789244c3, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=ce55b64dc528447993e32b00ae4d3a2a) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:50.741419 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51e5a7-e9c2-4bde-aada-54b37d8c0c70 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.743342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51e5a7-e9c2-4bde-aada-54b37d8c0c70 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.749244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eec9ad-c10e-4fe7-a0ed-5ede3bc91820 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.751273 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eec9ad-c10e-4fe7-a0ed-5ede3bc91820 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.758374 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 297/599] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/role_assignments?user.id=ce55b64dc528447993e32b00ae4d3a2a&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=9924d70543a845cdb7643026789244c3 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:50.771934 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-17eec9ad-c10e-4fe7-a0ed-5ede3bc91820 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 10 23:03:50.774244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 303/600] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:50.779719 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51e5a7-e9c2-4bde-aada-54b37d8c0c70 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.795003 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51e5a7-e9c2-4bde-aada-54b37d8c0c70 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.798707 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10abe23-baac-4efc-b3b4-ada76e3e2740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.799392 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10abe23-baac-4efc-b3b4-ada76e3e2740 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.799672 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10abe23-baac-4efc-b3b4-ada76e3e2740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.800007 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10abe23-baac-4efc-b3b4-ada76e3e2740 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.800987 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10abe23-baac-4efc-b3b4-ada76e3e2740 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:50.801297 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10abe23-baac-4efc-b3b4-ada76e3e2740 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.804061 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10abe23-baac-4efc-b3b4-ada76e3e2740 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.833131 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 298/601] 10.222.0.77 () {56 vars in 1160 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:50.838430 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eec9ad-c10e-4fe7-a0ed-5ede3bc91820 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.848844 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eec9ad-c10e-4fe7-a0ed-5ede3bc91820 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.855346 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61947a5b-7471-4d51-833e-e857f3c557bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.856182 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61947a5b-7471-4d51-833e-e857f3c557bb admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.856459 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61947a5b-7471-4d51-833e-e857f3c557bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.856723 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61947a5b-7471-4d51-833e-e857f3c557bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.869287 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61947a5b-7471-4d51-833e-e857f3c557bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.871116 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61947a5b-7471-4d51-833e-e857f3c557bb admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.890465 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-61947a5b-7471-4d51-833e-e857f3c557bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:50.892055 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 304/602] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:50.898032 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10abe23-baac-4efc-b3b4-ada76e3e2740 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.914504 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10abe23-baac-4efc-b3b4-ada76e3e2740 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.919007 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ee815-bae6-4cf8-afe6-04de18b42ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.919676 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ee815-bae6-4cf8-afe6-04de18b42ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.919979 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ee815-bae6-4cf8-afe6-04de18b42ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.920254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ee815-bae6-4cf8-afe6-04de18b42ba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.920990 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ee815-bae6-4cf8-afe6-04de18b42ba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:50.921291 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ee815-bae6-4cf8-afe6-04de18b42ba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.922996 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ee815-bae6-4cf8-afe6-04de18b42ba7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:50.941792 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 299/603] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:50.947577 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61947a5b-7471-4d51-833e-e857f3c557bb admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:50.961935 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61947a5b-7471-4d51-833e-e857f3c557bb admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:50.972434 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60b1f7-2938-4af5-a1f7-23d6906e05a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:50.972434 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60b1f7-2938-4af5-a1f7-23d6906e05a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:50.972894 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60b1f7-2938-4af5-a1f7-23d6906e05a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:50.973300 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60b1f7-2938-4af5-a1f7-23d6906e05a0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:50.982633 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60b1f7-2938-4af5-a1f7-23d6906e05a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:50.984606 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60b1f7-2938-4af5-a1f7-23d6906e05a0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:51.000437 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-dd60b1f7-2938-4af5-a1f7-23d6906e05a0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:03:51.001909 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 305/604] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:51.007892 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ee815-bae6-4cf8-afe6-04de18b42ba7 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:51.022196 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ee815-bae6-4cf8-afe6-04de18b42ba7 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:51.037058 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260a840-7ac7-4d01-b8ed-52249628a95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:51.037735 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260a840-7ac7-4d01-b8ed-52249628a95a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:51.038019 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260a840-7ac7-4d01-b8ed-52249628a95a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:51.038299 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260a840-7ac7-4d01-b8ed-52249628a95a admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:51.039106 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260a840-7ac7-4d01-b8ed-52249628a95a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:51.039414 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260a840-7ac7-4d01-b8ed-52249628a95a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:51.041301 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260a840-7ac7-4d01-b8ed-52249628a95a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:51.066432 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 300/605] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:03:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:51.072696 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60b1f7-2938-4af5-a1f7-23d6906e05a0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:51.083307 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60b1f7-2938-4af5-a1f7-23d6906e05a0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:51.095903 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af713da-db0b-4c62-9bae-e2e65d00eea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:51.096857 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af713da-db0b-4c62-9bae-e2e65d00eea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:51.097200 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af713da-db0b-4c62-9bae-e2e65d00eea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:51.097533 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af713da-db0b-4c62-9bae-e2e65d00eea3 admin admin] PATH_INFO: `/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/0d2af52f48dc435ca9a48cc0a32c31e2/roles/9924d70543a845cdb7643026789244c3` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:51.119074 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af713da-db0b-4c62-9bae-e2e65d00eea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ab195cc240497c9ac12843d738c4b9, user_id=0d2af52f48dc435ca9a48cc0a32c31e2, role_id=9924d70543a845cdb7643026789244c3)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:51.121945 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af713da-db0b-4c62-9bae-e2e65d00eea3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:51.146158 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 306/606] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:03:51 2022] PUT /identity/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/0d2af52f48dc435ca9a48cc0a32c31e2/roles/9924d70543a845cdb7643026789244c3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:03:52.134572 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f088e-ae68-449d-a738-436b8a4db42c None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:52.135075 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f088e-ae68-449d-a738-436b8a4db42c None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:52.135150 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f088e-ae68-449d-a738-436b8a4db42c None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:52.137183 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 301/607] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:52.153686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca6157-6c21-4fbb-b0db-4773efda6caf None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:52.154176 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca6157-6c21-4fbb-b0db-4773efda6caf None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:52.154254 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca6157-6c21-4fbb-b0db-4773efda6caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:52.180827 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-f2ca6157-6c21-4fbb-b0db-4773efda6caf None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:52.182053 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-f2ca6157-6c21-4fbb-b0db-4773efda6caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:52.258384 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 307/608] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:52.305370 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f088e-ae68-449d-a738-436b8a4db42c None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:52.322997 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f088e-ae68-449d-a738-436b8a4db42c None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:52.333376 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee4372-876f-4082-b02b-44c3488acb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:52.334637 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee4372-876f-4082-b02b-44c3488acb69 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:52.334918 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee4372-876f-4082-b02b-44c3488acb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:52.335190 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee4372-876f-4082-b02b-44c3488acb69 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:52.348926 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee4372-876f-4082-b02b-44c3488acb69 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:52.356668 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-13ee4372-876f-4082-b02b-44c3488acb69 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:03:52.358227 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 302/609] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:03:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:52.364246 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca6157-6c21-4fbb-b0db-4773efda6caf None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:52.373291 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca6157-6c21-4fbb-b0db-4773efda6caf None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:52.384006 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489beec-ccc6-49c3-88bf-5aeab13f96ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:52.384670 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489beec-ccc6-49c3-88bf-5aeab13f96ae admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:52.384961 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489beec-ccc6-49c3-88bf-5aeab13f96ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:52.385237 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489beec-ccc6-49c3-88bf-5aeab13f96ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:52.386013 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489beec-ccc6-49c3-88bf-5aeab13f96ae admin admin] RBAC: Adding query filter params (name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:52.386324 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489beec-ccc6-49c3-88bf-5aeab13f96ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:52.387936 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489beec-ccc6-49c3-88bf-5aeab13f96ae admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:52.399783 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 308/610] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:03:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:52.405711 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee4372-876f-4082-b02b-44c3488acb69 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:52.418504 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee4372-876f-4082-b02b-44c3488acb69 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:52.423277 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b43ea-4579-4f33-bcc6-fdefee59d2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:52.424187 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b43ea-4579-4f33-bcc6-fdefee59d2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:52.424493 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b43ea-4579-4f33-bcc6-fdefee59d2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:52.424764 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b43ea-4579-4f33-bcc6-fdefee59d2e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:52.446053 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b43ea-4579-4f33-bcc6-fdefee59d2e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:52.447977 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b43ea-4579-4f33-bcc6-fdefee59d2e6 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:52.469516 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-7b4b43ea-4579-4f33-bcc6-fdefee59d2e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:52.471236 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 303/611] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:52.477495 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489beec-ccc6-49c3-88bf-5aeab13f96ae admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:52.496794 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489beec-ccc6-49c3-88bf-5aeab13f96ae admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:52.509437 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f39a3-ad2b-418f-9f85-ba01a5ba02b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:52.510108 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f39a3-ad2b-418f-9f85-ba01a5ba02b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:52.510395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f39a3-ad2b-418f-9f85-ba01a5ba02b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:52.510678 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f39a3-ad2b-418f-9f85-ba01a5ba02b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:52.511423 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f39a3-ad2b-418f-9f85-ba01a5ba02b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:52.511716 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f39a3-ad2b-418f-9f85-ba01a5ba02b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:52.513332 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f39a3-ad2b-418f-9f85-ba01a5ba02b3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:52.533162 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 309/612] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:52.538899 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b43ea-4579-4f33-bcc6-fdefee59d2e6 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:52.551957 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b43ea-4579-4f33-bcc6-fdefee59d2e6 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:52.559353 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a87e5-0dde-431c-bdc5-54303328ef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:52.560238 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a87e5-0dde-431c-bdc5-54303328ef5b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:52.560585 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a87e5-0dde-431c-bdc5-54303328ef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:52.560925 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a87e5-0dde-431c-bdc5-54303328ef5b admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:52.576943 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a87e5-0dde-431c-bdc5-54303328ef5b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:52.579047 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a87e5-0dde-431c-bdc5-54303328ef5b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:52.600178 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-845a87e5-0dde-431c-bdc5-54303328ef5b admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 10 23:03:52.601590 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 304/613] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:52.607241 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f39a3-ad2b-418f-9f85-ba01a5ba02b3 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:52.627020 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f39a3-ad2b-418f-9f85-ba01a5ba02b3 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:52.641014 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa444f36-f31f-4254-be20-bd821a92d096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:52.641672 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa444f36-f31f-4254-be20-bd821a92d096 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:52.641961 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa444f36-f31f-4254-be20-bd821a92d096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:52.642234 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa444f36-f31f-4254-be20-bd821a92d096 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:52.643095 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa444f36-f31f-4254-be20-bd821a92d096 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:52.643405 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa444f36-f31f-4254-be20-bd821a92d096 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:52.645254 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa444f36-f31f-4254-be20-bd821a92d096 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:52.675356 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 310/614] 10.222.0.77 () {56 vars in 1158 bytes} [Thu Feb 10 23:03:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:52.681099 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a87e5-0dde-431c-bdc5-54303328ef5b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:52.693060 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a87e5-0dde-431c-bdc5-54303328ef5b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:52.701046 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f3fe4-c6e1-4351-8cd4-716703fb2d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:52.701790 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f3fe4-c6e1-4351-8cd4-716703fb2d26 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:52.702113 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f3fe4-c6e1-4351-8cd4-716703fb2d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:52.702451 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f3fe4-c6e1-4351-8cd4-716703fb2d26 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:52.715436 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f3fe4-c6e1-4351-8cd4-716703fb2d26 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:52.717285 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f3fe4-c6e1-4351-8cd4-716703fb2d26 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:52.730123 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 305/615] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:52.731748 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f0aa8-0ef8-4e31-92ab-01374be360dd None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:52.732070 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f0aa8-0ef8-4e31-92ab-01374be360dd None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:52.732353 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f0aa8-0ef8-4e31-92ab-01374be360dd None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:52.734305 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 311/616] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:52.737050 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f3fe4-c6e1-4351-8cd4-716703fb2d26 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:52.739708 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441743e-839e-4c4d-923a-d3935786573e None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:52.740853 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441743e-839e-4c4d-923a-d3935786573e None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:52.741148 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441743e-839e-4c4d-923a-d3935786573e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:52.749325 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f3fe4-c6e1-4351-8cd4-716703fb2d26 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:52.761923 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddd6ca-c738-4d5f-853d-20759c27c9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:52.762807 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddd6ca-c738-4d5f-853d-20759c27c9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:52.763157 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddd6ca-c738-4d5f-853d-20759c27c9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:52.763498 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddd6ca-c738-4d5f-853d-20759c27c9c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:52.773544 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-9441743e-839e-4c4d-923a-d3935786573e None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:52.774629 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-9441743e-839e-4c4d-923a-d3935786573e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:52.781040 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddd6ca-c738-4d5f-853d-20759c27c9c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:52.786760 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddd6ca-c738-4d5f-853d-20759c27c9c0 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:52.790035 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 312/617] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:52.814945 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-9dddd6ca-c738-4d5f-853d-20759c27c9c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:52.819836 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 306/618] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:52.822111 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441743e-839e-4c4d-923a-d3935786573e None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:52.833832 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441743e-839e-4c4d-923a-d3935786573e None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:52.842207 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60af65-e0ae-4061-ad04-ca3b8cdca890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:52.842922 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60af65-e0ae-4061-ad04-ca3b8cdca890 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:52.843215 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60af65-e0ae-4061-ad04-ca3b8cdca890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:52.843490 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60af65-e0ae-4061-ad04-ca3b8cdca890 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:52.844319 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60af65-e0ae-4061-ad04-ca3b8cdca890 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:52.844626 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60af65-e0ae-4061-ad04-ca3b8cdca890 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:52.846252 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60af65-e0ae-4061-ad04-ca3b8cdca890 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:52.856721 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddd6ca-c738-4d5f-853d-20759c27c9c0 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:52.869543 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddd6ca-c738-4d5f-853d-20759c27c9c0 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:52.870161 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 313/619] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:52.874290 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac1d8c-5075-4fa3-9336-cd76a01e6e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:52.874985 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac1d8c-5075-4fa3-9336-cd76a01e6e73 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:52.875266 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac1d8c-5075-4fa3-9336-cd76a01e6e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:52.875403 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60af65-e0ae-4061-ad04-ca3b8cdca890 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:52.875603 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac1d8c-5075-4fa3-9336-cd76a01e6e73 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:52.887723 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac1d8c-5075-4fa3-9336-cd76a01e6e73 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:52.888926 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60af65-e0ae-4061-ad04-ca3b8cdca890 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:52.895145 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-aaac1d8c-5075-4fa3-9336-cd76a01e6e73 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:03:52.896828 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 307/620] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:03:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:52.898543 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150d2da-dde7-44c9-9c25-ed553a259dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:52.899336 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d2da-dde7-44c9-9c25-ed553a259dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:52.899619 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d2da-dde7-44c9-9c25-ed553a259dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:52.899926 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d2da-dde7-44c9-9c25-ed553a259dd0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:52.902487 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac1d8c-5075-4fa3-9336-cd76a01e6e73 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:52.915990 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac1d8c-5075-4fa3-9336-cd76a01e6e73 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:52.918954 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150d2da-dde7-44c9-9c25-ed553a259dd0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:52.921621 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150d2da-dde7-44c9-9c25-ed553a259dd0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:52.926902 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffce7e7-145a-43a7-b31e-f059b16ca9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:52.929121 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffce7e7-145a-43a7-b31e-f059b16ca9ea admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:52.929717 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffce7e7-145a-43a7-b31e-f059b16ca9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:52.931339 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffce7e7-145a-43a7-b31e-f059b16ca9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:52.932356 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffce7e7-145a-43a7-b31e-f059b16ca9ea admin admin] RBAC: Adding query filter params (name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:52.933552 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffce7e7-145a-43a7-b31e-f059b16ca9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:52.937468 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffce7e7-145a-43a7-b31e-f059b16ca9ea admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:52.951292 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-f150d2da-dde7-44c9-9c25-ed553a259dd0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:03:52.952965 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 314/621] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:52.954983 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 308/622] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:03:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:52.961134 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150d2da-dde7-44c9-9c25-ed553a259dd0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:52.961269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffce7e7-145a-43a7-b31e-f059b16ca9ea admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:52.971848 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffce7e7-145a-43a7-b31e-f059b16ca9ea admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:52.978691 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150d2da-dde7-44c9-9c25-ed553a259dd0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:52.981370 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fb051-a3d3-43ab-8386-9ada7be5c320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:52.982052 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fb051-a3d3-43ab-8386-9ada7be5c320 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:52.982827 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fb051-a3d3-43ab-8386-9ada7be5c320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:52.983117 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fb051-a3d3-43ab-8386-9ada7be5c320 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:52.984501 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fb051-a3d3-43ab-8386-9ada7be5c320 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:52.985426 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fb051-a3d3-43ab-8386-9ada7be5c320 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:52.990319 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97e576-5435-4e63-8822-61190a7f1466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:52.991136 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97e576-5435-4e63-8822-61190a7f1466 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:52.991470 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97e576-5435-4e63-8822-61190a7f1466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:52.991752 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97e576-5435-4e63-8822-61190a7f1466 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:52.991934 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fb051-a3d3-43ab-8386-9ada7be5c320 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.016635 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 309/623] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:03:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:53.017551 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97e576-5435-4e63-8822-61190a7f1466 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.019397 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97e576-5435-4e63-8822-61190a7f1466 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.028813 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fb051-a3d3-43ab-8386-9ada7be5c320 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.038929 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fb051-a3d3-43ab-8386-9ada7be5c320 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.040076 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-8b97e576-5435-4e63-8822-61190a7f1466 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:53.041701 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 315/624] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:53.051844 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97e576-5435-4e63-8822-61190a7f1466 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.053784 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802b898-f5f2-4352-be82-abc7a5d7ed06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.054493 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802b898-f5f2-4352-be82-abc7a5d7ed06 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.054779 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802b898-f5f2-4352-be82-abc7a5d7ed06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.055055 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802b898-f5f2-4352-be82-abc7a5d7ed06 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.057358 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802b898-f5f2-4352-be82-abc7a5d7ed06 admin admin] RBAC: Adding query filter params (role.id=9924d70543a845cdb7643026789244c3, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=d367d4b48c634351a427f2f1b468d4ca) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:53.059166 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802b898-f5f2-4352-be82-abc7a5d7ed06 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.062251 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802b898-f5f2-4352-be82-abc7a5d7ed06 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.067011 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97e576-5435-4e63-8822-61190a7f1466 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.075521 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 310/625] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/role_assignments?user.id=d367d4b48c634351a427f2f1b468d4ca&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=9924d70543a845cdb7643026789244c3 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:53.086971 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5512f-d2d0-4ae2-9c55-d25a86a269f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.086971 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5512f-d2d0-4ae2-9c55-d25a86a269f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.086971 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5512f-d2d0-4ae2-9c55-d25a86a269f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.086971 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5512f-d2d0-4ae2-9c55-d25a86a269f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.087326 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5512f-d2d0-4ae2-9c55-d25a86a269f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:53.087326 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5512f-d2d0-4ae2-9c55-d25a86a269f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.088396 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5512f-d2d0-4ae2-9c55-d25a86a269f6 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.109965 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 316/626] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:53.116073 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802b898-f5f2-4352-be82-abc7a5d7ed06 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.126737 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802b898-f5f2-4352-be82-abc7a5d7ed06 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.136487 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004596c7-fffb-49a4-bec2-c9d04f3f1b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.137356 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004596c7-fffb-49a4-bec2-c9d04f3f1b40 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.137738 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004596c7-fffb-49a4-bec2-c9d04f3f1b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.138019 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004596c7-fffb-49a4-bec2-c9d04f3f1b40 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.153213 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004596c7-fffb-49a4-bec2-c9d04f3f1b40 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.155372 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004596c7-fffb-49a4-bec2-c9d04f3f1b40 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.175576 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-004596c7-fffb-49a4-bec2-c9d04f3f1b40 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 10 23:03:53.177047 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 311/627] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:53.184975 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5512f-d2d0-4ae2-9c55-d25a86a269f6 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.199096 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5512f-d2d0-4ae2-9c55-d25a86a269f6 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.205525 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348d1b9-5a44-473e-84a6-a0c5d5f89957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.206272 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348d1b9-5a44-473e-84a6-a0c5d5f89957 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.206559 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348d1b9-5a44-473e-84a6-a0c5d5f89957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.206837 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348d1b9-5a44-473e-84a6-a0c5d5f89957 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.207764 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348d1b9-5a44-473e-84a6-a0c5d5f89957 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:53.208157 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348d1b9-5a44-473e-84a6-a0c5d5f89957 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.210333 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348d1b9-5a44-473e-84a6-a0c5d5f89957 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.237286 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 317/628] 10.222.0.77 () {56 vars in 1158 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:53.243804 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004596c7-fffb-49a4-bec2-c9d04f3f1b40 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.254756 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004596c7-fffb-49a4-bec2-c9d04f3f1b40 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.264737 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea31a7-6bbc-45c6-a10e-15a0182b97e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.265463 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea31a7-6bbc-45c6-a10e-15a0182b97e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.265752 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea31a7-6bbc-45c6-a10e-15a0182b97e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.267243 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea31a7-6bbc-45c6-a10e-15a0182b97e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.276118 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea31a7-6bbc-45c6-a10e-15a0182b97e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.278080 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea31a7-6bbc-45c6-a10e-15a0182b97e0 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.288756 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 312/629] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:53.294291 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348d1b9-5a44-473e-84a6-a0c5d5f89957 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.305154 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348d1b9-5a44-473e-84a6-a0c5d5f89957 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.309887 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b23470-341d-478e-ae5a-b73288639a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.310669 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b23470-341d-478e-ae5a-b73288639a58 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.310955 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b23470-341d-478e-ae5a-b73288639a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.311286 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b23470-341d-478e-ae5a-b73288639a58 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.323052 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b23470-341d-478e-ae5a-b73288639a58 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.325052 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b23470-341d-478e-ae5a-b73288639a58 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.342814 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-67b23470-341d-478e-ae5a-b73288639a58 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:53.347940 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 318/630] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:53.350517 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea31a7-6bbc-45c6-a10e-15a0182b97e0 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.363149 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea31a7-6bbc-45c6-a10e-15a0182b97e0 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.371399 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fc4cd-f485-417a-b94e-cc4cedfba275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.372330 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fc4cd-f485-417a-b94e-cc4cedfba275 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.372845 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fc4cd-f485-417a-b94e-cc4cedfba275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.373130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fc4cd-f485-417a-b94e-cc4cedfba275 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.373876 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fc4cd-f485-417a-b94e-cc4cedfba275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:53.374183 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fc4cd-f485-417a-b94e-cc4cedfba275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.375854 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fc4cd-f485-417a-b94e-cc4cedfba275 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.388750 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 313/631] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:53.394168 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b23470-341d-478e-ae5a-b73288639a58 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.404763 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b23470-341d-478e-ae5a-b73288639a58 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.409489 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f2ef4-583f-4682-8dbe-f02d6a15f9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.410266 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f2ef4-583f-4682-8dbe-f02d6a15f9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.410604 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f2ef4-583f-4682-8dbe-f02d6a15f9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.410882 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f2ef4-583f-4682-8dbe-f02d6a15f9c8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.419236 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f2ef4-583f-4682-8dbe-f02d6a15f9c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.421263 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f2ef4-583f-4682-8dbe-f02d6a15f9c8 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.441573 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-fb3f2ef4-583f-4682-8dbe-f02d6a15f9c8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:03:53.443413 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 319/632] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:53.450909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fc4cd-f485-417a-b94e-cc4cedfba275 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.462489 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fc4cd-f485-417a-b94e-cc4cedfba275 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.468604 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738310b-fd7a-47eb-93ba-5efedaad3b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.469273 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738310b-fd7a-47eb-93ba-5efedaad3b2b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.469558 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738310b-fd7a-47eb-93ba-5efedaad3b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.469835 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738310b-fd7a-47eb-93ba-5efedaad3b2b admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.470628 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738310b-fd7a-47eb-93ba-5efedaad3b2b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:53.470937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738310b-fd7a-47eb-93ba-5efedaad3b2b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.473733 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738310b-fd7a-47eb-93ba-5efedaad3b2b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.483548 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711882b-0d27-4c9f-b573-d55c8f5947c8 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.484235 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711882b-0d27-4c9f-b573-d55c8f5947c8 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.484751 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711882b-0d27-4c9f-b573-d55c8f5947c8 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.487309 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 320/633] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:03:53.488643 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 314/634] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:53.494272 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef01d0-2eac-41ec-ae4c-8fd33d6fdd21 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.494636 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738310b-fd7a-47eb-93ba-5efedaad3b2b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.495036 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef01d0-2eac-41ec-ae4c-8fd33d6fdd21 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.495411 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef01d0-2eac-41ec-ae4c-8fd33d6fdd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.504968 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738310b-fd7a-47eb-93ba-5efedaad3b2b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.509786 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f020d-4c6d-4c6e-8758-0252cd7fb961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.510612 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f020d-4c6d-4c6e-8758-0252cd7fb961 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.511068 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f020d-4c6d-4c6e-8758-0252cd7fb961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.511587 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f020d-4c6d-4c6e-8758-0252cd7fb961 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.512622 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f020d-4c6d-4c6e-8758-0252cd7fb961 admin admin] RBAC: Adding query filter params (role.id=9924d70543a845cdb7643026789244c3, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=d4899bdd65bb4cccae615cc5e8192388) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:53.513078 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f020d-4c6d-4c6e-8758-0252cd7fb961 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.515073 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f020d-4c6d-4c6e-8758-0252cd7fb961 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.521678 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 315/635] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/role_assignments?user.id=d4899bdd65bb4cccae615cc5e8192388&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=9924d70543a845cdb7643026789244c3 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:53.530158 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-93ef01d0-2eac-41ec-ae4c-8fd33d6fdd21 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:53.530158 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-93ef01d0-2eac-41ec-ae4c-8fd33d6fdd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:53.537825 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 321/636] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:53.564754 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f020d-4c6d-4c6e-8758-0252cd7fb961 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.569488 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d1f3f-fbb0-4f53-8752-9436eb56a2bf None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.570125 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d1f3f-fbb0-4f53-8752-9436eb56a2bf None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.570618 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d1f3f-fbb0-4f53-8752-9436eb56a2bf None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.572770 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 322/637] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:53.575494 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f020d-4c6d-4c6e-8758-0252cd7fb961 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.580538 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b5f72-f21c-4198-a2f6-c9c814d5b236 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.580824 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b5f72-f21c-4198-a2f6-c9c814d5b236 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.581098 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b5f72-f21c-4198-a2f6-c9c814d5b236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.584469 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c219e-53e2-4841-ab5e-08ac3e191f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.585715 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c219e-53e2-4841-ab5e-08ac3e191f98 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.586302 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c219e-53e2-4841-ab5e-08ac3e191f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.586785 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c219e-53e2-4841-ab5e-08ac3e191f98 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.602226 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-878b5f72-f21c-4198-a2f6-c9c814d5b236 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:53.603435 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-878b5f72-f21c-4198-a2f6-c9c814d5b236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:53.605926 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c219e-53e2-4841-ab5e-08ac3e191f98 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:53.612307 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 323/638] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:53.614676 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-852c219e-53e2-4841-ab5e-08ac3e191f98 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:03:53.617609 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 316/639] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:53.623361 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b5f72-f21c-4198-a2f6-c9c814d5b236 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.637404 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b5f72-f21c-4198-a2f6-c9c814d5b236 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.642001 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59e418-2d7f-4ba3-9e2f-3ee92098d4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.642677 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59e418-2d7f-4ba3-9e2f-3ee92098d4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.642973 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59e418-2d7f-4ba3-9e2f-3ee92098d4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.643230 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59e418-2d7f-4ba3-9e2f-3ee92098d4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.644038 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59e418-2d7f-4ba3-9e2f-3ee92098d4d7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:53.644339 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59e418-2d7f-4ba3-9e2f-3ee92098d4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.645959 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59e418-2d7f-4ba3-9e2f-3ee92098d4d7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.648830 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c219e-53e2-4841-ab5e-08ac3e191f98 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.656057 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 324/640] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:53.663994 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59e418-2d7f-4ba3-9e2f-3ee92098d4d7 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.665247 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c219e-53e2-4841-ab5e-08ac3e191f98 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.672920 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bae28-51a9-4278-b64f-352b2638f050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.673885 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bae28-51a9-4278-b64f-352b2638f050 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.674271 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bae28-51a9-4278-b64f-352b2638f050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.674667 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bae28-51a9-4278-b64f-352b2638f050 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.676022 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59e418-2d7f-4ba3-9e2f-3ee92098d4d7 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.688803 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabafef1-9d22-4066-9f30-ddcab8c4e003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.689723 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabafef1-9d22-4066-9f30-ddcab8c4e003 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.690008 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabafef1-9d22-4066-9f30-ddcab8c4e003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.690282 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabafef1-9d22-4066-9f30-ddcab8c4e003 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.702882 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bae28-51a9-4278-b64f-352b2638f050 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:53.714345 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-108bae28-51a9-4278-b64f-352b2638f050 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:03:53.715587 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 317/641] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:03:53.720954 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabafef1-9d22-4066-9f30-ddcab8c4e003 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.721388 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bae28-51a9-4278-b64f-352b2638f050 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.722811 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabafef1-9d22-4066-9f30-ddcab8c4e003 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.735179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bae28-51a9-4278-b64f-352b2638f050 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.742337 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2dfd1-dcfc-4e41-821d-2571f645b6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.743009 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2dfd1-dcfc-4e41-821d-2571f645b6ec admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.743295 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2dfd1-dcfc-4e41-821d-2571f645b6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.743574 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2dfd1-dcfc-4e41-821d-2571f645b6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.744177 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-eabafef1-9d22-4066-9f30-ddcab8c4e003 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:53.744353 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2dfd1-dcfc-4e41-821d-2571f645b6ec admin admin] RBAC: Adding query filter params (name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:53.744661 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2dfd1-dcfc-4e41-821d-2571f645b6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.745775 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 325/642] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:03:53.748839 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2dfd1-dcfc-4e41-821d-2571f645b6ec admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.751531 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabafef1-9d22-4066-9f30-ddcab8c4e003 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.763579 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 318/643] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:53.765823 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabafef1-9d22-4066-9f30-ddcab8c4e003 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.772917 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2dfd1-dcfc-4e41-821d-2571f645b6ec admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.778249 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a2b08-7261-4011-a8d7-34128faf93be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.779454 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a2b08-7261-4011-a8d7-34128faf93be admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.779924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a2b08-7261-4011-a8d7-34128faf93be admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.780372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a2b08-7261-4011-a8d7-34128faf93be admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.782038 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a2b08-7261-4011-a8d7-34128faf93be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:53.782868 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a2b08-7261-4011-a8d7-34128faf93be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.784684 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a2b08-7261-4011-a8d7-34128faf93be admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.784890 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2dfd1-dcfc-4e41-821d-2571f645b6ec admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.790511 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4914ad6-c578-4750-9433-1898fb5b66d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.791420 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4914ad6-c578-4750-9433-1898fb5b66d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.791709 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4914ad6-c578-4750-9433-1898fb5b66d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.792075 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4914ad6-c578-4750-9433-1898fb5b66d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.801474 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 326/644] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:53.811877 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a2b08-7261-4011-a8d7-34128faf93be admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.812044 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4914ad6-c578-4750-9433-1898fb5b66d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.812044 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4914ad6-c578-4750-9433-1898fb5b66d8 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.822617 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a2b08-7261-4011-a8d7-34128faf93be admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.827596 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d8359-48a1-4346-be8e-613b96b42279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.828697 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d8359-48a1-4346-be8e-613b96b42279 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.829221 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d8359-48a1-4346-be8e-613b96b42279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.829687 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d8359-48a1-4346-be8e-613b96b42279 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.835723 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-a4914ad6-c578-4750-9433-1898fb5b66d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:53.837232 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 319/645] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:03:53.838506 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d8359-48a1-4346-be8e-613b96b42279 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.840782 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d8359-48a1-4346-be8e-613b96b42279 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.842586 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4914ad6-c578-4750-9433-1898fb5b66d8 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.853447 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4914ad6-c578-4750-9433-1898fb5b66d8 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.856745 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-a12d8359-48a1-4346-be8e-613b96b42279 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 23:03:53.857953 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e580c-8e4b-4caf-bd04-5a60f92c6a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.858627 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e580c-8e4b-4caf-bd04-5a60f92c6a59 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.858897 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e580c-8e4b-4caf-bd04-5a60f92c6a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.859226 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e580c-8e4b-4caf-bd04-5a60f92c6a59 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.859433 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 327/646] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:53.863939 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e580c-8e4b-4caf-bd04-5a60f92c6a59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:53.864498 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e580c-8e4b-4caf-bd04-5a60f92c6a59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.866147 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d8359-48a1-4346-be8e-613b96b42279 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.867396 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e580c-8e4b-4caf-bd04-5a60f92c6a59 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.880606 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 320/647] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:53.886428 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d8359-48a1-4346-be8e-613b96b42279 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.890895 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e580c-8e4b-4caf-bd04-5a60f92c6a59 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.893954 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a28b8c-c0e8-4a9c-9e9d-6601603c60da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.894677 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a28b8c-c0e8-4a9c-9e9d-6601603c60da admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.894960 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a28b8c-c0e8-4a9c-9e9d-6601603c60da admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.895240 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a28b8c-c0e8-4a9c-9e9d-6601603c60da admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.896320 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a28b8c-c0e8-4a9c-9e9d-6601603c60da admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:53.897077 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a28b8c-c0e8-4a9c-9e9d-6601603c60da admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.907866 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a28b8c-c0e8-4a9c-9e9d-6601603c60da admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.913235 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e580c-8e4b-4caf-bd04-5a60f92c6a59 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.923776 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7a3b5-c6d0-4a8b-bfc6-9ca7faf19b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.924917 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7a3b5-c6d0-4a8b-bfc6-9ca7faf19b55 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.925472 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7a3b5-c6d0-4a8b-bfc6-9ca7faf19b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.925980 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7a3b5-c6d0-4a8b-bfc6-9ca7faf19b55 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.932502 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 328/648] 10.222.0.77 () {56 vars in 1154 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:53.940475 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a28b8c-c0e8-4a9c-9e9d-6601603c60da admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.944078 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7a3b5-c6d0-4a8b-bfc6-9ca7faf19b55 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.947696 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7a3b5-c6d0-4a8b-bfc6-9ca7faf19b55 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:53.958674 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a28b8c-c0e8-4a9c-9e9d-6601603c60da admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:53.970234 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250189a-fd1b-4e40-adc2-d3900b4377ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:53.970918 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250189a-fd1b-4e40-adc2-d3900b4377ca admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:53.971207 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250189a-fd1b-4e40-adc2-d3900b4377ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:53.971484 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250189a-fd1b-4e40-adc2-d3900b4377ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:53.975806 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-deb7a3b5-c6d0-4a8b-bfc6-9ca7faf19b55 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 10 23:03:53.981564 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 321/649] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:53.988205 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7a3b5-c6d0-4a8b-bfc6-9ca7faf19b55 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:53.991942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250189a-fd1b-4e40-adc2-d3900b4377ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:53.996961 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250189a-fd1b-4e40-adc2-d3900b4377ca admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.008661 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7a3b5-c6d0-4a8b-bfc6-9ca7faf19b55 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.014233 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 329/650] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:54.015285 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb43bc-6a98-475b-882f-6324293527f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.016193 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb43bc-6a98-475b-882f-6324293527f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.016688 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb43bc-6a98-475b-882f-6324293527f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.017151 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb43bc-6a98-475b-882f-6324293527f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.018199 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb43bc-6a98-475b-882f-6324293527f6 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:54.018760 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb43bc-6a98-475b-882f-6324293527f6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.019598 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250189a-fd1b-4e40-adc2-d3900b4377ca admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.021032 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb43bc-6a98-475b-882f-6324293527f6 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.037770 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250189a-fd1b-4e40-adc2-d3900b4377ca admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.048527 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91716e67-8276-4f2d-99df-9e4e0db9d398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.049357 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91716e67-8276-4f2d-99df-9e4e0db9d398 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.049693 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91716e67-8276-4f2d-99df-9e4e0db9d398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.049966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91716e67-8276-4f2d-99df-9e4e0db9d398 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.060408 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 322/651] 10.222.0.77 () {56 vars in 1156 bytes} [Thu Feb 10 23:03:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:54.065718 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10b76a-09fc-4f8a-aeff-00ba03474cc5 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.066011 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10b76a-09fc-4f8a-aeff-00ba03474cc5 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.066288 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10b76a-09fc-4f8a-aeff-00ba03474cc5 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.068837 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 323/652] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:03:54.069807 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10b76a-09fc-4f8a-aeff-00ba03474cc5 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.070214 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91716e67-8276-4f2d-99df-9e4e0db9d398 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.072326 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91716e67-8276-4f2d-99df-9e4e0db9d398 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.090721 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10b76a-09fc-4f8a-aeff-00ba03474cc5 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.094109 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-91716e67-8276-4f2d-99df-9e4e0db9d398 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:54.095359 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ceb42f-f1ef-4717-bd7f-da2d6c2ffed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.095653 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 330/653] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:03:54.096274 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ceb42f-f1ef-4717-bd7f-da2d6c2ffed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.096554 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ceb42f-f1ef-4717-bd7f-da2d6c2ffed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.096823 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ceb42f-f1ef-4717-bd7f-da2d6c2ffed5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.096923 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712ddc7-a954-43cf-b5e4-a4794e6168c9 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.097170 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712ddc7-a954-43cf-b5e4-a4794e6168c9 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.097444 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712ddc7-a954-43cf-b5e4-a4794e6168c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.110101 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ceb42f-f1ef-4717-bd7f-da2d6c2ffed5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.113040 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ceb42f-f1ef-4717-bd7f-da2d6c2ffed5 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.116969 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-2712ddc7-a954-43cf-b5e4-a4794e6168c9 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:54.118185 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2712ddc7-a954-43cf-b5e4-a4794e6168c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:54.127168 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 331/654] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:54.128110 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712ddc7-a954-43cf-b5e4-a4794e6168c9 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.137904 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712ddc7-a954-43cf-b5e4-a4794e6168c9 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.138854 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-a1ceb42f-f1ef-4717-bd7f-da2d6c2ffed5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:54.140333 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 324/655] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:54.142925 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018f16c-3851-4cd1-b190-b2e2c1da4333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.143718 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018f16c-3851-4cd1-b190-b2e2c1da4333 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.144177 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018f16c-3851-4cd1-b190-b2e2c1da4333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.144589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018f16c-3851-4cd1-b190-b2e2c1da4333 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.145607 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018f16c-3851-4cd1-b190-b2e2c1da4333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:54.146013 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018f16c-3851-4cd1-b190-b2e2c1da4333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.146149 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ceb42f-f1ef-4717-bd7f-da2d6c2ffed5 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.148596 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018f16c-3851-4cd1-b190-b2e2c1da4333 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.168650 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 332/656] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:54.168848 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ceb42f-f1ef-4717-bd7f-da2d6c2ffed5 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.169755 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018f16c-3851-4cd1-b190-b2e2c1da4333 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.173555 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149505c5-86c9-42ce-8434-cb413531c6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.174245 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149505c5-86c9-42ce-8434-cb413531c6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.174523 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149505c5-86c9-42ce-8434-cb413531c6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.174885 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149505c5-86c9-42ce-8434-cb413531c6a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.175705 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149505c5-86c9-42ce-8434-cb413531c6a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:54.176049 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149505c5-86c9-42ce-8434-cb413531c6a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.177787 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149505c5-86c9-42ce-8434-cb413531c6a7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.184027 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018f16c-3851-4cd1-b190-b2e2c1da4333 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.188967 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e3948-cdc2-45b5-8046-1492de858887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.190491 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e3948-cdc2-45b5-8046-1492de858887 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.190956 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e3948-cdc2-45b5-8046-1492de858887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.191238 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 325/657] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:54.191695 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e3948-cdc2-45b5-8046-1492de858887 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.195993 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149505c5-86c9-42ce-8434-cb413531c6a7 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.202879 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149505c5-86c9-42ce-8434-cb413531c6a7 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.207975 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc71b8-a79b-4d38-a543-db4a922e23e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.209537 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc71b8-a79b-4d38-a543-db4a922e23e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.209685 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e3948-cdc2-45b5-8046-1492de858887 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:54.209856 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc71b8-a79b-4d38-a543-db4a922e23e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.210087 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc71b8-a79b-4d38-a543-db4a922e23e5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.217000 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc71b8-a79b-4d38-a543-db4a922e23e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.217818 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-c88e3948-cdc2-45b5-8046-1492de858887 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:03:54.218914 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc71b8-a79b-4d38-a543-db4a922e23e5 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.219438 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 333/658] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:54.220401 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e3948-cdc2-45b5-8046-1492de858887 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.234861 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e3948-cdc2-45b5-8046-1492de858887 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.240107 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a8012-c9b7-4974-9ac2-e7d9bcc7941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.241125 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a8012-c9b7-4974-9ac2-e7d9bcc7941c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.241672 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a8012-c9b7-4974-9ac2-e7d9bcc7941c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.242151 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a8012-c9b7-4974-9ac2-e7d9bcc7941c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.242350 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-4adc71b8-a79b-4d38-a543-db4a922e23e5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:03:54.243897 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 326/659] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:54.247852 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc71b8-a79b-4d38-a543-db4a922e23e5 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.254957 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc71b8-a79b-4d38-a543-db4a922e23e5 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.255482 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a8012-c9b7-4974-9ac2-e7d9bcc7941c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.258341 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a8012-c9b7-4974-9ac2-e7d9bcc7941c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.260017 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a38e6-f215-4ccb-b783-855b43afcafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.260825 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a38e6-f215-4ccb-b783-855b43afcafa admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.261108 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a38e6-f215-4ccb-b783-855b43afcafa admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.261381 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a38e6-f215-4ccb-b783-855b43afcafa admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.262438 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a38e6-f215-4ccb-b783-855b43afcafa admin admin] RBAC: Adding query filter params (name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:54.262744 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a38e6-f215-4ccb-b783-855b43afcafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.264338 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a38e6-f215-4ccb-b783-855b43afcafa admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.273560 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 327/660] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:54.274161 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a38e6-f215-4ccb-b783-855b43afcafa admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.275653 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-542a8012-c9b7-4974-9ac2-e7d9bcc7941c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:03:54.277314 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 334/661] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:54.279762 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a8012-c9b7-4974-9ac2-e7d9bcc7941c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.289826 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a38e6-f215-4ccb-b783-855b43afcafa admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.291433 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a8012-c9b7-4974-9ac2-e7d9bcc7941c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.294542 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462df8c-7d44-4f42-b91e-643b9b9861c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.295279 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462df8c-7d44-4f42-b91e-643b9b9861c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.295552 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462df8c-7d44-4f42-b91e-643b9b9861c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.295863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462df8c-7d44-4f42-b91e-643b9b9861c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.296801 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462df8c-7d44-4f42-b91e-643b9b9861c4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:54.297115 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462df8c-7d44-4f42-b91e-643b9b9861c4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.297519 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce82c79-a2a8-4ee1-a035-7d1a0ae64113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.298521 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce82c79-a2a8-4ee1-a035-7d1a0ae64113 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.298927 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462df8c-7d44-4f42-b91e-643b9b9861c4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.299191 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce82c79-a2a8-4ee1-a035-7d1a0ae64113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.299665 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce82c79-a2a8-4ee1-a035-7d1a0ae64113 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.311014 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce82c79-a2a8-4ee1-a035-7d1a0ae64113 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.313176 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 328/662] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:54.317976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce82c79-a2a8-4ee1-a035-7d1a0ae64113 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.318671 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462df8c-7d44-4f42-b91e-643b9b9861c4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.324728 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462df8c-7d44-4f42-b91e-643b9b9861c4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.329788 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a47a0-5351-4bd0-97db-23d893208b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.330444 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a47a0-5351-4bd0-97db-23d893208b90 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.330721 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a47a0-5351-4bd0-97db-23d893208b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.330995 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a47a0-5351-4bd0-97db-23d893208b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.331774 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a47a0-5351-4bd0-97db-23d893208b90 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:54.332110 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a47a0-5351-4bd0-97db-23d893208b90 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.334899 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a47a0-5351-4bd0-97db-23d893208b90 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.341225 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-cce82c79-a2a8-4ee1-a035-7d1a0ae64113 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:54.342930 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 335/663] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:54.343945 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce82c79-a2a8-4ee1-a035-7d1a0ae64113 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.354188 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 329/664] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:54.355018 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a47a0-5351-4bd0-97db-23d893208b90 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.362660 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce82c79-a2a8-4ee1-a035-7d1a0ae64113 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.368415 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6561dd2-657d-49ab-ad3f-df3258e6da3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.368627 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a47a0-5351-4bd0-97db-23d893208b90 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.369489 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6561dd2-657d-49ab-ad3f-df3258e6da3f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.369973 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6561dd2-657d-49ab-ad3f-df3258e6da3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.370432 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6561dd2-657d-49ab-ad3f-df3258e6da3f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.371330 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6561dd2-657d-49ab-ad3f-df3258e6da3f admin admin] RBAC: Adding query filter params (role.id=9924d70543a845cdb7643026789244c3, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=551da2c9fab74cb8b14287a5634adb25) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:54.371759 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6561dd2-657d-49ab-ad3f-df3258e6da3f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.373578 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d809c-a89f-4e2c-947f-05104f8f77f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.374392 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d809c-a89f-4e2c-947f-05104f8f77f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.374614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6561dd2-657d-49ab-ad3f-df3258e6da3f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.374956 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d809c-a89f-4e2c-947f-05104f8f77f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.375374 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d809c-a89f-4e2c-947f-05104f8f77f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.376270 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d809c-a89f-4e2c-947f-05104f8f77f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:54.376707 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d809c-a89f-4e2c-947f-05104f8f77f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.378505 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d809c-a89f-4e2c-947f-05104f8f77f1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.382682 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 336/665] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/role_assignments?user.id=551da2c9fab74cb8b14287a5634adb25&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=9924d70543a845cdb7643026789244c3 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:54.383519 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6561dd2-657d-49ab-ad3f-df3258e6da3f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.400484 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 330/666] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:54.403161 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6561dd2-657d-49ab-ad3f-df3258e6da3f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.405577 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d809c-a89f-4e2c-947f-05104f8f77f1 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.419847 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d809c-a89f-4e2c-947f-05104f8f77f1 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.424654 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a09b0-c759-4fdb-94e6-6de51a4bb31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.425958 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a09b0-c759-4fdb-94e6-6de51a4bb31c admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.426460 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a09b0-c759-4fdb-94e6-6de51a4bb31c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.426873 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a09b0-c759-4fdb-94e6-6de51a4bb31c admin admin] PATH_INFO: `/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/ce55b64dc528447993e32b00ae4d3a2a/roles/9924d70543a845cdb7643026789244c3` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.437730 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401ed0c-a589-4827-be6a-8da4db1d04b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.440015 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ed0c-a589-4827-be6a-8da4db1d04b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.442038 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ed0c-a589-4827-be6a-8da4db1d04b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.442519 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ed0c-a589-4827-be6a-8da4db1d04b3 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.456824 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401ed0c-a589-4827-be6a-8da4db1d04b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.462884 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a09b0-c759-4fdb-94e6-6de51a4bb31c admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ab195cc240497c9ac12843d738c4b9, user_id=ce55b64dc528447993e32b00ae4d3a2a, role_id=9924d70543a845cdb7643026789244c3)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.465837 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a09b0-c759-4fdb-94e6-6de51a4bb31c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.466302 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401ed0c-a589-4827-be6a-8da4db1d04b3 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.486182 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-3401ed0c-a589-4827-be6a-8da4db1d04b3 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 10 23:03:54.490845 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 331/667] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:03:54.496180 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 337/668] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:03:54 2022] PUT /identity/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/ce55b64dc528447993e32b00ae4d3a2a/roles/9924d70543a845cdb7643026789244c3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:03:54.497432 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401ed0c-a589-4827-be6a-8da4db1d04b3 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.513616 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401ed0c-a589-4827-be6a-8da4db1d04b3 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.593156 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec106f27-4f45-4b3d-8401-d09fb63e5902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.593903 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec106f27-4f45-4b3d-8401-d09fb63e5902 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.594179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec106f27-4f45-4b3d-8401-d09fb63e5902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.594494 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec106f27-4f45-4b3d-8401-d09fb63e5902 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.595344 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec106f27-4f45-4b3d-8401-d09fb63e5902 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:54.595652 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec106f27-4f45-4b3d-8401-d09fb63e5902 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.597638 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec106f27-4f45-4b3d-8401-d09fb63e5902 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.620460 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 332/669] 10.222.0.77 () {56 vars in 1160 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:54.625913 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a09b0-c759-4fdb-94e6-6de51a4bb31c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.636570 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a09b0-c759-4fdb-94e6-6de51a4bb31c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.641371 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb600299-0684-4dc3-942c-d2f58242509c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.642181 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb600299-0684-4dc3-942c-d2f58242509c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.642508 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb600299-0684-4dc3-942c-d2f58242509c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.642781 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb600299-0684-4dc3-942c-d2f58242509c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.652842 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb600299-0684-4dc3-942c-d2f58242509c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.654736 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb600299-0684-4dc3-942c-d2f58242509c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.666111 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 338/670] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:54.671309 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec106f27-4f45-4b3d-8401-d09fb63e5902 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.684269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec106f27-4f45-4b3d-8401-d09fb63e5902 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.689046 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90308f53-8dc4-49e3-8357-eda8b8b70c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.689895 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90308f53-8dc4-49e3-8357-eda8b8b70c04 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.690176 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90308f53-8dc4-49e3-8357-eda8b8b70c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.690446 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90308f53-8dc4-49e3-8357-eda8b8b70c04 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.703584 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90308f53-8dc4-49e3-8357-eda8b8b70c04 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.705507 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90308f53-8dc4-49e3-8357-eda8b8b70c04 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.726076 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-90308f53-8dc4-49e3-8357-eda8b8b70c04 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:54.727685 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 333/671] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:54.732829 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb600299-0684-4dc3-942c-d2f58242509c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.743561 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb600299-0684-4dc3-942c-d2f58242509c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.748263 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21471c05-efdd-4840-93ef-594230707af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.748925 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21471c05-efdd-4840-93ef-594230707af9 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.749205 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21471c05-efdd-4840-93ef-594230707af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.749475 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21471c05-efdd-4840-93ef-594230707af9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.750211 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21471c05-efdd-4840-93ef-594230707af9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:54.750510 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21471c05-efdd-4840-93ef-594230707af9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.752221 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21471c05-efdd-4840-93ef-594230707af9 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.765975 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 339/672] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:54.772961 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90308f53-8dc4-49e3-8357-eda8b8b70c04 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.784935 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90308f53-8dc4-49e3-8357-eda8b8b70c04 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.789444 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc9ffa-1fc9-47e9-8987-00499f829257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.790250 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc9ffa-1fc9-47e9-8987-00499f829257 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.790528 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc9ffa-1fc9-47e9-8987-00499f829257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.790797 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc9ffa-1fc9-47e9-8987-00499f829257 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.798360 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc9ffa-1fc9-47e9-8987-00499f829257 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.800396 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc9ffa-1fc9-47e9-8987-00499f829257 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.814221 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-9dbc9ffa-1fc9-47e9-8987-00499f829257 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:03:54.815697 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 334/673] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:54.822004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21471c05-efdd-4840-93ef-594230707af9 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.834434 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21471c05-efdd-4840-93ef-594230707af9 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.840307 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e20f25-27c6-40d7-ace0-ede51651cb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.840958 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e20f25-27c6-40d7-ace0-ede51651cb30 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.841236 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e20f25-27c6-40d7-ace0-ede51651cb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.841505 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e20f25-27c6-40d7-ace0-ede51651cb30 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.842301 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e20f25-27c6-40d7-ace0-ede51651cb30 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:54.842605 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e20f25-27c6-40d7-ace0-ede51651cb30 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.844470 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e20f25-27c6-40d7-ace0-ede51651cb30 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.858747 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 340/674] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:54.864791 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc9ffa-1fc9-47e9-8987-00499f829257 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:54.875912 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc9ffa-1fc9-47e9-8987-00499f829257 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:54.880319 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f58c0-2cf7-41fa-83b1-a1cad07ad2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:54.880978 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f58c0-2cf7-41fa-83b1-a1cad07ad2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:54.881251 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f58c0-2cf7-41fa-83b1-a1cad07ad2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:54.881520 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f58c0-2cf7-41fa-83b1-a1cad07ad2b2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:54.882356 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f58c0-2cf7-41fa-83b1-a1cad07ad2b2 admin admin] RBAC: Adding query filter params (role.id=9924d70543a845cdb7643026789244c3, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=0d2af52f48dc435ca9a48cc0a32c31e2) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:54.882657 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f58c0-2cf7-41fa-83b1-a1cad07ad2b2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:54.884489 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f58c0-2cf7-41fa-83b1-a1cad07ad2b2 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:54.890454 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 335/675] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:54 2022] GET /identity/v3/role_assignments?user.id=0d2af52f48dc435ca9a48cc0a32c31e2&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=9924d70543a845cdb7643026789244c3 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:55.946451 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8decd0-089e-4bb5-9ef9-af33b479d33b None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:55.947646 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8decd0-089e-4bb5-9ef9-af33b479d33b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:55.948173 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8decd0-089e-4bb5-9ef9-af33b479d33b None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:55.950690 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 341/676] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:55.956435 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db14901-33b2-4696-b34a-5e2a9489a8d2 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:55.957388 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db14901-33b2-4696-b34a-5e2a9489a8d2 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:55.957899 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db14901-33b2-4696-b34a-5e2a9489a8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:55.981807 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-0db14901-33b2-4696-b34a-5e2a9489a8d2 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:55.983353 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-0db14901-33b2-4696-b34a-5e2a9489a8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:55.997557 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 336/677] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:56.045305 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8decd0-089e-4bb5-9ef9-af33b479d33b None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:56.058734 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8decd0-089e-4bb5-9ef9-af33b479d33b None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:56.067849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d26c91-3971-4cd8-abcc-459eb3a56aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:56.069450 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d26c91-3971-4cd8-abcc-459eb3a56aab admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:56.069943 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d26c91-3971-4cd8-abcc-459eb3a56aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:56.070447 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d26c91-3971-4cd8-abcc-459eb3a56aab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:56.089561 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d26c91-3971-4cd8-abcc-459eb3a56aab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:56.091651 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d26c91-3971-4cd8-abcc-459eb3a56aab admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:56.110065 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-95d26c91-3971-4cd8-abcc-459eb3a56aab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:56.112319 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 342/678] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:56.118786 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db14901-33b2-4696-b34a-5e2a9489a8d2 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:56.128177 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db14901-33b2-4696-b34a-5e2a9489a8d2 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:56.139424 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e826a-ed47-4326-a42c-05b351974e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:56.140386 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e826a-ed47-4326-a42c-05b351974e9c admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:56.140895 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e826a-ed47-4326-a42c-05b351974e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:56.141373 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e826a-ed47-4326-a42c-05b351974e9c admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:56.142307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e826a-ed47-4326-a42c-05b351974e9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:56.142811 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e826a-ed47-4326-a42c-05b351974e9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:56.144638 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e826a-ed47-4326-a42c-05b351974e9c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:56.166255 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 337/679] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:56.172024 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d26c91-3971-4cd8-abcc-459eb3a56aab admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:56.182981 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d26c91-3971-4cd8-abcc-459eb3a56aab admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:56.192086 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70231628-4450-46ea-9ea7-c9833620465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:56.193960 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70231628-4450-46ea-9ea7-c9833620465e admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:56.194578 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70231628-4450-46ea-9ea7-c9833620465e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:56.195061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70231628-4450-46ea-9ea7-c9833620465e admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:56.196052 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70231628-4450-46ea-9ea7-c9833620465e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:56.198239 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70231628-4450-46ea-9ea7-c9833620465e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:56.229035 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 343/680] 10.222.0.77 () {60 vars in 1153 bytes} [Thu Feb 10 23:03:56 2022] POST /identity/v3/users => generated 254 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:03:56.369245 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540368a-ba96-404b-a0c9-ee2888a4ced9 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:56.369956 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540368a-ba96-404b-a0c9-ee2888a4ced9 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:56.370492 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540368a-ba96-404b-a0c9-ee2888a4ced9 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:56.372750 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 338/681] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:56.378394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035ab78-2e56-4e79-b85c-9f19e41cc94b None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:56.378968 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035ab78-2e56-4e79-b85c-9f19e41cc94b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:56.379471 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035ab78-2e56-4e79-b85c-9f19e41cc94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:56.402376 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-4035ab78-2e56-4e79-b85c-9f19e41cc94b None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:56.403954 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-4035ab78-2e56-4e79-b85c-9f19e41cc94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:56.415781 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 344/682] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:56.439168 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540368a-ba96-404b-a0c9-ee2888a4ced9 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:56.453059 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540368a-ba96-404b-a0c9-ee2888a4ced9 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:56.464863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59dd29-22c6-4f43-a38f-1deff9c76295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:56.465683 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59dd29-22c6-4f43-a38f-1deff9c76295 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:56.465965 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59dd29-22c6-4f43-a38f-1deff9c76295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:56.466240 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59dd29-22c6-4f43-a38f-1deff9c76295 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:56.466911 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59dd29-22c6-4f43-a38f-1deff9c76295 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:56.467952 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING py.warnings [None req-0f59dd29-22c6-4f43-a38f-1deff9c76295 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:03:56.467952 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: warnings.warn(msg) Feb 10 23:03:56.467952 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: Feb 10 23:03:56.468834 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59dd29-22c6-4f43-a38f-1deff9c76295 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:56.486184 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-0f59dd29-22c6-4f43-a38f-1deff9c76295 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 10 23:03:56.487745 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 339/683] 10.222.0.77 () {56 vars in 1150 bytes} [Thu Feb 10 23:03:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:56.494001 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035ab78-2e56-4e79-b85c-9f19e41cc94b None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:56.503698 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035ab78-2e56-4e79-b85c-9f19e41cc94b None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:56.508257 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a7811-2531-42cd-b926-b75e82dbdd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:56.508911 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a7811-2531-42cd-b926-b75e82dbdd48 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:56.509190 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a7811-2531-42cd-b926-b75e82dbdd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:56.509464 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a7811-2531-42cd-b926-b75e82dbdd48 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:56.510183 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a7811-2531-42cd-b926-b75e82dbdd48 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:56.510483 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a7811-2531-42cd-b926-b75e82dbdd48 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:56.511474 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING py.warnings [None req-8f3a7811-2531-42cd-b926-b75e82dbdd48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:03:56.511474 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: warnings.warn(msg) Feb 10 23:03:56.511474 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: Feb 10 23:03:56.513464 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a7811-2531-42cd-b926-b75e82dbdd48 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:56.518331 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 345/684] 10.222.0.77 () {56 vars in 1145 bytes} [Thu Feb 10 23:03:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:56.523957 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59dd29-22c6-4f43-a38f-1deff9c76295 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:56.534782 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59dd29-22c6-4f43-a38f-1deff9c76295 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:56.540111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1050e-765a-4be1-ba3a-354cab946a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:56.540759 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1050e-765a-4be1-ba3a-354cab946a19 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:56.541037 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1050e-765a-4be1-ba3a-354cab946a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:56.541307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1050e-765a-4be1-ba3a-354cab946a19 admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:56.542019 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1050e-765a-4be1-ba3a-354cab946a19 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:56.542316 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1050e-765a-4be1-ba3a-354cab946a19 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:56.543310 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING py.warnings [None req-90a1050e-765a-4be1-ba3a-354cab946a19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:03:56.543310 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: warnings.warn(msg) Feb 10 23:03:56.543310 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: Feb 10 23:03:56.544226 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1050e-765a-4be1-ba3a-354cab946a19 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:56.550397 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 340/685] 10.222.0.77 () {56 vars in 1145 bytes} [Thu Feb 10 23:03:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:57.215535 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e3a53-5466-4ecf-a010-9ded7ff4f80d None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.216246 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e3a53-5466-4ecf-a010-9ded7ff4f80d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.216246 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e3a53-5466-4ecf-a010-9ded7ff4f80d None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.218079 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 346/686] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:57.223524 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d51612-c180-4388-a465-9b09260ddbd6 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.224013 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d51612-c180-4388-a465-9b09260ddbd6 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.224245 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d51612-c180-4388-a465-9b09260ddbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.246201 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-a5d51612-c180-4388-a465-9b09260ddbd6 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:57.247378 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a5d51612-c180-4388-a465-9b09260ddbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:57.255265 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 341/687] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:57.280576 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e3a53-5466-4ecf-a010-9ded7ff4f80d None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:57.293595 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e3a53-5466-4ecf-a010-9ded7ff4f80d None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:57.297939 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48892789-40a3-4942-a6fe-b64d326defb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:57.298719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48892789-40a3-4942-a6fe-b64d326defb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.298996 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48892789-40a3-4942-a6fe-b64d326defb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.299264 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48892789-40a3-4942-a6fe-b64d326defb2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.310089 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48892789-40a3-4942-a6fe-b64d326defb2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:57.316948 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-48892789-40a3-4942-a6fe-b64d326defb2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:03:57.318958 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 347/688] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:03:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:57.324593 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d51612-c180-4388-a465-9b09260ddbd6 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:57.333715 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d51612-c180-4388-a465-9b09260ddbd6 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:57.338639 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23ec96-a49b-47e5-b168-7658b15f8a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:57.339290 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23ec96-a49b-47e5-b168-7658b15f8a17 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.339575 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23ec96-a49b-47e5-b168-7658b15f8a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.339861 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23ec96-a49b-47e5-b168-7658b15f8a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.340629 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23ec96-a49b-47e5-b168-7658b15f8a17 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:57.340932 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23ec96-a49b-47e5-b168-7658b15f8a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:57.342513 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23ec96-a49b-47e5-b168-7658b15f8a17 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:57.354868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 342/689] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:03:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:57.360420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48892789-40a3-4942-a6fe-b64d326defb2 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:57.370690 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48892789-40a3-4942-a6fe-b64d326defb2 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:57.375350 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a957f0-3d79-4377-b729-c2a5f59622bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:57.376204 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a957f0-3d79-4377-b729-c2a5f59622bb admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.376528 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a957f0-3d79-4377-b729-c2a5f59622bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.376809 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a957f0-3d79-4377-b729-c2a5f59622bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.388838 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a957f0-3d79-4377-b729-c2a5f59622bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:57.390695 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a957f0-3d79-4377-b729-c2a5f59622bb admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:57.412909 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-66a957f0-3d79-4377-b729-c2a5f59622bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:57.414389 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 348/690] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:57.419962 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23ec96-a49b-47e5-b168-7658b15f8a17 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:57.435492 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23ec96-a49b-47e5-b168-7658b15f8a17 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:57.441142 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc426f-ecba-4ce4-9ec2-52fe4488c8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:57.441847 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc426f-ecba-4ce4-9ec2-52fe4488c8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.442178 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc426f-ecba-4ce4-9ec2-52fe4488c8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.442454 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc426f-ecba-4ce4-9ec2-52fe4488c8a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.443224 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc426f-ecba-4ce4-9ec2-52fe4488c8a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:57.443618 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc426f-ecba-4ce4-9ec2-52fe4488c8a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:57.445310 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc426f-ecba-4ce4-9ec2-52fe4488c8a2 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:57.460798 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 343/691] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:57.466418 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a957f0-3d79-4377-b729-c2a5f59622bb admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:57.480955 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a957f0-3d79-4377-b729-c2a5f59622bb admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:57.489671 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c3f60-dc97-463c-865f-1cc7bcb4fe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:57.490564 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c3f60-dc97-463c-865f-1cc7bcb4fe8c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.490838 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c3f60-dc97-463c-865f-1cc7bcb4fe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.491114 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c3f60-dc97-463c-865f-1cc7bcb4fe8c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.492047 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c434da3-bc1b-4cbc-b32e-721be0fd5ad4 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.492540 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c434da3-bc1b-4cbc-b32e-721be0fd5ad4 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.493106 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c434da3-bc1b-4cbc-b32e-721be0fd5ad4 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.496588 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 344/692] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:03:57.503367 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e0888-afa6-4ba6-9933-ee066b75b18f None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.503937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e0888-afa6-4ba6-9933-ee066b75b18f None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.504550 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e0888-afa6-4ba6-9933-ee066b75b18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.505061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c3f60-dc97-463c-865f-1cc7bcb4fe8c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:57.507111 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c3f60-dc97-463c-865f-1cc7bcb4fe8c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:57.525587 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-9e5e0888-afa6-4ba6-9933-ee066b75b18f None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:57.526612 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-6d7c3f60-dc97-463c-865f-1cc7bcb4fe8c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 10 23:03:57.527339 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-9e5e0888-afa6-4ba6-9933-ee066b75b18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:57.528141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 349/693] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:03:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:57.533368 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c3f60-dc97-463c-865f-1cc7bcb4fe8c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:57.536037 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 345/694] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:57.552697 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c3f60-dc97-463c-865f-1cc7bcb4fe8c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:57.560476 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11a718-e4a6-4615-819f-6862aa27227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:57.561132 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11a718-e4a6-4615-819f-6862aa27227b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.561408 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11a718-e4a6-4615-819f-6862aa27227b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.561676 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11a718-e4a6-4615-819f-6862aa27227b admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.562609 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11a718-e4a6-4615-819f-6862aa27227b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:57.562830 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11a718-e4a6-4615-819f-6862aa27227b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:57.563977 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e0888-afa6-4ba6-9933-ee066b75b18f None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:57.564682 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11a718-e4a6-4615-819f-6862aa27227b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:57.575212 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e0888-afa6-4ba6-9933-ee066b75b18f None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:57.590814 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5a965-5a5e-4073-aa2b-b6d7d5c3d473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:57.591614 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5a965-5a5e-4073-aa2b-b6d7d5c3d473 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.591915 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5a965-5a5e-4073-aa2b-b6d7d5c3d473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.592186 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5a965-5a5e-4073-aa2b-b6d7d5c3d473 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.597168 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 350/695] 10.222.0.77 () {56 vars in 1156 bytes} [Thu Feb 10 23:03:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:57.603797 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11a718-e4a6-4615-819f-6862aa27227b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:57.614073 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11a718-e4a6-4615-819f-6862aa27227b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:57.618958 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5a965-5a5e-4073-aa2b-b6d7d5c3d473 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:57.619223 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2be45a-217b-41df-9540-1035de9ec1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:57.619899 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2be45a-217b-41df-9540-1035de9ec1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.620188 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2be45a-217b-41df-9540-1035de9ec1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.620510 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2be45a-217b-41df-9540-1035de9ec1c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.625930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-acd5a965-5a5e-4073-aa2b-b6d7d5c3d473 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:03:57.633904 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 346/696] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:03:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:57.638351 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5a965-5a5e-4073-aa2b-b6d7d5c3d473 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:57.640715 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2be45a-217b-41df-9540-1035de9ec1c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:57.642539 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2be45a-217b-41df-9540-1035de9ec1c8 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:57.649189 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5a965-5a5e-4073-aa2b-b6d7d5c3d473 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:57.659617 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 351/697] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 23:03:57.660453 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e14231-fdcd-4695-b0a7-58ba12e62b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:57.661355 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e14231-fdcd-4695-b0a7-58ba12e62b2f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.662421 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e14231-fdcd-4695-b0a7-58ba12e62b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.662909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e14231-fdcd-4695-b0a7-58ba12e62b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.663931 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e14231-fdcd-4695-b0a7-58ba12e62b2f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:57.664439 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e14231-fdcd-4695-b0a7-58ba12e62b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:57.666249 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e14231-fdcd-4695-b0a7-58ba12e62b2f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:57.667297 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2be45a-217b-41df-9540-1035de9ec1c8 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:57.676672 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2be45a-217b-41df-9540-1035de9ec1c8 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:57.679399 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 347/698] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:03:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:57.682353 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c23f7-0273-413e-abc9-c0974e7fc46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:57.683398 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c23f7-0273-413e-abc9-c0974e7fc46b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.684006 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c23f7-0273-413e-abc9-c0974e7fc46b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.684488 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c23f7-0273-413e-abc9-c0974e7fc46b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.684611 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e14231-fdcd-4695-b0a7-58ba12e62b2f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:57.698735 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c23f7-0273-413e-abc9-c0974e7fc46b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:57.700994 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c23f7-0273-413e-abc9-c0974e7fc46b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:57.702326 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e14231-fdcd-4695-b0a7-58ba12e62b2f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:57.717082 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf8f11-0106-4619-bf79-c38ddf7ebcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:57.717881 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf8f11-0106-4619-bf79-c38ddf7ebcff admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.718155 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf8f11-0106-4619-bf79-c38ddf7ebcff admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.718425 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf8f11-0106-4619-bf79-c38ddf7ebcff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.722824 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-908c23f7-0273-413e-abc9-c0974e7fc46b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:57.724890 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 352/699] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:57.730396 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c23f7-0273-413e-abc9-c0974e7fc46b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:57.741344 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c23f7-0273-413e-abc9-c0974e7fc46b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:57.741784 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf8f11-0106-4619-bf79-c38ddf7ebcff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:57.743633 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf8f11-0106-4619-bf79-c38ddf7ebcff admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:57.746854 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44dd91-6794-4b50-a3d2-c15c7cfa5031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:57.747772 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44dd91-6794-4b50-a3d2-c15c7cfa5031 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.748304 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44dd91-6794-4b50-a3d2-c15c7cfa5031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.748794 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44dd91-6794-4b50-a3d2-c15c7cfa5031 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.749726 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44dd91-6794-4b50-a3d2-c15c7cfa5031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:57.750282 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44dd91-6794-4b50-a3d2-c15c7cfa5031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:57.752210 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44dd91-6794-4b50-a3d2-c15c7cfa5031 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:57.765628 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 353/700] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:57.769559 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-6dcf8f11-0106-4619-bf79-c38ddf7ebcff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:57.770856 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 348/701] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:03:57.772189 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44dd91-6794-4b50-a3d2-c15c7cfa5031 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:57.780914 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf8f11-0106-4619-bf79-c38ddf7ebcff admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:57.783731 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44dd91-6794-4b50-a3d2-c15c7cfa5031 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:57.789118 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf8035-8de9-4371-9210-af9079293159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:57.790445 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf8035-8de9-4371-9210-af9079293159 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.790934 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf8035-8de9-4371-9210-af9079293159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.791436 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf8035-8de9-4371-9210-af9079293159 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.791558 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf8f11-0106-4619-bf79-c38ddf7ebcff admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:57.799954 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf8035-8de9-4371-9210-af9079293159 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:57.803661 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf8035-8de9-4371-9210-af9079293159 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:57.810046 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db597a15-248b-4aa1-be23-435fc4a59f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:57.810714 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db597a15-248b-4aa1-be23-435fc4a59f57 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.810998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db597a15-248b-4aa1-be23-435fc4a59f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.811273 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db597a15-248b-4aa1-be23-435fc4a59f57 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.812037 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db597a15-248b-4aa1-be23-435fc4a59f57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:57.812344 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db597a15-248b-4aa1-be23-435fc4a59f57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:57.813934 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db597a15-248b-4aa1-be23-435fc4a59f57 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:57.822610 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-9fcf8035-8de9-4371-9210-af9079293159 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:03:57.824493 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 354/702] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:57.830108 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf8035-8de9-4371-9210-af9079293159 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:57.835238 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 349/703] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:57.841036 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db597a15-248b-4aa1-be23-435fc4a59f57 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:57.841941 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf8035-8de9-4371-9210-af9079293159 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:57.847098 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42618e-c248-43cb-bb44-cefbac9da657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:57.848199 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42618e-c248-43cb-bb44-cefbac9da657 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.848775 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42618e-c248-43cb-bb44-cefbac9da657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.849877 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42618e-c248-43cb-bb44-cefbac9da657 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.850966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42618e-c248-43cb-bb44-cefbac9da657 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:57.851545 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42618e-c248-43cb-bb44-cefbac9da657 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:57.853758 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42618e-c248-43cb-bb44-cefbac9da657 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:57.854260 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db597a15-248b-4aa1-be23-435fc4a59f57 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:57.869111 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 355/704] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:03:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:03:57.874812 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94b93a-1ebd-4a85-b703-c56ee88ce0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:57.875498 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42618e-c248-43cb-bb44-cefbac9da657 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:57.875607 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94b93a-1ebd-4a85-b703-c56ee88ce0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.875900 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94b93a-1ebd-4a85-b703-c56ee88ce0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.876179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94b93a-1ebd-4a85-b703-c56ee88ce0c4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.886231 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42618e-c248-43cb-bb44-cefbac9da657 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:57.891079 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1ab83-41a4-4fba-8355-c3950ad133d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:57.892007 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1ab83-41a4-4fba-8355-c3950ad133d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.892523 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1ab83-41a4-4fba-8355-c3950ad133d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.892998 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1ab83-41a4-4fba-8355-c3950ad133d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.894031 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1ab83-41a4-4fba-8355-c3950ad133d1 admin admin] RBAC: Adding query filter params (role.id=9924d70543a845cdb7643026789244c3, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=ce55b64dc528447993e32b00ae4d3a2a) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:57.894545 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1ab83-41a4-4fba-8355-c3950ad133d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:57.895947 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94b93a-1ebd-4a85-b703-c56ee88ce0c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:57.896877 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1ab83-41a4-4fba-8355-c3950ad133d1 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:57.898276 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94b93a-1ebd-4a85-b703-c56ee88ce0c4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:57.903626 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 356/705] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:57 2022] GET /identity/v3/role_assignments?user.id=ce55b64dc528447993e32b00ae4d3a2a&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=9924d70543a845cdb7643026789244c3 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:57.920382 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-ba94b93a-1ebd-4a85-b703-c56ee88ce0c4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 23:03:57.922033 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 350/706] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Feb 10 23:03:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:57.928297 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1ab83-41a4-4fba-8355-c3950ad133d1 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:57.946505 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1ab83-41a4-4fba-8355-c3950ad133d1 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:57.960701 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34da975-9829-4496-8bc3-b90eb70b7554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:57.961748 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34da975-9829-4496-8bc3-b90eb70b7554 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:57.962232 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34da975-9829-4496-8bc3-b90eb70b7554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:57.962732 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34da975-9829-4496-8bc3-b90eb70b7554 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:57.963852 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34da975-9829-4496-8bc3-b90eb70b7554 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:57.964364 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34da975-9829-4496-8bc3-b90eb70b7554 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:57.966402 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34da975-9829-4496-8bc3-b90eb70b7554 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:57.994196 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 357/707] 10.222.0.77 () {56 vars in 1154 bytes} [Thu Feb 10 23:03:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:57.999425 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94b93a-1ebd-4a85-b703-c56ee88ce0c4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:58.022332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94b93a-1ebd-4a85-b703-c56ee88ce0c4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:58.027094 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a864f10-298a-4e34-9ddc-92145b5e5109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:58.027753 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a864f10-298a-4e34-9ddc-92145b5e5109 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:58.028066 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a864f10-298a-4e34-9ddc-92145b5e5109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:58.028338 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a864f10-298a-4e34-9ddc-92145b5e5109 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:58.045204 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a864f10-298a-4e34-9ddc-92145b5e5109 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:58.046979 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a864f10-298a-4e34-9ddc-92145b5e5109 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:58.057957 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 351/708] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:58.063277 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34da975-9829-4496-8bc3-b90eb70b7554 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:58.077269 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34da975-9829-4496-8bc3-b90eb70b7554 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:58.083606 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb85149-f587-42d6-bf94-4581bf591b35 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:58.084432 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb85149-f587-42d6-bf94-4581bf591b35 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:58.084717 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb85149-f587-42d6-bf94-4581bf591b35 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:58.086803 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 352/709] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:03:58.092176 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb6266-cb75-404a-a05d-6ccf8a53ffae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:58.093115 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118d472-7074-4072-8075-d7f371650c57 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:58.093327 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb6266-cb75-404a-a05d-6ccf8a53ffae admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:58.093525 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118d472-7074-4072-8075-d7f371650c57 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:58.093874 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118d472-7074-4072-8075-d7f371650c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:58.094046 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb6266-cb75-404a-a05d-6ccf8a53ffae admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:58.094454 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb6266-cb75-404a-a05d-6ccf8a53ffae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:58.120035 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb6266-cb75-404a-a05d-6ccf8a53ffae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:58.122303 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb6266-cb75-404a-a05d-6ccf8a53ffae admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:58.137274 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-7118d472-7074-4072-8075-d7f371650c57 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:58.138707 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-7118d472-7074-4072-8075-d7f371650c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:58.152227 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-becb6266-cb75-404a-a05d-6ccf8a53ffae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:58.157685 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 353/710] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:58.159151 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 358/711] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:58.164321 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118d472-7074-4072-8075-d7f371650c57 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:58.179876 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118d472-7074-4072-8075-d7f371650c57 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:58.186661 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553e7bd-2a93-4602-ae3e-1daf8f5374d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:58.188643 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb6266-cb75-404a-a05d-6ccf8a53ffae admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:58.192129 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553e7bd-2a93-4602-ae3e-1daf8f5374d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:58.192643 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553e7bd-2a93-4602-ae3e-1daf8f5374d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:58.193682 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553e7bd-2a93-4602-ae3e-1daf8f5374d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:58.194654 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553e7bd-2a93-4602-ae3e-1daf8f5374d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:58.195110 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553e7bd-2a93-4602-ae3e-1daf8f5374d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:58.197071 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553e7bd-2a93-4602-ae3e-1daf8f5374d8 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:58.200326 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb6266-cb75-404a-a05d-6ccf8a53ffae admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:58.205520 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd545e11-21ea-4f95-b728-f7cda22deb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:58.207020 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd545e11-21ea-4f95-b728-f7cda22deb43 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:58.207415 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd545e11-21ea-4f95-b728-f7cda22deb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:58.207792 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd545e11-21ea-4f95-b728-f7cda22deb43 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:58.208671 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd545e11-21ea-4f95-b728-f7cda22deb43 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:58.210441 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING py.warnings [None req-cd545e11-21ea-4f95-b728-f7cda22deb43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:03:58.210441 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: warnings.warn(msg) Feb 10 23:03:58.210441 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: Feb 10 23:03:58.212377 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd545e11-21ea-4f95-b728-f7cda22deb43 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:58.215201 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 354/712] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:58.222970 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553e7bd-2a93-4602-ae3e-1daf8f5374d8 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:58.232372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-cd545e11-21ea-4f95-b728-f7cda22deb43 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 10 23:03:58.234358 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 359/713] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:58 2022] GET /identity/v3/services/network => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:58.242044 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553e7bd-2a93-4602-ae3e-1daf8f5374d8 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:58.244150 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd545e11-21ea-4f95-b728-f7cda22deb43 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:58.251261 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321a7f0-baf1-441d-848a-410a2f33dafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:58.252162 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321a7f0-baf1-441d-848a-410a2f33dafa admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:58.252458 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321a7f0-baf1-441d-848a-410a2f33dafa admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:58.252788 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321a7f0-baf1-441d-848a-410a2f33dafa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:58.256258 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd545e11-21ea-4f95-b728-f7cda22deb43 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:58.261979 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac30127-c0f4-48d8-89ab-b4bb168887fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:58.262972 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac30127-c0f4-48d8-89ab-b4bb168887fb admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:58.263141 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321a7f0-baf1-441d-848a-410a2f33dafa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:58.263755 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac30127-c0f4-48d8-89ab-b4bb168887fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:58.264469 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac30127-c0f4-48d8-89ab-b4bb168887fb admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:58.265716 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321a7f0-baf1-441d-848a-410a2f33dafa admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:58.265937 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac30127-c0f4-48d8-89ab-b4bb168887fb admin admin] RBAC: Adding query filter params (name=network) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:58.266942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac30127-c0f4-48d8-89ab-b4bb168887fb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:58.270080 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac30127-c0f4-48d8-89ab-b4bb168887fb admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:58.276955 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 360/714] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Feb 10 23:03:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:58.288216 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac30127-c0f4-48d8-89ab-b4bb168887fb admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:58.288506 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-e321a7f0-baf1-441d-848a-410a2f33dafa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:03:58.290225 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 355/715] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:58.296734 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321a7f0-baf1-441d-848a-410a2f33dafa admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:58.307168 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac30127-c0f4-48d8-89ab-b4bb168887fb admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:58.307571 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321a7f0-baf1-441d-848a-410a2f33dafa admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:58.313717 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d45ac-793c-437f-8375-834d6be16e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:58.314222 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91cd13-1493-4756-b7fd-dff5cc839c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:58.314877 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d45ac-793c-437f-8375-834d6be16e1c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:58.314997 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91cd13-1493-4756-b7fd-dff5cc839c8c admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:58.315201 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91cd13-1493-4756-b7fd-dff5cc839c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:58.315482 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91cd13-1493-4756-b7fd-dff5cc839c8c admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:58.315968 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d45ac-793c-437f-8375-834d6be16e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:58.316391 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91cd13-1493-4756-b7fd-dff5cc839c8c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:58.316665 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d45ac-793c-437f-8375-834d6be16e1c admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:58.316764 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91cd13-1493-4756-b7fd-dff5cc839c8c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:58.317673 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d45ac-793c-437f-8375-834d6be16e1c admin admin] RBAC: Adding query filter params (type=network) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:58.318904 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d45ac-793c-437f-8375-834d6be16e1c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:58.319397 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91cd13-1493-4756-b7fd-dff5cc839c8c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:58.321575 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d45ac-793c-437f-8375-834d6be16e1c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:58.329148 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 361/716] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Feb 10 23:03:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:58.343976 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 356/717] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:03:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:58.350463 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d45ac-793c-437f-8375-834d6be16e1c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:58.363684 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d45ac-793c-437f-8375-834d6be16e1c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:58.369688 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e639f09-2a80-4bf1-b935-ca43e5b972a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:58.370654 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e639f09-2a80-4bf1-b935-ca43e5b972a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:58.371087 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e639f09-2a80-4bf1-b935-ca43e5b972a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:58.371507 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e639f09-2a80-4bf1-b935-ca43e5b972a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:58.372895 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e639f09-2a80-4bf1-b935-ca43e5b972a9 admin admin] RBAC: Adding query filter params (role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=551da2c9fab74cb8b14287a5634adb25) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:58.373368 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e639f09-2a80-4bf1-b935-ca43e5b972a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:58.375473 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e639f09-2a80-4bf1-b935-ca43e5b972a9 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:58.383567 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 362/718] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:58 2022] GET /identity/v3/role_assignments?user.id=551da2c9fab74cb8b14287a5634adb25&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:59.030611 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64bd61-6c1f-432b-8766-0549987e0a31 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:59.030911 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64bd61-6c1f-432b-8766-0549987e0a31 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:59.031197 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64bd61-6c1f-432b-8766-0549987e0a31 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:59.033261 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 357/719] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:59.045709 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558cb2e-5bad-4e64-b2a6-da82aa3d1bee None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:59.046010 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558cb2e-5bad-4e64-b2a6-da82aa3d1bee None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:59.046295 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558cb2e-5bad-4e64-b2a6-da82aa3d1bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:59.067430 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-6558cb2e-5bad-4e64-b2a6-da82aa3d1bee None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:59.068970 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-6558cb2e-5bad-4e64-b2a6-da82aa3d1bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:59.082257 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 363/720] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 23:03:59.118436 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64bd61-6c1f-432b-8766-0549987e0a31 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:59.136464 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64bd61-6c1f-432b-8766-0549987e0a31 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:59.140928 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8e223-d038-49f2-af30-67d0691697a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:59.141709 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8e223-d038-49f2-af30-67d0691697a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:59.141994 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8e223-d038-49f2-af30-67d0691697a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:59.142273 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8e223-d038-49f2-af30-67d0691697a9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:59.156707 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8e223-d038-49f2-af30-67d0691697a9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:03:59.164224 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-2ca8e223-d038-49f2-af30-67d0691697a9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:03:59.165718 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 358/721] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:03:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:59.171017 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558cb2e-5bad-4e64-b2a6-da82aa3d1bee None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:59.182452 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558cb2e-5bad-4e64-b2a6-da82aa3d1bee None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:59.198508 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a09ab3-2ad3-4dbe-9296-ec1bbd136b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:59.199213 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a09ab3-2ad3-4dbe-9296-ec1bbd136b54 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:59.199519 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a09ab3-2ad3-4dbe-9296-ec1bbd136b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:59.199777 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a09ab3-2ad3-4dbe-9296-ec1bbd136b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:59.200589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a09ab3-2ad3-4dbe-9296-ec1bbd136b54 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:59.200898 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a09ab3-2ad3-4dbe-9296-ec1bbd136b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:59.202541 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a09ab3-2ad3-4dbe-9296-ec1bbd136b54 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:59.216830 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 364/722] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:03:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:59.221803 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8e223-d038-49f2-af30-67d0691697a9 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:59.232600 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8e223-d038-49f2-af30-67d0691697a9 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:59.244812 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0302ed3-f4f5-41a9-b775-f49a22350ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:59.245604 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0302ed3-f4f5-41a9-b775-f49a22350ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:59.245889 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0302ed3-f4f5-41a9-b775-f49a22350ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:59.246164 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0302ed3-f4f5-41a9-b775-f49a22350ef7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:59.261700 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0302ed3-f4f5-41a9-b775-f49a22350ef7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:59.263534 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0302ed3-f4f5-41a9-b775-f49a22350ef7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:59.287979 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-f0302ed3-f4f5-41a9-b775-f49a22350ef7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:59.289449 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 359/723] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:59.294559 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a09ab3-2ad3-4dbe-9296-ec1bbd136b54 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:59.307973 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a09ab3-2ad3-4dbe-9296-ec1bbd136b54 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:59.315572 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf4a0d-63c6-4f6f-a44b-dbef549a85af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:59.316299 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf4a0d-63c6-4f6f-a44b-dbef549a85af admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:59.316584 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf4a0d-63c6-4f6f-a44b-dbef549a85af admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:59.316860 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf4a0d-63c6-4f6f-a44b-dbef549a85af admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:59.317705 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf4a0d-63c6-4f6f-a44b-dbef549a85af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:59.318567 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf4a0d-63c6-4f6f-a44b-dbef549a85af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:59.320815 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf4a0d-63c6-4f6f-a44b-dbef549a85af admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:59.337900 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 365/724] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:59.343208 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0302ed3-f4f5-41a9-b775-f49a22350ef7 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:59.355019 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0302ed3-f4f5-41a9-b775-f49a22350ef7 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:59.360388 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e07e6c-0c8a-457f-b845-f8f4d44cfcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:59.361503 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e07e6c-0c8a-457f-b845-f8f4d44cfcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:59.361843 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e07e6c-0c8a-457f-b845-f8f4d44cfcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:59.362114 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e07e6c-0c8a-457f-b845-f8f4d44cfcf1 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:59.372575 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e07e6c-0c8a-457f-b845-f8f4d44cfcf1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:59.374649 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e07e6c-0c8a-457f-b845-f8f4d44cfcf1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:59.395973 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-07e07e6c-0c8a-457f-b845-f8f4d44cfcf1 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 10 23:03:59.398284 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 360/725] 10.222.0.77 () {56 vars in 1138 bytes} [Thu Feb 10 23:03:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:59.403742 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf4a0d-63c6-4f6f-a44b-dbef549a85af admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:59.414619 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf4a0d-63c6-4f6f-a44b-dbef549a85af admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:59.424075 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa3a2b-f1d8-435a-af7a-67670e799ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:59.424787 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa3a2b-f1d8-435a-af7a-67670e799ecc admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:59.425076 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa3a2b-f1d8-435a-af7a-67670e799ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:59.425378 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa3a2b-f1d8-435a-af7a-67670e799ecc admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:59.426220 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa3a2b-f1d8-435a-af7a-67670e799ecc admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:59.426530 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa3a2b-f1d8-435a-af7a-67670e799ecc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:59.429372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa3a2b-f1d8-435a-af7a-67670e799ecc admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:59.453114 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 366/726] 10.222.0.77 () {56 vars in 1170 bytes} [Thu Feb 10 23:03:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:59.458269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e07e6c-0c8a-457f-b845-f8f4d44cfcf1 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:59.472747 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e07e6c-0c8a-457f-b845-f8f4d44cfcf1 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:59.481400 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3bab9-1abe-4881-bf53-8f2d4c93add7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:59.482057 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3bab9-1abe-4881-bf53-8f2d4c93add7 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:59.482339 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3bab9-1abe-4881-bf53-8f2d4c93add7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:59.482611 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3bab9-1abe-4881-bf53-8f2d4c93add7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:59.489518 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5313c-93b2-4835-ad48-a28cee6190e0 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:59.489838 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5313c-93b2-4835-ad48-a28cee6190e0 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:59.490104 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5313c-93b2-4835-ad48-a28cee6190e0 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:59.492294 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 367/727] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:03:59.495850 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3bab9-1abe-4881-bf53-8f2d4c93add7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:59.497671 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3bab9-1abe-4881-bf53-8f2d4c93add7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:59.497791 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72636299-13d5-4a7c-888e-e7f843794dad None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:59.497988 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72636299-13d5-4a7c-888e-e7f843794dad None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:59.498266 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72636299-13d5-4a7c-888e-e7f843794dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:59.524916 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-72636299-13d5-4a7c-888e-e7f843794dad None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:03:59.526105 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-72636299-13d5-4a7c-888e-e7f843794dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:03:59.527183 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 361/728] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:03:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:03:59.528101 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3bab9-1abe-4881-bf53-8f2d4c93add7 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:59.539226 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3bab9-1abe-4881-bf53-8f2d4c93add7 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:59.544571 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 368/729] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:03:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 23:03:59.555055 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b98a5-c9ff-4587-9fd3-df0073b38013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:59.555850 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b98a5-c9ff-4587-9fd3-df0073b38013 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:59.556141 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b98a5-c9ff-4587-9fd3-df0073b38013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:59.556412 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b98a5-c9ff-4587-9fd3-df0073b38013 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:59.570322 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b98a5-c9ff-4587-9fd3-df0073b38013 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:59.572169 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b98a5-c9ff-4587-9fd3-df0073b38013 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:59.594121 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-f66b98a5-c9ff-4587-9fd3-df0073b38013 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:03:59.595593 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 362/730] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:59.601636 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72636299-13d5-4a7c-888e-e7f843794dad None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:59.613041 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b98a5-c9ff-4587-9fd3-df0073b38013 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:59.619054 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72636299-13d5-4a7c-888e-e7f843794dad None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:59.624020 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b98a5-c9ff-4587-9fd3-df0073b38013 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:59.625141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dc5db-37e3-45c0-859f-2fd7ef1f1c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:59.626307 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dc5db-37e3-45c0-859f-2fd7ef1f1c49 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:59.626914 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dc5db-37e3-45c0-859f-2fd7ef1f1c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:59.627563 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dc5db-37e3-45c0-859f-2fd7ef1f1c49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:59.628517 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23deb296-f076-4bf6-a24f-b004dfdd7556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:59.628917 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47dc5db-37e3-45c0-859f-2fd7ef1f1c49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:59.629159 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23deb296-f076-4bf6-a24f-b004dfdd7556 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:59.629439 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23deb296-f076-4bf6-a24f-b004dfdd7556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:59.634702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23deb296-f076-4bf6-a24f-b004dfdd7556 admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:59.634702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23deb296-f076-4bf6-a24f-b004dfdd7556 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:59.634702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING py.warnings [None req-23deb296-f076-4bf6-a24f-b004dfdd7556 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:03:59.634702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: warnings.warn(msg) Feb 10 23:03:59.634702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: Feb 10 23:03:59.634702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23deb296-f076-4bf6-a24f-b004dfdd7556 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:59.635575 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47dc5db-37e3-45c0-859f-2fd7ef1f1c49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:59.638261 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47dc5db-37e3-45c0-859f-2fd7ef1f1c49 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:59.661015 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 363/731] 10.222.0.77 () {60 vars in 1162 bytes} [Thu Feb 10 23:03:59 2022] POST /identity/v3/services => generated 251 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:03:59.671833 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 369/732] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:59.678536 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23deb296-f076-4bf6-a24f-b004dfdd7556 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:59.704474 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23deb296-f076-4bf6-a24f-b004dfdd7556 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:59.713299 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fa0b8-a42b-4ed4-94c1-7b98d5807622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:59.714105 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fa0b8-a42b-4ed4-94c1-7b98d5807622 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:59.714387 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fa0b8-a42b-4ed4-94c1-7b98d5807622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:59.714656 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fa0b8-a42b-4ed4-94c1-7b98d5807622 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:59.723224 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fa0b8-a42b-4ed4-94c1-7b98d5807622 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:59.726134 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fa0b8-a42b-4ed4-94c1-7b98d5807622 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:59.746841 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-f67fa0b8-a42b-4ed4-94c1-7b98d5807622 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:03:59.748489 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 364/733] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:03:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:03:59.754260 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dc5db-37e3-45c0-859f-2fd7ef1f1c49 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:59.765046 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dc5db-37e3-45c0-859f-2fd7ef1f1c49 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:59.769647 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25b7b7-7a5d-41cc-ad12-1dfca262838b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:59.770315 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25b7b7-7a5d-41cc-ad12-1dfca262838b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:59.770598 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25b7b7-7a5d-41cc-ad12-1dfca262838b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:59.770873 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25b7b7-7a5d-41cc-ad12-1dfca262838b admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:59.772302 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25b7b7-7a5d-41cc-ad12-1dfca262838b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:59.772665 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25b7b7-7a5d-41cc-ad12-1dfca262838b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:59.774493 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25b7b7-7a5d-41cc-ad12-1dfca262838b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:59.789157 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 370/734] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:03:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:03:59.803349 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fa0b8-a42b-4ed4-94c1-7b98d5807622 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:03:59.814101 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fa0b8-a42b-4ed4-94c1-7b98d5807622 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:03:59.824430 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02930c-b995-4401-a696-c785d62c0020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:03:59.825102 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02930c-b995-4401-a696-c785d62c0020 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:03:59.825382 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02930c-b995-4401-a696-c785d62c0020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:03:59.825656 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02930c-b995-4401-a696-c785d62c0020 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:03:59.826506 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02930c-b995-4401-a696-c785d62c0020 admin admin] RBAC: Adding query filter params (role.id=9924d70543a845cdb7643026789244c3, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=9dca4ea4f2c8490e823a73dca6c303ed) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:03:59.826814 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02930c-b995-4401-a696-c785d62c0020 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:03:59.828830 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02930c-b995-4401-a696-c785d62c0020 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:03:59.836257 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 365/735] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:03:59 2022] GET /identity/v3/role_assignments?user.id=9dca4ea4f2c8490e823a73dca6c303ed&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=9924d70543a845cdb7643026789244c3 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:01.038873 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e02bbc-8b32-4fcf-994d-1b421dc3e55d None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.039439 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e02bbc-8b32-4fcf-994d-1b421dc3e55d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.039439 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e02bbc-8b32-4fcf-994d-1b421dc3e55d None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.041513 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 371/736] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:01.046427 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8ea48-1137-40db-adcc-069ed5aeb47d None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.046863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8ea48-1137-40db-adcc-069ed5aeb47d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.047033 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8ea48-1137-40db-adcc-069ed5aeb47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.072993 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-c0a8ea48-1137-40db-adcc-069ed5aeb47d None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:01.074204 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-c0a8ea48-1137-40db-adcc-069ed5aeb47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:01.096087 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 366/737] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:01 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:01.131775 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e02bbc-8b32-4fcf-994d-1b421dc3e55d None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.149651 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e02bbc-8b32-4fcf-994d-1b421dc3e55d None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.154113 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc6737-1680-42db-aa1f-aa1087e9168e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.154894 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc6737-1680-42db-aa1f-aa1087e9168e admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.155177 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc6737-1680-42db-aa1f-aa1087e9168e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.155451 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc6737-1680-42db-aa1f-aa1087e9168e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.173427 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc6737-1680-42db-aa1f-aa1087e9168e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:04:01.180964 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-9fcc6737-1680-42db-aa1f-aa1087e9168e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:04:01.183175 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 372/738] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:04:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:01.187794 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8ea48-1137-40db-adcc-069ed5aeb47d None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.196916 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8ea48-1137-40db-adcc-069ed5aeb47d None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.203936 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeeb923-5615-45f4-8f04-c1c4eee22c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.204601 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeb923-5615-45f4-8f04-c1c4eee22c62 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.204882 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeb923-5615-45f4-8f04-c1c4eee22c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.205152 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeb923-5615-45f4-8f04-c1c4eee22c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.205910 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeeb923-5615-45f4-8f04-c1c4eee22c62 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:01.206207 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeeb923-5615-45f4-8f04-c1c4eee22c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:01.207782 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeeb923-5615-45f4-8f04-c1c4eee22c62 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:01.217109 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 367/739] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:04:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:01.228884 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc6737-1680-42db-aa1f-aa1087e9168e admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.239293 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc6737-1680-42db-aa1f-aa1087e9168e admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.248037 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18250b-b985-405d-a9b1-dca0cbe7c01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.248833 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18250b-b985-405d-a9b1-dca0cbe7c01c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.249115 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18250b-b985-405d-a9b1-dca0cbe7c01c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.249391 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18250b-b985-405d-a9b1-dca0cbe7c01c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.257777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95126ac7-2e1d-4264-a760-29929f44aa5b None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.257777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95126ac7-2e1d-4264-a760-29929f44aa5b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.257777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95126ac7-2e1d-4264-a760-29929f44aa5b None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.258584 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 368/740] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:04:01.265180 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18250b-b985-405d-a9b1-dca0cbe7c01c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:01.265925 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43317a74-153f-4e83-ab4b-97aec7d3df77 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.266424 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43317a74-153f-4e83-ab4b-97aec7d3df77 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.266909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43317a74-153f-4e83-ab4b-97aec7d3df77 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.267081 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18250b-b985-405d-a9b1-dca0cbe7c01c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:01.269580 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 369/741] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:01.270847 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa6659-6a85-4428-860d-1045b1a807bb None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.272182 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa6659-6a85-4428-860d-1045b1a807bb None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.272666 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa6659-6a85-4428-860d-1045b1a807bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.289730 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-6e18250b-b985-405d-a9b1-dca0cbe7c01c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:01.291231 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 373/742] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:01.292573 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a89df-2989-486c-b7e0-526eb6d8e857 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.292856 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a89df-2989-486c-b7e0-526eb6d8e857 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.293133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a89df-2989-486c-b7e0-526eb6d8e857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.293735 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-e3aa6659-6a85-4428-860d-1045b1a807bb None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:01.295324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e3aa6659-6a85-4428-860d-1045b1a807bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:01.304003 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 370/743] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:01 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:01.305129 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa6659-6a85-4428-860d-1045b1a807bb None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.314847 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa6659-6a85-4428-860d-1045b1a807bb None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.319771 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce1aba-fdc4-408a-8751-cc9d59371e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.320719 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce1aba-fdc4-408a-8751-cc9d59371e0d admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.321204 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce1aba-fdc4-408a-8751-cc9d59371e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.321678 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce1aba-fdc4-408a-8751-cc9d59371e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.321782 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-599a89df-2989-486c-b7e0-526eb6d8e857 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:01.322698 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce1aba-fdc4-408a-8751-cc9d59371e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:01.322931 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-599a89df-2989-486c-b7e0-526eb6d8e857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:01.323428 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce1aba-fdc4-408a-8751-cc9d59371e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:01.325335 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce1aba-fdc4-408a-8751-cc9d59371e0d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:01.337900 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 374/744] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:01 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:01.344179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 371/745] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:01.350044 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a89df-2989-486c-b7e0-526eb6d8e857 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.351134 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce1aba-fdc4-408a-8751-cc9d59371e0d admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.360178 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a89df-2989-486c-b7e0-526eb6d8e857 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.366105 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b85c8e-acd7-44b9-adb5-642341df8d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.366736 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b85c8e-acd7-44b9-adb5-642341df8d03 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.367021 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b85c8e-acd7-44b9-adb5-642341df8d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.367296 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b85c8e-acd7-44b9-adb5-642341df8d03 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.371492 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce1aba-fdc4-408a-8751-cc9d59371e0d admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.379100 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b85c8e-acd7-44b9-adb5-642341df8d03 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:04:01.383966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b4d19-f6da-4724-9484-053e29be5cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.385082 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b4d19-f6da-4724-9484-053e29be5cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.385605 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b4d19-f6da-4724-9484-053e29be5cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.386090 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b4d19-f6da-4724-9484-053e29be5cb3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.386505 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-71b85c8e-acd7-44b9-adb5-642341df8d03 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:04:01.391949 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 375/746] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:04:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:01.392755 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b85c8e-acd7-44b9-adb5-642341df8d03 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.395998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b4d19-f6da-4724-9484-053e29be5cb3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:01.398744 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b4d19-f6da-4724-9484-053e29be5cb3 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:01.402958 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b85c8e-acd7-44b9-adb5-642341df8d03 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.407626 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd3b8d-249d-45e5-8b5f-323a6670b4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.408280 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd3b8d-249d-45e5-8b5f-323a6670b4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.408559 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd3b8d-249d-45e5-8b5f-323a6670b4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.408834 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd3b8d-249d-45e5-8b5f-323a6670b4a4 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.409563 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd3b8d-249d-45e5-8b5f-323a6670b4a4 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:01.410565 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING py.warnings [None req-e1bd3b8d-249d-45e5-8b5f-323a6670b4a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:04:01.410565 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: warnings.warn(msg) Feb 10 23:04:01.410565 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: Feb 10 23:04:01.411435 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd3b8d-249d-45e5-8b5f-323a6670b4a4 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:01.417852 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-8c4b4d19-f6da-4724-9484-053e29be5cb3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 23:04:01.419620 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 372/747] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Feb 10 23:04:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:04:01.425279 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b4d19-f6da-4724-9484-053e29be5cb3 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.432354 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 376/748] 10.222.0.77 () {60 vars in 1162 bytes} [Thu Feb 10 23:04:01 2022] POST /identity/v3/services => generated 240 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:04:01.433475 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd3b8d-249d-45e5-8b5f-323a6670b4a4 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.447399 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b4d19-f6da-4724-9484-053e29be5cb3 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.468240 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28125533-02d0-4c1e-b989-f75132b30a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.469229 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28125533-02d0-4c1e-b989-f75132b30a72 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.469765 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28125533-02d0-4c1e-b989-f75132b30a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.470223 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28125533-02d0-4c1e-b989-f75132b30a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.471215 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28125533-02d0-4c1e-b989-f75132b30a72 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:01.471702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28125533-02d0-4c1e-b989-f75132b30a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:01.473792 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28125533-02d0-4c1e-b989-f75132b30a72 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:01.485629 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 373/749] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:04:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:01.507902 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd3b8d-249d-45e5-8b5f-323a6670b4a4 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.509451 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28125533-02d0-4c1e-b989-f75132b30a72 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.517131 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff894e-dc44-4deb-9497-0cee56b511e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.518667 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff894e-dc44-4deb-9497-0cee56b511e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.520376 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff894e-dc44-4deb-9497-0cee56b511e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.520850 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff894e-dc44-4deb-9497-0cee56b511e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.524513 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff894e-dc44-4deb-9497-0cee56b511e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:01.525054 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff894e-dc44-4deb-9497-0cee56b511e7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:01.528077 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff894e-dc44-4deb-9497-0cee56b511e7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:01.532016 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28125533-02d0-4c1e-b989-f75132b30a72 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.544480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf0e41-fe70-4cd6-bac2-aa276f74c4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.545674 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf0e41-fe70-4cd6-bac2-aa276f74c4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.546720 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf0e41-fe70-4cd6-bac2-aa276f74c4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.547323 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf0e41-fe70-4cd6-bac2-aa276f74c4b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.573570 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 377/750] 10.222.0.77 () {56 vars in 1154 bytes} [Thu Feb 10 23:04:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:01.573884 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf0e41-fe70-4cd6-bac2-aa276f74c4b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:01.576120 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf0e41-fe70-4cd6-bac2-aa276f74c4b1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:01.579673 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff894e-dc44-4deb-9497-0cee56b511e7 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.596908 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff894e-dc44-4deb-9497-0cee56b511e7 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.602767 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-86cf0e41-fe70-4cd6-bac2-aa276f74c4b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:01.604608 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 374/751] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:01.610459 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf0e41-fe70-4cd6-bac2-aa276f74c4b1 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.615078 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dafc90-91c8-4dff-9bdf-2640b227ccdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.617726 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dafc90-91c8-4dff-9bdf-2640b227ccdb admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.618205 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dafc90-91c8-4dff-9bdf-2640b227ccdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.618628 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dafc90-91c8-4dff-9bdf-2640b227ccdb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.627284 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf0e41-fe70-4cd6-bac2-aa276f74c4b1 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.634964 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dafc90-91c8-4dff-9bdf-2640b227ccdb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:01.637150 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dafc90-91c8-4dff-9bdf-2640b227ccdb admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:01.638545 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb377bb4-4cae-44a9-ae21-796c1df3e33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.638672 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb377bb4-4cae-44a9-ae21-796c1df3e33a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.638935 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb377bb4-4cae-44a9-ae21-796c1df3e33a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.639219 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb377bb4-4cae-44a9-ae21-796c1df3e33a admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.639973 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb377bb4-4cae-44a9-ae21-796c1df3e33a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:01.640285 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb377bb4-4cae-44a9-ae21-796c1df3e33a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:01.642101 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb377bb4-4cae-44a9-ae21-796c1df3e33a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:01.656304 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 375/752] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:01.657801 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-59dafc90-91c8-4dff-9bdf-2640b227ccdb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:01.659477 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 378/753] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:04:01.662294 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb377bb4-4cae-44a9-ae21-796c1df3e33a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.666133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dafc90-91c8-4dff-9bdf-2640b227ccdb admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.672342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb377bb4-4cae-44a9-ae21-796c1df3e33a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.676859 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dafc90-91c8-4dff-9bdf-2640b227ccdb admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.679701 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5812b21-5ba3-476c-93d2-76a522f6585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.680993 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5812b21-5ba3-476c-93d2-76a522f6585a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.681459 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5812b21-5ba3-476c-93d2-76a522f6585a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.681565 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad31ea-5d1a-4c59-9866-ca735668eb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.682103 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad31ea-5d1a-4c59-9866-ca735668eb9f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.682225 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5812b21-5ba3-476c-93d2-76a522f6585a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.682387 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad31ea-5d1a-4c59-9866-ca735668eb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.682662 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad31ea-5d1a-4c59-9866-ca735668eb9f admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.683388 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad31ea-5d1a-4c59-9866-ca735668eb9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:01.683708 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad31ea-5d1a-4c59-9866-ca735668eb9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:01.685286 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad31ea-5d1a-4c59-9866-ca735668eb9f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:01.691784 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5812b21-5ba3-476c-93d2-76a522f6585a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:01.694644 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5812b21-5ba3-476c-93d2-76a522f6585a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:01.702615 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 379/754] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:01.703847 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad31ea-5d1a-4c59-9866-ca735668eb9f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.710024 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-f5812b21-5ba3-476c-93d2-76a522f6585a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 10 23:04:01.711551 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 376/755] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:04:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:04:01.713826 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad31ea-5d1a-4c59-9866-ca735668eb9f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.717002 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5812b21-5ba3-476c-93d2-76a522f6585a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.718860 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf500695-3093-4bce-bf27-f797b9cf8d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.719921 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf500695-3093-4bce-bf27-f797b9cf8d4e admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.720401 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf500695-3093-4bce-bf27-f797b9cf8d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.720846 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf500695-3093-4bce-bf27-f797b9cf8d4e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.727763 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5812b21-5ba3-476c-93d2-76a522f6585a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.729608 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf500695-3093-4bce-bf27-f797b9cf8d4e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:01.732278 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf500695-3093-4bce-bf27-f797b9cf8d4e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:01.732489 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115211c-b020-4dff-a2fc-a45486a94fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.732961 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115211c-b020-4dff-a2fc-a45486a94fcc admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.733256 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115211c-b020-4dff-a2fc-a45486a94fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.733528 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115211c-b020-4dff-a2fc-a45486a94fcc admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.734373 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115211c-b020-4dff-a2fc-a45486a94fcc admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:01.734681 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115211c-b020-4dff-a2fc-a45486a94fcc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:01.736778 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115211c-b020-4dff-a2fc-a45486a94fcc admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:01.748932 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-cf500695-3093-4bce-bf27-f797b9cf8d4e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:04:01.754952 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 380/756] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:04:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:01.756298 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 377/757] 10.222.0.77 () {56 vars in 1156 bytes} [Thu Feb 10 23:04:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:01.756701 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf500695-3093-4bce-bf27-f797b9cf8d4e admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.765682 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115211c-b020-4dff-a2fc-a45486a94fcc admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.766933 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf500695-3093-4bce-bf27-f797b9cf8d4e admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.771580 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75681ac-0f06-4e9f-ac14-151d79fb3477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.772651 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75681ac-0f06-4e9f-ac14-151d79fb3477 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.773108 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75681ac-0f06-4e9f-ac14-151d79fb3477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.773541 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75681ac-0f06-4e9f-ac14-151d79fb3477 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.774502 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75681ac-0f06-4e9f-ac14-151d79fb3477 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:01.774978 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75681ac-0f06-4e9f-ac14-151d79fb3477 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:01.777014 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75681ac-0f06-4e9f-ac14-151d79fb3477 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:01.777328 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115211c-b020-4dff-a2fc-a45486a94fcc admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.782130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4187571-119f-4c61-bd36-e6c655b38ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.782841 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4187571-119f-4c61-bd36-e6c655b38ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.783269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4187571-119f-4c61-bd36-e6c655b38ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.783618 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4187571-119f-4c61-bd36-e6c655b38ec3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.794399 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4187571-119f-4c61-bd36-e6c655b38ec3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:01.794719 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4187571-119f-4c61-bd36-e6c655b38ec3 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:01.794887 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 381/758] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:04:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:01.799372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75681ac-0f06-4e9f-ac14-151d79fb3477 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.805920 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 378/759] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:04:01 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:04:01.810891 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75681ac-0f06-4e9f-ac14-151d79fb3477 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.811389 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4187571-119f-4c61-bd36-e6c655b38ec3 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.815983 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864a4c6-9713-473b-9ed0-3a19f56d9168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.817704 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864a4c6-9713-473b-9ed0-3a19f56d9168 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.819002 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864a4c6-9713-473b-9ed0-3a19f56d9168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.819455 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864a4c6-9713-473b-9ed0-3a19f56d9168 admin admin] PATH_INFO: `/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/551da2c9fab74cb8b14287a5634adb25/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.821082 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4187571-119f-4c61-bd36-e6c655b38ec3 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.822017 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864a4c6-9713-473b-9ed0-3a19f56d9168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ab195cc240497c9ac12843d738c4b9, user_id=551da2c9fab74cb8b14287a5634adb25, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:01.825319 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864a4c6-9713-473b-9ed0-3a19f56d9168 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:01.827853 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f551bb-3fc0-4d5e-ad8e-aa58b3aa0bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.828644 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f551bb-3fc0-4d5e-ad8e-aa58b3aa0bfb admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.828920 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f551bb-3fc0-4d5e-ad8e-aa58b3aa0bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.829195 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f551bb-3fc0-4d5e-ad8e-aa58b3aa0bfb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.852533 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 382/760] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:04:01 2022] PUT /identity/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/551da2c9fab74cb8b14287a5634adb25/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:04:01.853439 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f551bb-3fc0-4d5e-ad8e-aa58b3aa0bfb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:01.855346 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f551bb-3fc0-4d5e-ad8e-aa58b3aa0bfb admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:01.875748 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-a1f551bb-3fc0-4d5e-ad8e-aa58b3aa0bfb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:01.877307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 379/761] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:04:01.883625 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864a4c6-9713-473b-9ed0-3a19f56d9168 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.952066 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864a4c6-9713-473b-9ed0-3a19f56d9168 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:01.956741 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28bc41-11c9-47fb-aa1a-c1d478fa3da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:01.957410 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28bc41-11c9-47fb-aa1a-c1d478fa3da5 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:01.957714 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28bc41-11c9-47fb-aa1a-c1d478fa3da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:01.957961 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28bc41-11c9-47fb-aa1a-c1d478fa3da5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:01.959264 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28bc41-11c9-47fb-aa1a-c1d478fa3da5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:01.959832 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28bc41-11c9-47fb-aa1a-c1d478fa3da5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:01.961513 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28bc41-11c9-47fb-aa1a-c1d478fa3da5 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:01.974884 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 383/762] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:01.981087 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f551bb-3fc0-4d5e-ad8e-aa58b3aa0bfb admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:01.992343 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f551bb-3fc0-4d5e-ad8e-aa58b3aa0bfb admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:02.001316 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b55a0-a03f-4cd4-ace3-001548679fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:02.002173 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b55a0-a03f-4cd4-ace3-001548679fce admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:02.002457 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b55a0-a03f-4cd4-ace3-001548679fce admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:02.002733 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b55a0-a03f-4cd4-ace3-001548679fce admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:02.012603 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b55a0-a03f-4cd4-ace3-001548679fce admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:02.014746 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b55a0-a03f-4cd4-ace3-001548679fce admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:02.034952 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-288b55a0-a03f-4cd4-ace3-001548679fce admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:04:02.040700 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 380/763] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:04:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:02.046456 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28bc41-11c9-47fb-aa1a-c1d478fa3da5 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:02.057838 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28bc41-11c9-47fb-aa1a-c1d478fa3da5 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:02.068635 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbec3e-cbe9-402e-8722-a0455bd6c8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:02.069416 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbec3e-cbe9-402e-8722-a0455bd6c8ff admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:02.069704 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbec3e-cbe9-402e-8722-a0455bd6c8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:02.069982 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbec3e-cbe9-402e-8722-a0455bd6c8ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:02.070857 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbec3e-cbe9-402e-8722-a0455bd6c8ff admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:02.071169 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbec3e-cbe9-402e-8722-a0455bd6c8ff admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:02.073224 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbec3e-cbe9-402e-8722-a0455bd6c8ff admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:02.092120 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 384/764] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:04:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:02.098180 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b55a0-a03f-4cd4-ace3-001548679fce admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:02.113919 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b55a0-a03f-4cd4-ace3-001548679fce admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:02.124167 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf7fab-a086-4122-979f-7e7c71073f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:02.124832 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf7fab-a086-4122-979f-7e7c71073f9f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:02.125114 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf7fab-a086-4122-979f-7e7c71073f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:02.125391 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf7fab-a086-4122-979f-7e7c71073f9f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:02.126248 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf7fab-a086-4122-979f-7e7c71073f9f admin admin] RBAC: Adding query filter params (role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=ce55b64dc528447993e32b00ae4d3a2a) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:02.126557 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf7fab-a086-4122-979f-7e7c71073f9f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:02.128433 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf7fab-a086-4122-979f-7e7c71073f9f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:02.136208 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 381/765] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:04:02 2022] GET /identity/v3/role_assignments?user.id=ce55b64dc528447993e32b00ae4d3a2a&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:02.716046 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76917b4-2af0-42df-b216-44868b0ddf1c None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:02.716369 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76917b4-2af0-42df-b216-44868b0ddf1c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:02.716607 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76917b4-2af0-42df-b216-44868b0ddf1c None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:02.718686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 385/766] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:02.724098 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a163d-69b8-4684-9729-860f28cb5715 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:02.724936 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a163d-69b8-4684-9729-860f28cb5715 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:02.725213 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a163d-69b8-4684-9729-860f28cb5715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:02.743550 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-7f8a163d-69b8-4684-9729-860f28cb5715 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:02.744837 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-7f8a163d-69b8-4684-9729-860f28cb5715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:02.752547 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 382/767] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:02 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:02.776390 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76917b4-2af0-42df-b216-44868b0ddf1c None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:02.788883 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76917b4-2af0-42df-b216-44868b0ddf1c None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:02.801277 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11dc44-a1f0-44d7-a8e7-3c16f8ddf1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:02.802072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11dc44-a1f0-44d7-a8e7-3c16f8ddf1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:02.802889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11dc44-a1f0-44d7-a8e7-3c16f8ddf1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:02.803162 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11dc44-a1f0-44d7-a8e7-3c16f8ddf1d9 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:02.803842 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11dc44-a1f0-44d7-a8e7-3c16f8ddf1d9 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:02.805434 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11dc44-a1f0-44d7-a8e7-3c16f8ddf1d9 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:02.813843 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4c28c-3ee1-48b0-9838-3970c1e31178 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:02.814135 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4c28c-3ee1-48b0-9838-3970c1e31178 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:02.814414 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4c28c-3ee1-48b0-9838-3970c1e31178 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:02.816665 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 383/768] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:04:02.823212 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fff3b-1fac-497b-9115-277696e18461 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:02.823496 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fff3b-1fac-497b-9115-277696e18461 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:02.823775 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fff3b-1fac-497b-9115-277696e18461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:02.827363 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-0e11dc44-a1f0-44d7-a8e7-3c16f8ddf1d9 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 10 23:04:02.828807 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 386/769] 10.222.0.77 () {56 vars in 1150 bytes} [Thu Feb 10 23:04:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:02.834380 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11dc44-a1f0-44d7-a8e7-3c16f8ddf1d9 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:02.842431 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-105fff3b-1fac-497b-9115-277696e18461 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:02.843642 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-105fff3b-1fac-497b-9115-277696e18461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:02.852628 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11dc44-a1f0-44d7-a8e7-3c16f8ddf1d9 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:02.853043 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 384/770] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:02 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:04:02.865931 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154307fa-1636-4131-a52c-787ea4e0bfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:02.866584 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154307fa-1636-4131-a52c-787ea4e0bfcc admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:02.866866 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154307fa-1636-4131-a52c-787ea4e0bfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:02.867140 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154307fa-1636-4131-a52c-787ea4e0bfcc admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:02.867875 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154307fa-1636-4131-a52c-787ea4e0bfcc admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:02.875032 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154307fa-1636-4131-a52c-787ea4e0bfcc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:02.875032 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154307fa-1636-4131-a52c-787ea4e0bfcc admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:02.878193 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fff3b-1fac-497b-9115-277696e18461 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:02.880242 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 387/771] 10.222.0.77 () {56 vars in 1145 bytes} [Thu Feb 10 23:04:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:02.886225 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154307fa-1636-4131-a52c-787ea4e0bfcc admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:02.889161 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fff3b-1fac-497b-9115-277696e18461 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:02.901351 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ab648-e9e7-4fa8-939f-41ad16aeddf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:02.902140 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ab648-e9e7-4fa8-939f-41ad16aeddf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:02.902424 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ab648-e9e7-4fa8-939f-41ad16aeddf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:02.904433 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ab648-e9e7-4fa8-939f-41ad16aeddf0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:02.905753 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154307fa-1636-4131-a52c-787ea4e0bfcc admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:02.916263 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f0833-f4c9-4291-9d50-775c2e9f545a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:02.917612 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f0833-f4c9-4291-9d50-775c2e9f545a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:02.917895 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f0833-f4c9-4291-9d50-775c2e9f545a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:02.918387 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f0833-f4c9-4291-9d50-775c2e9f545a admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:02.919885 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f0833-f4c9-4291-9d50-775c2e9f545a admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:02.920255 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f0833-f4c9-4291-9d50-775c2e9f545a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:02.921839 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f0833-f4c9-4291-9d50-775c2e9f545a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:02.924261 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ab648-e9e7-4fa8-939f-41ad16aeddf0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:04:02.931927 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 388/772] 10.222.0.77 () {56 vars in 1145 bytes} [Thu Feb 10 23:04:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:02.932460 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-7b2ab648-e9e7-4fa8-939f-41ad16aeddf0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:04:02.933918 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 385/773] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:04:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:04:02.939501 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f0833-f4c9-4291-9d50-775c2e9f545a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:02.939638 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ab648-e9e7-4fa8-939f-41ad16aeddf0 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:02.950287 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ab648-e9e7-4fa8-939f-41ad16aeddf0 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:02.955708 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82561c14-3ffd-4b47-8001-e1213c3e7f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:02.956445 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82561c14-3ffd-4b47-8001-e1213c3e7f1d admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:02.956729 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82561c14-3ffd-4b47-8001-e1213c3e7f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:02.957003 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82561c14-3ffd-4b47-8001-e1213c3e7f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:02.957820 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82561c14-3ffd-4b47-8001-e1213c3e7f1d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:02.958222 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82561c14-3ffd-4b47-8001-e1213c3e7f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:02.961081 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82561c14-3ffd-4b47-8001-e1213c3e7f1d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:02.961936 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f0833-f4c9-4291-9d50-775c2e9f545a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:02.970837 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 386/774] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:04:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:02.973303 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e9be6-0707-448e-b19d-42007fdf8be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:02.973963 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e9be6-0707-448e-b19d-42007fdf8be9 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:02.974866 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e9be6-0707-448e-b19d-42007fdf8be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:02.975147 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e9be6-0707-448e-b19d-42007fdf8be9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:02.975982 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e9be6-0707-448e-b19d-42007fdf8be9 admin admin] RBAC: Adding query filter params (interface=public, service_id=25aecef75087401ca1ff577b99aff100, region_id=RegionOne) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:02.976600 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e9be6-0707-448e-b19d-42007fdf8be9 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:02.977206 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82561c14-3ffd-4b47-8001-e1213c3e7f1d admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:02.977600 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING py.warnings [None req-b85e9be6-0707-448e-b19d-42007fdf8be9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:04:02.977600 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: warnings.warn(msg) Feb 10 23:04:02.977600 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: Feb 10 23:04:02.978470 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e9be6-0707-448e-b19d-42007fdf8be9 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:02.987012 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 389/775] 10.222.0.77 () {56 vars in 1272 bytes} [Thu Feb 10 23:04:02 2022] GET /identity/v3/endpoints?service_id=25aecef75087401ca1ff577b99aff100&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:02.988210 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82561c14-3ffd-4b47-8001-e1213c3e7f1d admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:02.992913 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e9be6-0707-448e-b19d-42007fdf8be9 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:02.993777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e92af8-83f3-4090-b49b-6b4d69f478a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:02.994494 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e92af8-83f3-4090-b49b-6b4d69f478a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:02.994773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e92af8-83f3-4090-b49b-6b4d69f478a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:02.995044 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e92af8-83f3-4090-b49b-6b4d69f478a2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:03.003629 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e9be6-0707-448e-b19d-42007fdf8be9 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:03.007717 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e92af8-83f3-4090-b49b-6b4d69f478a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:03.009079 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d86b5a-577a-46d5-8516-a06893ec6e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:03.009596 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e92af8-83f3-4090-b49b-6b4d69f478a2 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:03.009768 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d86b5a-577a-46d5-8516-a06893ec6e28 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:03.010048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d86b5a-577a-46d5-8516-a06893ec6e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:03.010324 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d86b5a-577a-46d5-8516-a06893ec6e28 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:03.011072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d86b5a-577a-46d5-8516-a06893ec6e28 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:03.012760 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d86b5a-577a-46d5-8516-a06893ec6e28 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:03.018476 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 390/776] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Feb 10 23:04:02 2022] GET /identity/v3/services => generated 772 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:03.033217 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-79e92af8-83f3-4090-b49b-6b4d69f478a2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:03.034491 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 387/777] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:04:03.045190 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d86b5a-577a-46d5-8516-a06893ec6e28 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:03.061361 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d86b5a-577a-46d5-8516-a06893ec6e28 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:03.070296 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4369d9-c372-45d3-b425-f7279c6406fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:03.070967 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4369d9-c372-45d3-b425-f7279c6406fe admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:03.071302 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4369d9-c372-45d3-b425-f7279c6406fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:03.071582 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4369d9-c372-45d3-b425-f7279c6406fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:03.072367 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4369d9-c372-45d3-b425-f7279c6406fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:03.072704 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4369d9-c372-45d3-b425-f7279c6406fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:03.074356 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4369d9-c372-45d3-b425-f7279c6406fe admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:03.093803 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 391/778] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:03.100152 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e92af8-83f3-4090-b49b-6b4d69f478a2 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:03.114171 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e92af8-83f3-4090-b49b-6b4d69f478a2 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:03.120012 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c074224-6538-463d-b6b0-82aeccbdc6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:03.120842 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c074224-6538-463d-b6b0-82aeccbdc6cc admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:03.121124 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c074224-6538-463d-b6b0-82aeccbdc6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:03.121394 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c074224-6538-463d-b6b0-82aeccbdc6cc admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:03.130214 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c074224-6538-463d-b6b0-82aeccbdc6cc admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:03.132828 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c074224-6538-463d-b6b0-82aeccbdc6cc admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:03.149498 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-6c074224-6538-463d-b6b0-82aeccbdc6cc admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 10 23:04:03.151080 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 388/779] 10.222.0.77 () {56 vars in 1138 bytes} [Thu Feb 10 23:04:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:03.156867 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4369d9-c372-45d3-b425-f7279c6406fe admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:03.170681 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4369d9-c372-45d3-b425-f7279c6406fe admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:03.181290 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017c151-c328-4bb8-a8a7-cc4803a83c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:03.182027 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017c151-c328-4bb8-a8a7-cc4803a83c79 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:03.182311 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017c151-c328-4bb8-a8a7-cc4803a83c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:03.182585 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017c151-c328-4bb8-a8a7-cc4803a83c79 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:03.183500 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017c151-c328-4bb8-a8a7-cc4803a83c79 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:03.183813 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017c151-c328-4bb8-a8a7-cc4803a83c79 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:03.185726 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017c151-c328-4bb8-a8a7-cc4803a83c79 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:03.215757 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 392/780] 10.222.0.77 () {56 vars in 1170 bytes} [Thu Feb 10 23:04:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:03.221269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c074224-6538-463d-b6b0-82aeccbdc6cc admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:03.241564 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c074224-6538-463d-b6b0-82aeccbdc6cc admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:03.252668 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1864c6f-24d7-45ab-a848-99dd1f7d4203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:03.253549 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1864c6f-24d7-45ab-a848-99dd1f7d4203 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:03.253834 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1864c6f-24d7-45ab-a848-99dd1f7d4203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:03.254109 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1864c6f-24d7-45ab-a848-99dd1f7d4203 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:03.265905 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1864c6f-24d7-45ab-a848-99dd1f7d4203 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:03.267741 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1864c6f-24d7-45ab-a848-99dd1f7d4203 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:03.288989 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-c1864c6f-24d7-45ab-a848-99dd1f7d4203 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:03.290482 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 389/781] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:03.296159 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017c151-c328-4bb8-a8a7-cc4803a83c79 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:03.313133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017c151-c328-4bb8-a8a7-cc4803a83c79 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:03.320024 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc8dcf-2a58-411d-92b4-c98e32c04436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:03.320746 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc8dcf-2a58-411d-92b4-c98e32c04436 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:03.321033 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc8dcf-2a58-411d-92b4-c98e32c04436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:03.321352 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc8dcf-2a58-411d-92b4-c98e32c04436 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:03.322104 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc8dcf-2a58-411d-92b4-c98e32c04436 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:03.322409 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc8dcf-2a58-411d-92b4-c98e32c04436 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:03.324100 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc8dcf-2a58-411d-92b4-c98e32c04436 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:03.337619 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 393/782] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:03.343006 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1864c6f-24d7-45ab-a848-99dd1f7d4203 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:03.354438 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1864c6f-24d7-45ab-a848-99dd1f7d4203 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:03.361843 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215187d1-1c57-45c0-8050-59ceeded4ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:03.362630 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215187d1-1c57-45c0-8050-59ceeded4ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:03.362914 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215187d1-1c57-45c0-8050-59ceeded4ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:03.363187 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215187d1-1c57-45c0-8050-59ceeded4ee6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:03.371010 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215187d1-1c57-45c0-8050-59ceeded4ee6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:03.372977 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215187d1-1c57-45c0-8050-59ceeded4ee6 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:03.388296 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-215187d1-1c57-45c0-8050-59ceeded4ee6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:04:03.389779 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 390/783] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:04:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:03.395441 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc8dcf-2a58-411d-92b4-c98e32c04436 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:03.406390 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc8dcf-2a58-411d-92b4-c98e32c04436 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:03.416493 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f246ab-0ae3-4efb-951e-b639b3313604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:03.417150 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f246ab-0ae3-4efb-951e-b639b3313604 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:03.417453 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f246ab-0ae3-4efb-951e-b639b3313604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:03.417702 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f246ab-0ae3-4efb-951e-b639b3313604 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:03.418505 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f246ab-0ae3-4efb-951e-b639b3313604 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:03.418816 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f246ab-0ae3-4efb-951e-b639b3313604 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:03.420684 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f246ab-0ae3-4efb-951e-b639b3313604 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:03.434928 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 394/784] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:04:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:03.440704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215187d1-1c57-45c0-8050-59ceeded4ee6 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:03.451961 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215187d1-1c57-45c0-8050-59ceeded4ee6 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:03.463295 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa08aa8-c3bb-4e6c-9f40-9d54a0526ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:03.464218 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa08aa8-c3bb-4e6c-9f40-9d54a0526ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:03.464501 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa08aa8-c3bb-4e6c-9f40-9d54a0526ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:03.464780 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa08aa8-c3bb-4e6c-9f40-9d54a0526ee2 admin admin] PATH_INFO: `/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/9dca4ea4f2c8490e823a73dca6c303ed/roles/9924d70543a845cdb7643026789244c3` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:03.493585 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa08aa8-c3bb-4e6c-9f40-9d54a0526ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ab195cc240497c9ac12843d738c4b9, user_id=9dca4ea4f2c8490e823a73dca6c303ed, role_id=9924d70543a845cdb7643026789244c3)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:03.496392 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa08aa8-c3bb-4e6c-9f40-9d54a0526ee2 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:03.521739 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 391/785] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:04:03 2022] PUT /identity/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/9dca4ea4f2c8490e823a73dca6c303ed/roles/9924d70543a845cdb7643026789244c3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:04:04.421156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb78640-75b2-4021-b4df-4e60b6558712 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:04.421898 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb78640-75b2-4021-b4df-4e60b6558712 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:04.421898 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb78640-75b2-4021-b4df-4e60b6558712 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:04.423690 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 395/786] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:04.429742 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6401ee3-3209-4c14-a23b-bec5ad8f1412 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:04.430568 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6401ee3-3209-4c14-a23b-bec5ad8f1412 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:04.431057 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6401ee3-3209-4c14-a23b-bec5ad8f1412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:04.467898 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-a6401ee3-3209-4c14-a23b-bec5ad8f1412 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:04.469509 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a6401ee3-3209-4c14-a23b-bec5ad8f1412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:04.543717 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 392/787] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:04 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:04:04.589880 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb78640-75b2-4021-b4df-4e60b6558712 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:04.606821 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb78640-75b2-4021-b4df-4e60b6558712 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:04.611751 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65e6c8-ea19-4c53-aa1b-fbe55f0ad47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:04.612808 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65e6c8-ea19-4c53-aa1b-fbe55f0ad47c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:04.613312 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65e6c8-ea19-4c53-aa1b-fbe55f0ad47c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:04.613775 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65e6c8-ea19-4c53-aa1b-fbe55f0ad47c admin admin] PATH_INFO: `/v3/services/network` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:04.614876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65e6c8-ea19-4c53-aa1b-fbe55f0ad47c admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:04.616762 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65e6c8-ea19-4c53-aa1b-fbe55f0ad47c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:04.632183 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-8e65e6c8-ea19-4c53-aa1b-fbe55f0ad47c admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 10 23:04:04.633643 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 396/788] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:04:04 2022] GET /identity/v3/services/network => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:04.639686 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6401ee3-3209-4c14-a23b-bec5ad8f1412 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:04.650044 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6401ee3-3209-4c14-a23b-bec5ad8f1412 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:04.655349 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e4e50-540e-4ace-817d-df2d56562483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:04.656450 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e4e50-540e-4ace-817d-df2d56562483 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:04.656931 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e4e50-540e-4ace-817d-df2d56562483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:04.657412 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e4e50-540e-4ace-817d-df2d56562483 admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:04.658351 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e4e50-540e-4ace-817d-df2d56562483 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:04.658901 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e4e50-540e-4ace-817d-df2d56562483 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:04.660872 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e4e50-540e-4ace-817d-df2d56562483 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:04.672675 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 393/789] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Feb 10 23:04:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:04.678432 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65e6c8-ea19-4c53-aa1b-fbe55f0ad47c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:04.689786 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65e6c8-ea19-4c53-aa1b-fbe55f0ad47c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:04.695106 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db80d5e-1969-431e-ad99-445018545886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:04.696060 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db80d5e-1969-431e-ad99-445018545886 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:04.696588 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db80d5e-1969-431e-ad99-445018545886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:04.697103 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db80d5e-1969-431e-ad99-445018545886 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:04.698013 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db80d5e-1969-431e-ad99-445018545886 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:04.698526 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db80d5e-1969-431e-ad99-445018545886 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:04.700348 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db80d5e-1969-431e-ad99-445018545886 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:04.715035 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 397/790] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Feb 10 23:04:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:04.721202 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e4e50-540e-4ace-817d-df2d56562483 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:04.732765 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e4e50-540e-4ace-817d-df2d56562483 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:04.737886 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e9ee6-581d-4d7b-96c0-fe0a4888565f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:04.738803 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e9ee6-581d-4d7b-96c0-fe0a4888565f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:04.739280 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e9ee6-581d-4d7b-96c0-fe0a4888565f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:04.739952 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e9ee6-581d-4d7b-96c0-fe0a4888565f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:04.741031 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e9ee6-581d-4d7b-96c0-fe0a4888565f admin admin] RBAC: Adding query filter params (interface=public, service_id=079b528782884d87b87e39c998defdfd, region_id=RegionOne) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:04.741695 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e9ee6-581d-4d7b-96c0-fe0a4888565f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:04.742895 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING py.warnings [None req-b29e9ee6-581d-4d7b-96c0-fe0a4888565f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:04:04.742895 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: warnings.warn(msg) Feb 10 23:04:04.742895 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: Feb 10 23:04:04.744176 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e9ee6-581d-4d7b-96c0-fe0a4888565f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:04.752953 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 394/791] 10.222.0.77 () {56 vars in 1272 bytes} [Thu Feb 10 23:04:04 2022] GET /identity/v3/endpoints?service_id=079b528782884d87b87e39c998defdfd&interface=public®ion_id=RegionOne => generated 194 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:04.760968 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db80d5e-1969-431e-ad99-445018545886 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:04.773406 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db80d5e-1969-431e-ad99-445018545886 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:04.778595 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8aab56-e279-4528-b563-0256bb2f4a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:04.779530 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aab56-e279-4528-b563-0256bb2f4a4a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:04.780030 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aab56-e279-4528-b563-0256bb2f4a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:04.780540 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aab56-e279-4528-b563-0256bb2f4a4a admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:04.781462 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8aab56-e279-4528-b563-0256bb2f4a4a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:04.783389 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8aab56-e279-4528-b563-0256bb2f4a4a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:04.797001 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 398/792] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Feb 10 23:04:04 2022] GET /identity/v3/services => generated 772 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:04.845771 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1145c0b-8b12-4501-bd1a-67254fa1e024 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:04.846438 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1145c0b-8b12-4501-bd1a-67254fa1e024 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:04.846912 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1145c0b-8b12-4501-bd1a-67254fa1e024 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:04.849937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 395/793] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:04.870457 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa41c31-d631-4265-bc0e-7d9dd3cec3e2 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:04.871071 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa41c31-d631-4265-bc0e-7d9dd3cec3e2 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:04.871568 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa41c31-d631-4265-bc0e-7d9dd3cec3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:04.897061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-4aa41c31-d631-4265-bc0e-7d9dd3cec3e2 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:04.898648 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-4aa41c31-d631-4265-bc0e-7d9dd3cec3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:04.912100 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 399/794] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:04 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:04.947555 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1145c0b-8b12-4501-bd1a-67254fa1e024 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:04.959526 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b16d3-fb96-401b-b6bb-3af2e6f75d13 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:04.962283 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b16d3-fb96-401b-b6bb-3af2e6f75d13 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:04.963368 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b16d3-fb96-401b-b6bb-3af2e6f75d13 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:04.964172 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1145c0b-8b12-4501-bd1a-67254fa1e024 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:04.967055 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 400/795] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:04 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:04.971768 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011014f3-85ea-4137-8b2c-817a340d3957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:04.973790 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dba73-9479-4144-970d-18d83db2e08e None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:04.974910 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dba73-9479-4144-970d-18d83db2e08e None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:04.975542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dba73-9479-4144-970d-18d83db2e08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:04.977433 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011014f3-85ea-4137-8b2c-817a340d3957 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:04.978863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011014f3-85ea-4137-8b2c-817a340d3957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:04.979839 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011014f3-85ea-4137-8b2c-817a340d3957 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.006102 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011014f3-85ea-4137-8b2c-817a340d3957 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:04:05.013850 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-b91dba73-9479-4144-970d-18d83db2e08e None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:05.015315 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-b91dba73-9479-4144-970d-18d83db2e08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:05.019157 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-011014f3-85ea-4137-8b2c-817a340d3957 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:04:05.023041 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 396/796] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:04:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:05.027903 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 401/797] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:04 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:05.028945 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011014f3-85ea-4137-8b2c-817a340d3957 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.039938 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011014f3-85ea-4137-8b2c-817a340d3957 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.044632 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8c55f-132a-46c4-a47b-e6e619c2d8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.045336 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8c55f-132a-46c4-a47b-e6e619c2d8ac admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.045620 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8c55f-132a-46c4-a47b-e6e619c2d8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.045948 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8c55f-132a-46c4-a47b-e6e619c2d8ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.046704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8c55f-132a-46c4-a47b-e6e619c2d8ac admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:05.047009 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8c55f-132a-46c4-a47b-e6e619c2d8ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.048851 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8c55f-132a-46c4-a47b-e6e619c2d8ac admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.050428 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91dba73-9479-4144-970d-18d83db2e08e None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.061158 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 397/798] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:05.061651 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91dba73-9479-4144-970d-18d83db2e08e None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.066447 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8c55f-132a-46c4-a47b-e6e619c2d8ac admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.067266 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c019e32-4cf4-4461-926f-acbc93b48986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.068977 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c019e32-4cf4-4461-926f-acbc93b48986 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.069474 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c019e32-4cf4-4461-926f-acbc93b48986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.069977 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c019e32-4cf4-4461-926f-acbc93b48986 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.081434 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8c55f-132a-46c4-a47b-e6e619c2d8ac admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.088867 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c019e32-4cf4-4461-926f-acbc93b48986 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:04:05.093440 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf8fd7-1c79-4c67-a854-f27894b967cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.094543 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf8fd7-1c79-4c67-a854-f27894b967cb admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.095047 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf8fd7-1c79-4c67-a854-f27894b967cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.095562 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf8fd7-1c79-4c67-a854-f27894b967cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.096719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-7c019e32-4cf4-4461-926f-acbc93b48986 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:04:05.098218 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 402/799] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:04:05.108848 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c019e32-4cf4-4461-926f-acbc93b48986 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.109047 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf8fd7-1c79-4c67-a854-f27894b967cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.111572 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf8fd7-1c79-4c67-a854-f27894b967cb admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.123042 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c019e32-4cf4-4461-926f-acbc93b48986 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.129220 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc221d72-7e8c-4e31-9abf-6c460627defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.129888 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc221d72-7e8c-4e31-9abf-6c460627defe admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.130173 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc221d72-7e8c-4e31-9abf-6c460627defe admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.130470 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc221d72-7e8c-4e31-9abf-6c460627defe admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.131248 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc221d72-7e8c-4e31-9abf-6c460627defe admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:05.131553 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc221d72-7e8c-4e31-9abf-6c460627defe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.133197 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc221d72-7e8c-4e31-9abf-6c460627defe admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.135023 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-7dcf8fd7-1c79-4c67-a854-f27894b967cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:05.136843 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 398/800] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:04:05.142765 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf8fd7-1c79-4c67-a854-f27894b967cb admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.154929 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 403/801] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:05.160610 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf8fd7-1c79-4c67-a854-f27894b967cb admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.160792 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc221d72-7e8c-4e31-9abf-6c460627defe admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.169916 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e95de2-5599-4fcb-b59d-a9fbacd5cdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.170823 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e95de2-5599-4fcb-b59d-a9fbacd5cdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.171920 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e95de2-5599-4fcb-b59d-a9fbacd5cdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.172392 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e95de2-5599-4fcb-b59d-a9fbacd5cdd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.174594 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e95de2-5599-4fcb-b59d-a9fbacd5cdd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:05.175090 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e95de2-5599-4fcb-b59d-a9fbacd5cdd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.178807 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e95de2-5599-4fcb-b59d-a9fbacd5cdd4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.181047 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc221d72-7e8c-4e31-9abf-6c460627defe admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.192378 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9c46b-70e5-4940-a2a8-abfb6892995d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.194279 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9c46b-70e5-4940-a2a8-abfb6892995d admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.195293 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9c46b-70e5-4940-a2a8-abfb6892995d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.196352 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9c46b-70e5-4940-a2a8-abfb6892995d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.208929 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 399/802] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:05.215983 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9c46b-70e5-4940-a2a8-abfb6892995d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.217025 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e95de2-5599-4fcb-b59d-a9fbacd5cdd4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.217939 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9c46b-70e5-4940-a2a8-abfb6892995d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.234114 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e95de2-5599-4fcb-b59d-a9fbacd5cdd4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.237804 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-78a9c46b-70e5-4940-a2a8-abfb6892995d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:05.239212 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25268a0-254f-4460-b2bd-4d765f09e452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.239361 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 404/803] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:05.240357 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25268a0-254f-4460-b2bd-4d765f09e452 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.240841 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25268a0-254f-4460-b2bd-4d765f09e452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.241306 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25268a0-254f-4460-b2bd-4d765f09e452 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.246855 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9c46b-70e5-4940-a2a8-abfb6892995d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.259012 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25268a0-254f-4460-b2bd-4d765f09e452 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.262081 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25268a0-254f-4460-b2bd-4d765f09e452 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.266138 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9c46b-70e5-4940-a2a8-abfb6892995d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.276757 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a034b-eb71-46c4-9ccf-09e791924868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.278895 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a034b-eb71-46c4-9ccf-09e791924868 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.279692 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a034b-eb71-46c4-9ccf-09e791924868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.281673 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a034b-eb71-46c4-9ccf-09e791924868 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.282671 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a034b-eb71-46c4-9ccf-09e791924868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:05.283256 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a034b-eb71-46c4-9ccf-09e791924868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.286548 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a034b-eb71-46c4-9ccf-09e791924868 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.297878 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-d25268a0-254f-4460-b2bd-4d765f09e452 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 23:04:05.299363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 400/804] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:05.311460 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 405/805] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:05.312478 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25268a0-254f-4460-b2bd-4d765f09e452 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.316733 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a034b-eb71-46c4-9ccf-09e791924868 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.323935 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25268a0-254f-4460-b2bd-4d765f09e452 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.328786 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2649b69-53b5-4bbb-a70a-ba064f04c6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.329704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2649b69-53b5-4bbb-a70a-ba064f04c6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.330207 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2649b69-53b5-4bbb-a70a-ba064f04c6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.330672 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2649b69-53b5-4bbb-a70a-ba064f04c6f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.331518 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a034b-eb71-46c4-9ccf-09e791924868 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.331991 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2649b69-53b5-4bbb-a70a-ba064f04c6f9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:05.332583 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2649b69-53b5-4bbb-a70a-ba064f04c6f9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.335093 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2649b69-53b5-4bbb-a70a-ba064f04c6f9 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.352551 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6ec3d-6ee9-484f-8d9f-220269b79802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.353361 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6ec3d-6ee9-484f-8d9f-220269b79802 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.353724 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6ec3d-6ee9-484f-8d9f-220269b79802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.353938 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6ec3d-6ee9-484f-8d9f-220269b79802 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.356738 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 401/806] 10.222.0.77 () {56 vars in 1154 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:05.362714 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2649b69-53b5-4bbb-a70a-ba064f04c6f9 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.375302 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6ec3d-6ee9-484f-8d9f-220269b79802 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.381044 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6ec3d-6ee9-484f-8d9f-220269b79802 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.383125 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2649b69-53b5-4bbb-a70a-ba064f04c6f9 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.391983 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d89e90-3ecd-4760-8b4b-4fc1de09d2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.393141 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d89e90-3ecd-4760-8b4b-4fc1de09d2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.395095 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d89e90-3ecd-4760-8b4b-4fc1de09d2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.395570 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d89e90-3ecd-4760-8b4b-4fc1de09d2b7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.408598 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-a8f6ec3d-6ee9-484f-8d9f-220269b79802 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 10 23:04:05.409943 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 406/807] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:04:05.410824 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d89e90-3ecd-4760-8b4b-4fc1de09d2b7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.413524 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d89e90-3ecd-4760-8b4b-4fc1de09d2b7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.415951 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6ec3d-6ee9-484f-8d9f-220269b79802 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.424060 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 402/808] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:04:05.430021 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6ec3d-6ee9-484f-8d9f-220269b79802 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.431518 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d89e90-3ecd-4760-8b4b-4fc1de09d2b7 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.440500 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d89e90-3ecd-4760-8b4b-4fc1de09d2b7 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.445764 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b0383-047c-438d-8df6-9ea8f4893af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.446799 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b0383-047c-438d-8df6-9ea8f4893af9 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.447274 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b0383-047c-438d-8df6-9ea8f4893af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.447898 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b0383-047c-438d-8df6-9ea8f4893af9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.448448 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e00fef-6bba-43b2-8bf3-0e7aadfc69f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.449112 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e00fef-6bba-43b2-8bf3-0e7aadfc69f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.449397 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e00fef-6bba-43b2-8bf3-0e7aadfc69f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.449676 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e00fef-6bba-43b2-8bf3-0e7aadfc69f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.450532 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e00fef-6bba-43b2-8bf3-0e7aadfc69f1 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:05.450837 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e00fef-6bba-43b2-8bf3-0e7aadfc69f1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.452675 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e00fef-6bba-43b2-8bf3-0e7aadfc69f1 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.460833 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b0383-047c-438d-8df6-9ea8f4893af9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.462880 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b0383-047c-438d-8df6-9ea8f4893af9 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.481473 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-032b0383-047c-438d-8df6-9ea8f4893af9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:05.482959 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 403/809] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:05.488559 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 407/810] 10.222.0.77 () {56 vars in 1156 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:05.489616 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b0383-047c-438d-8df6-9ea8f4893af9 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.494270 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e00fef-6bba-43b2-8bf3-0e7aadfc69f1 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.504046 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e00fef-6bba-43b2-8bf3-0e7aadfc69f1 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.507750 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b0383-047c-438d-8df6-9ea8f4893af9 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.514660 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725942d-e8f2-4b32-877d-d08c93285f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.516460 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725942d-e8f2-4b32-877d-d08c93285f34 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.517413 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725942d-e8f2-4b32-877d-d08c93285f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.518644 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725942d-e8f2-4b32-877d-d08c93285f34 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.520386 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5028479-6e4d-456e-87ea-386491fcbb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.522872 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5028479-6e4d-456e-87ea-386491fcbb53 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.523399 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5028479-6e4d-456e-87ea-386491fcbb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.523930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5028479-6e4d-456e-87ea-386491fcbb53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.525170 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5028479-6e4d-456e-87ea-386491fcbb53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:05.526430 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5028479-6e4d-456e-87ea-386491fcbb53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.530291 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5028479-6e4d-456e-87ea-386491fcbb53 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.544362 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725942d-e8f2-4b32-877d-d08c93285f34 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.546440 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725942d-e8f2-4b32-877d-d08c93285f34 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.552189 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 404/811] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:05.558113 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5028479-6e4d-456e-87ea-386491fcbb53 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.571075 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5028479-6e4d-456e-87ea-386491fcbb53 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.576021 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9eebb4-c1b1-4777-b720-7e37bc0fe840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.577069 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9eebb4-c1b1-4777-b720-7e37bc0fe840 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.577569 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9eebb4-c1b1-4777-b720-7e37bc0fe840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.578033 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9eebb4-c1b1-4777-b720-7e37bc0fe840 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.578552 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-5725942d-e8f2-4b32-877d-d08c93285f34 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:05.579978 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 408/812] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:05.587435 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9eebb4-c1b1-4777-b720-7e37bc0fe840 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.588729 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725942d-e8f2-4b32-877d-d08c93285f34 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.590024 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9eebb4-c1b1-4777-b720-7e37bc0fe840 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.598279 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725942d-e8f2-4b32-877d-d08c93285f34 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.606424 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-4c9eebb4-c1b1-4777-b720-7e37bc0fe840 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:04:05.608209 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 405/813] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:05.616539 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9eebb4-c1b1-4777-b720-7e37bc0fe840 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.618073 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841b5b1-173d-4fb8-9f3f-16393b000f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.618723 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841b5b1-173d-4fb8-9f3f-16393b000f11 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.619009 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841b5b1-173d-4fb8-9f3f-16393b000f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.619288 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841b5b1-173d-4fb8-9f3f-16393b000f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.620066 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841b5b1-173d-4fb8-9f3f-16393b000f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:05.620372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841b5b1-173d-4fb8-9f3f-16393b000f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.621959 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841b5b1-173d-4fb8-9f3f-16393b000f11 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.638957 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9eebb4-c1b1-4777-b720-7e37bc0fe840 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.647123 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 409/814] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:05.649190 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564f127-0a15-4778-9c26-7472c8cb6237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.649899 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564f127-0a15-4778-9c26-7472c8cb6237 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.650181 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564f127-0a15-4778-9c26-7472c8cb6237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.650454 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564f127-0a15-4778-9c26-7472c8cb6237 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.651342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564f127-0a15-4778-9c26-7472c8cb6237 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:05.651705 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564f127-0a15-4778-9c26-7472c8cb6237 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.654061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841b5b1-173d-4fb8-9f3f-16393b000f11 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.655407 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564f127-0a15-4778-9c26-7472c8cb6237 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.671139 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841b5b1-173d-4fb8-9f3f-16393b000f11 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.680874 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 406/815] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:05.682038 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339f310-537e-4bd7-856b-d89fad9cb4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.682884 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339f310-537e-4bd7-856b-d89fad9cb4ca admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.683167 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339f310-537e-4bd7-856b-d89fad9cb4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.683444 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339f310-537e-4bd7-856b-d89fad9cb4ca admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.686679 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564f127-0a15-4778-9c26-7472c8cb6237 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.701475 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564f127-0a15-4778-9c26-7472c8cb6237 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.702968 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339f310-537e-4bd7-856b-d89fad9cb4ca admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.705398 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339f310-537e-4bd7-856b-d89fad9cb4ca admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.711226 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2a480-ec4d-42ab-ba7e-b122e956d764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.714522 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2a480-ec4d-42ab-ba7e-b122e956d764 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.714812 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2a480-ec4d-42ab-ba7e-b122e956d764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.715092 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2a480-ec4d-42ab-ba7e-b122e956d764 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.716309 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2a480-ec4d-42ab-ba7e-b122e956d764 admin admin] RBAC: Adding query filter params (role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=551da2c9fab74cb8b14287a5634adb25) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:05.716626 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2a480-ec4d-42ab-ba7e-b122e956d764 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.720548 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2a480-ec4d-42ab-ba7e-b122e956d764 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.732587 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-8339f310-537e-4bd7-856b-d89fad9cb4ca admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:04:05.735175 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 407/816] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/role_assignments?user.id=551da2c9fab74cb8b14287a5634adb25&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:05.736377 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 410/817] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:05.742816 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2a480-ec4d-42ab-ba7e-b122e956d764 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.757962 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2a480-ec4d-42ab-ba7e-b122e956d764 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.768084 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c59bb-b123-45a3-ad68-2b5288f143db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.768764 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c59bb-b123-45a3-ad68-2b5288f143db admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.769049 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c59bb-b123-45a3-ad68-2b5288f143db admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.769328 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c59bb-b123-45a3-ad68-2b5288f143db admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.770138 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c59bb-b123-45a3-ad68-2b5288f143db admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:05.770449 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c59bb-b123-45a3-ad68-2b5288f143db admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.773039 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c59bb-b123-45a3-ad68-2b5288f143db admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.792877 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 408/818] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:04:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:05.799019 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339f310-537e-4bd7-856b-d89fad9cb4ca admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:05.809906 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339f310-537e-4bd7-856b-d89fad9cb4ca admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:05.820920 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4abb00-73bf-4a1a-8184-210c14508367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:05.821828 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4abb00-73bf-4a1a-8184-210c14508367 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:05.822112 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4abb00-73bf-4a1a-8184-210c14508367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:05.822392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4abb00-73bf-4a1a-8184-210c14508367 admin admin] PATH_INFO: `/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/ce55b64dc528447993e32b00ae4d3a2a/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:05.824486 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4abb00-73bf-4a1a-8184-210c14508367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ab195cc240497c9ac12843d738c4b9, user_id=ce55b64dc528447993e32b00ae4d3a2a, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:05.827174 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4abb00-73bf-4a1a-8184-210c14508367 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:05.850744 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 411/819] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:04:05 2022] PUT /identity/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/ce55b64dc528447993e32b00ae4d3a2a/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:04:06.187753 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c10832-289c-4068-91a4-a704a2a4d28b None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:06.188153 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c10832-289c-4068-91a4-a704a2a4d28b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:06.188328 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c10832-289c-4068-91a4-a704a2a4d28b None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:06.190277 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 409/820] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:06.196413 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc58fc1-4eb0-4b5c-a909-1e7ebfc29657 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:06.196952 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc58fc1-4eb0-4b5c-a909-1e7ebfc29657 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:06.197420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc58fc1-4eb0-4b5c-a909-1e7ebfc29657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:06.222717 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-cbc58fc1-4eb0-4b5c-a909-1e7ebfc29657 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:06.225185 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-cbc58fc1-4eb0-4b5c-a909-1e7ebfc29657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:06.317253 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 412/821] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:06 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:06.354839 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc58fc1-4eb0-4b5c-a909-1e7ebfc29657 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:06.355328 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f2980-a496-441f-9fe0-47d4645face4 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:06.355608 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f2980-a496-441f-9fe0-47d4645face4 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:06.355911 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f2980-a496-441f-9fe0-47d4645face4 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:06.357851 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 410/822] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:06.363245 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39837c25-4aea-472f-b0e2-ff289e4ecd01 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:06.363523 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39837c25-4aea-472f-b0e2-ff289e4ecd01 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:06.363790 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39837c25-4aea-472f-b0e2-ff289e4ecd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:06.367663 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc58fc1-4eb0-4b5c-a909-1e7ebfc29657 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:06.382518 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043b31e-b250-45f6-a8a6-f88ae3fbedf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:06.383316 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043b31e-b250-45f6-a8a6-f88ae3fbedf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:06.383595 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043b31e-b250-45f6-a8a6-f88ae3fbedf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:06.383886 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043b31e-b250-45f6-a8a6-f88ae3fbedf9 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:06.384554 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043b31e-b250-45f6-a8a6-f88ae3fbedf9 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:06.386148 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043b31e-b250-45f6-a8a6-f88ae3fbedf9 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:06.390287 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-39837c25-4aea-472f-b0e2-ff289e4ecd01 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:06.391438 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-39837c25-4aea-472f-b0e2-ff289e4ecd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:06.404927 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-7043b31e-b250-45f6-a8a6-f88ae3fbedf9 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 10 23:04:06.407678 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 413/823] 10.222.0.77 () {56 vars in 1150 bytes} [Thu Feb 10 23:04:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:04:06.412397 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 411/824] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:06 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:04:06.413324 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043b31e-b250-45f6-a8a6-f88ae3fbedf9 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:06.429768 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043b31e-b250-45f6-a8a6-f88ae3fbedf9 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:06.434259 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52345c2-c23e-4a19-af31-2924af107aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:06.434892 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52345c2-c23e-4a19-af31-2924af107aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:06.435172 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52345c2-c23e-4a19-af31-2924af107aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:06.435443 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52345c2-c23e-4a19-af31-2924af107aa3 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:06.436181 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52345c2-c23e-4a19-af31-2924af107aa3 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:06.436481 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52345c2-c23e-4a19-af31-2924af107aa3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:06.438033 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52345c2-c23e-4a19-af31-2924af107aa3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:06.442718 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 414/825] 10.222.0.77 () {56 vars in 1145 bytes} [Thu Feb 10 23:04:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:06.448420 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39837c25-4aea-472f-b0e2-ff289e4ecd01 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:06.448849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52345c2-c23e-4a19-af31-2924af107aa3 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:06.462748 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39837c25-4aea-472f-b0e2-ff289e4ecd01 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:06.472711 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39b1fd-99a4-4f1c-b118-dcdff5f81064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:06.473420 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39b1fd-99a4-4f1c-b118-dcdff5f81064 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:06.473704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39b1fd-99a4-4f1c-b118-dcdff5f81064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:06.474048 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39b1fd-99a4-4f1c-b118-dcdff5f81064 admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:06.476560 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39b1fd-99a4-4f1c-b118-dcdff5f81064 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:06.476871 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39b1fd-99a4-4f1c-b118-dcdff5f81064 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:06.478078 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52345c2-c23e-4a19-af31-2924af107aa3 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:06.480056 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39b1fd-99a4-4f1c-b118-dcdff5f81064 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:06.488100 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54197a-4503-497d-978f-a8c47fc7dc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:06.488971 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54197a-4503-497d-978f-a8c47fc7dc90 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:06.489307 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54197a-4503-497d-978f-a8c47fc7dc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:06.491200 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54197a-4503-497d-978f-a8c47fc7dc90 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:06.491926 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 412/826] 10.222.0.77 () {56 vars in 1145 bytes} [Thu Feb 10 23:04:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:06.497467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39b1fd-99a4-4f1c-b118-dcdff5f81064 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:06.513138 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39b1fd-99a4-4f1c-b118-dcdff5f81064 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:06.515263 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54197a-4503-497d-978f-a8c47fc7dc90 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:04:06.523999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fc8ff-1a93-4ff1-b428-f6d96fac80b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:06.524695 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fc8ff-1a93-4ff1-b428-f6d96fac80b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:06.524976 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fc8ff-1a93-4ff1-b428-f6d96fac80b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:06.525252 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fc8ff-1a93-4ff1-b428-f6d96fac80b5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:06.526054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fc8ff-1a93-4ff1-b428-f6d96fac80b5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:06.528480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING py.warnings [None req-079fc8ff-1a93-4ff1-b428-f6d96fac80b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:04:06.528480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: warnings.warn(msg) Feb 10 23:04:06.528480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: Feb 10 23:04:06.529413 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fc8ff-1a93-4ff1-b428-f6d96fac80b5 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:06.531498 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-9a54197a-4503-497d-978f-a8c47fc7dc90 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:04:06.533800 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 415/827] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:04:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:04:06.546574 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54197a-4503-497d-978f-a8c47fc7dc90 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:06.558674 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54197a-4503-497d-978f-a8c47fc7dc90 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:06.566033 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 413/828] 10.222.0.77 () {60 vars in 1165 bytes} [Thu Feb 10 23:04:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:04:06.580039 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49dfe1-4c0e-4ee0-bd50-12bf4beb80a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:06.580844 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49dfe1-4c0e-4ee0-bd50-12bf4beb80a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:06.581177 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49dfe1-4c0e-4ee0-bd50-12bf4beb80a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:06.581456 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49dfe1-4c0e-4ee0-bd50-12bf4beb80a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:06.582222 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49dfe1-4c0e-4ee0-bd50-12bf4beb80a1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:06.582571 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49dfe1-4c0e-4ee0-bd50-12bf4beb80a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:06.585544 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49dfe1-4c0e-4ee0-bd50-12bf4beb80a1 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:06.595359 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 416/829] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:04:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:06.601863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fc8ff-1a93-4ff1-b428-f6d96fac80b5 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:06.613221 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fc8ff-1a93-4ff1-b428-f6d96fac80b5 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:06.618799 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbcde5-5d2b-46ef-a1f8-fe64fcf8a9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:06.619650 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbcde5-5d2b-46ef-a1f8-fe64fcf8a9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:06.619978 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbcde5-5d2b-46ef-a1f8-fe64fcf8a9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:06.620317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbcde5-5d2b-46ef-a1f8-fe64fcf8a9d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:06.633355 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbcde5-5d2b-46ef-a1f8-fe64fcf8a9d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:06.635268 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbcde5-5d2b-46ef-a1f8-fe64fcf8a9d4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:06.654168 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-b7dbcde5-5d2b-46ef-a1f8-fe64fcf8a9d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:06.655704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 414/830] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:06.661324 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49dfe1-4c0e-4ee0-bd50-12bf4beb80a1 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:06.671967 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49dfe1-4c0e-4ee0-bd50-12bf4beb80a1 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:06.676585 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76753dd-a218-403e-8c9f-24cb0e3b319a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:06.677853 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76753dd-a218-403e-8c9f-24cb0e3b319a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:06.678351 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76753dd-a218-403e-8c9f-24cb0e3b319a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:06.678798 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76753dd-a218-403e-8c9f-24cb0e3b319a admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:06.679557 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76753dd-a218-403e-8c9f-24cb0e3b319a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:06.679948 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76753dd-a218-403e-8c9f-24cb0e3b319a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:06.681728 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76753dd-a218-403e-8c9f-24cb0e3b319a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:06.696083 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 417/831] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:06.701802 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbcde5-5d2b-46ef-a1f8-fe64fcf8a9d4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:06.712891 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbcde5-5d2b-46ef-a1f8-fe64fcf8a9d4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:06.717837 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2241-810a-4972-a149-f0b02521afa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:06.718708 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2241-810a-4972-a149-f0b02521afa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:06.718993 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2241-810a-4972-a149-f0b02521afa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:06.719318 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2241-810a-4972-a149-f0b02521afa1 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:06.733340 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d2241-810a-4972-a149-f0b02521afa1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:06.735458 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d2241-810a-4972-a149-f0b02521afa1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:06.764358 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-be5d2241-810a-4972-a149-f0b02521afa1 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 10 23:04:06.766017 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 415/832] 10.222.0.77 () {56 vars in 1138 bytes} [Thu Feb 10 23:04:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:06.771542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76753dd-a218-403e-8c9f-24cb0e3b319a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:06.787623 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76753dd-a218-403e-8c9f-24cb0e3b319a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:06.801343 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16122b5b-cfa9-440a-9a9c-47b31f913f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:06.802082 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16122b5b-cfa9-440a-9a9c-47b31f913f31 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:06.802995 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16122b5b-cfa9-440a-9a9c-47b31f913f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:06.803274 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16122b5b-cfa9-440a-9a9c-47b31f913f31 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:06.804338 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16122b5b-cfa9-440a-9a9c-47b31f913f31 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:06.804651 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16122b5b-cfa9-440a-9a9c-47b31f913f31 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:06.806509 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16122b5b-cfa9-440a-9a9c-47b31f913f31 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:06.831811 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 418/833] 10.222.0.77 () {56 vars in 1170 bytes} [Thu Feb 10 23:04:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:06.837389 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2241-810a-4972-a149-f0b02521afa1 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:06.848054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2241-810a-4972-a149-f0b02521afa1 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:06.853149 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a0f43-ff43-4cca-8e63-57a45fcafd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:06.853795 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a0f43-ff43-4cca-8e63-57a45fcafd0b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:06.854078 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a0f43-ff43-4cca-8e63-57a45fcafd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:06.854359 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a0f43-ff43-4cca-8e63-57a45fcafd0b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:06.862880 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a0f43-ff43-4cca-8e63-57a45fcafd0b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:06.865353 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a0f43-ff43-4cca-8e63-57a45fcafd0b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:06.874969 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 416/834] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:04:06 2022] GET /identity/v3/auth/tokens => generated 1303 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:04:06.880725 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16122b5b-cfa9-440a-9a9c-47b31f913f31 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:06.890598 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16122b5b-cfa9-440a-9a9c-47b31f913f31 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:06.895348 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ef383-1915-468a-87bd-8f79c1d458cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:06.896237 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ef383-1915-468a-87bd-8f79c1d458cf admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:06.896525 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ef383-1915-468a-87bd-8f79c1d458cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:06.896802 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ef383-1915-468a-87bd-8f79c1d458cf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:06.907604 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ef383-1915-468a-87bd-8f79c1d458cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:06.909627 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ef383-1915-468a-87bd-8f79c1d458cf admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:06.927778 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-509ef383-1915-468a-87bd-8f79c1d458cf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:06.929274 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 419/835] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:06.934863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a0f43-ff43-4cca-8e63-57a45fcafd0b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:06.945344 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a0f43-ff43-4cca-8e63-57a45fcafd0b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:06.950026 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396b5bc-f6ff-4ede-9e67-24c4581162f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:06.950681 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396b5bc-f6ff-4ede-9e67-24c4581162f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:06.950995 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396b5bc-f6ff-4ede-9e67-24c4581162f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:06.951286 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396b5bc-f6ff-4ede-9e67-24c4581162f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:06.952065 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396b5bc-f6ff-4ede-9e67-24c4581162f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:06.952373 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396b5bc-f6ff-4ede-9e67-24c4581162f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:06.954031 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396b5bc-f6ff-4ede-9e67-24c4581162f8 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:06.970779 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 417/836] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:06.973406 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ef383-1915-468a-87bd-8f79c1d458cf admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:06.984110 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ef383-1915-468a-87bd-8f79c1d458cf admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:06.989141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85929471-e5c2-4d96-9279-84ebc6042405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:06.990532 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85929471-e5c2-4d96-9279-84ebc6042405 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:06.990818 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85929471-e5c2-4d96-9279-84ebc6042405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:06.991091 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85929471-e5c2-4d96-9279-84ebc6042405 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:06.998737 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85929471-e5c2-4d96-9279-84ebc6042405 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:07.000779 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85929471-e5c2-4d96-9279-84ebc6042405 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:07.016159 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-85929471-e5c2-4d96-9279-84ebc6042405 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:04:07.017640 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 420/837] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:04:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:04:07.023604 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396b5bc-f6ff-4ede-9e67-24c4581162f8 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:07.034111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396b5bc-f6ff-4ede-9e67-24c4581162f8 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:07.039764 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859a17f-adf2-4269-9e43-52c52da7e7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:07.040496 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859a17f-adf2-4269-9e43-52c52da7e7cd admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:07.040777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859a17f-adf2-4269-9e43-52c52da7e7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:07.041108 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859a17f-adf2-4269-9e43-52c52da7e7cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:07.041909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859a17f-adf2-4269-9e43-52c52da7e7cd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:07.042273 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859a17f-adf2-4269-9e43-52c52da7e7cd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:07.044271 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859a17f-adf2-4269-9e43-52c52da7e7cd admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:07.057582 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 418/838] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:04:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:07.063397 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85929471-e5c2-4d96-9279-84ebc6042405 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:07.073782 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85929471-e5c2-4d96-9279-84ebc6042405 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:07.085623 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c9703-0f83-45bc-ab87-5a3b12e68f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:07.086285 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c9703-0f83-45bc-ab87-5a3b12e68f68 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:07.086564 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c9703-0f83-45bc-ab87-5a3b12e68f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:07.086843 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c9703-0f83-45bc-ab87-5a3b12e68f68 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:07.087694 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c9703-0f83-45bc-ab87-5a3b12e68f68 admin admin] RBAC: Adding query filter params (role.id=9924d70543a845cdb7643026789244c3, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=9dca4ea4f2c8490e823a73dca6c303ed) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:07.088039 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c9703-0f83-45bc-ab87-5a3b12e68f68 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:07.089859 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c9703-0f83-45bc-ab87-5a3b12e68f68 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:07.096785 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 421/839] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:04:07 2022] GET /identity/v3/role_assignments?user.id=9dca4ea4f2c8490e823a73dca6c303ed&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=9924d70543a845cdb7643026789244c3 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:07.547590 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ee8c5-1d53-4063-a408-ecb1c9b15764 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:07.548643 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ee8c5-1d53-4063-a408-ecb1c9b15764 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:07.549140 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ee8c5-1d53-4063-a408-ecb1c9b15764 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:07.551398 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 419/840] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:07.557273 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41539e6-cd04-4730-837a-6e336ac37834 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:07.557719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41539e6-cd04-4730-837a-6e336ac37834 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:07.557797 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41539e6-cd04-4730-837a-6e336ac37834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:07.576319 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-c41539e6-cd04-4730-837a-6e336ac37834 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:07.577497 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-c41539e6-cd04-4730-837a-6e336ac37834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:07.591923 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 422/841] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:07 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:07.610045 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ee8c5-1d53-4063-a408-ecb1c9b15764 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:07.623093 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ee8c5-1d53-4063-a408-ecb1c9b15764 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:07.627422 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2a41c-e307-4549-a2ca-2ce14fe4a46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:07.628274 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2a41c-e307-4549-a2ca-2ce14fe4a46a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:07.628554 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2a41c-e307-4549-a2ca-2ce14fe4a46a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:07.628825 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2a41c-e307-4549-a2ca-2ce14fe4a46a admin admin] PATH_INFO: `/v3/services/network` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:07.629533 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2a41c-e307-4549-a2ca-2ce14fe4a46a admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:07.631248 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2a41c-e307-4549-a2ca-2ce14fe4a46a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:07.642270 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-2eb2a41c-e307-4549-a2ca-2ce14fe4a46a admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 10 23:04:07.647938 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 420/842] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:04:07 2022] GET /identity/v3/services/network => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:07.649749 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41539e6-cd04-4730-837a-6e336ac37834 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:07.658728 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41539e6-cd04-4730-837a-6e336ac37834 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:07.663843 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea5a75-4394-4194-88ce-878774166e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:07.664503 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea5a75-4394-4194-88ce-878774166e41 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:07.664782 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea5a75-4394-4194-88ce-878774166e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:07.665051 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea5a75-4394-4194-88ce-878774166e41 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:07.665755 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea5a75-4394-4194-88ce-878774166e41 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:07.666053 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea5a75-4394-4194-88ce-878774166e41 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:07.667677 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea5a75-4394-4194-88ce-878774166e41 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:07.676072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 423/843] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Feb 10 23:04:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:07.678734 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2a41c-e307-4549-a2ca-2ce14fe4a46a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:07.688770 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2a41c-e307-4549-a2ca-2ce14fe4a46a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:07.693976 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde731dc-093f-4329-9c1d-875cfb744647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:07.694623 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde731dc-093f-4329-9c1d-875cfb744647 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:07.694952 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde731dc-093f-4329-9c1d-875cfb744647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:07.695233 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde731dc-093f-4329-9c1d-875cfb744647 admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:07.696005 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde731dc-093f-4329-9c1d-875cfb744647 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:07.696316 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde731dc-093f-4329-9c1d-875cfb744647 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:07.697942 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde731dc-093f-4329-9c1d-875cfb744647 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:07.707380 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 421/844] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Feb 10 23:04:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:07.709317 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea5a75-4394-4194-88ce-878774166e41 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:07.719776 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea5a75-4394-4194-88ce-878774166e41 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:07.724366 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a299ec-0d56-4c93-bfc7-11f42bf34ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:07.725104 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a299ec-0d56-4c93-bfc7-11f42bf34ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:07.725382 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a299ec-0d56-4c93-bfc7-11f42bf34ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:07.725649 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a299ec-0d56-4c93-bfc7-11f42bf34ce5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:07.726403 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a299ec-0d56-4c93-bfc7-11f42bf34ce5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:07.727407 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING py.warnings [None req-53a299ec-0d56-4c93-bfc7-11f42bf34ce5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:04:07.727407 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: warnings.warn(msg) Feb 10 23:04:07.727407 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: Feb 10 23:04:07.728296 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a299ec-0d56-4c93-bfc7-11f42bf34ce5 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:07.755949 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 424/845] 10.222.0.77 () {60 vars in 1165 bytes} [Thu Feb 10 23:04:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:04:08.299748 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da5fe8-491f-4093-8762-7cbe52e7e2c5 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:08.300510 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da5fe8-491f-4093-8762-7cbe52e7e2c5 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:08.301001 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da5fe8-491f-4093-8762-7cbe52e7e2c5 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:08.304192 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 422/846] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:08.309795 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64389360-f1ec-4af4-9203-0cdcfaff18bb None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:08.310435 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64389360-f1ec-4af4-9203-0cdcfaff18bb None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:08.310921 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64389360-f1ec-4af4-9203-0cdcfaff18bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:08.333307 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-64389360-f1ec-4af4-9203-0cdcfaff18bb None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:08.334821 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-64389360-f1ec-4af4-9203-0cdcfaff18bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:08.355689 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 425/847] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:08 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:08.382397 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da5fe8-491f-4093-8762-7cbe52e7e2c5 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:08.395182 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da5fe8-491f-4093-8762-7cbe52e7e2c5 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:08.400733 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3ac22-0bab-4f14-9934-820f7f16f634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:08.402011 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3ac22-0bab-4f14-9934-820f7f16f634 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:08.402509 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3ac22-0bab-4f14-9934-820f7f16f634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:08.402987 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3ac22-0bab-4f14-9934-820f7f16f634 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:08.417457 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3ac22-0bab-4f14-9934-820f7f16f634 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:04:08.424925 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-a0b3ac22-0bab-4f14-9934-820f7f16f634 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:04:08.426923 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 423/848] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:04:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:08.433032 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64389360-f1ec-4af4-9203-0cdcfaff18bb None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:08.442249 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64389360-f1ec-4af4-9203-0cdcfaff18bb None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:08.447103 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b841ca-8d75-4713-83c7-4666ce2e667f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:08.448049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b841ca-8d75-4713-83c7-4666ce2e667f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:08.448548 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b841ca-8d75-4713-83c7-4666ce2e667f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:08.449038 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b841ca-8d75-4713-83c7-4666ce2e667f admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:08.449991 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b841ca-8d75-4713-83c7-4666ce2e667f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:08.450492 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b841ca-8d75-4713-83c7-4666ce2e667f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:08.452348 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b841ca-8d75-4713-83c7-4666ce2e667f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:08.461759 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 426/849] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:04:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:08.471629 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3ac22-0bab-4f14-9934-820f7f16f634 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:08.477357 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3ac22-0bab-4f14-9934-820f7f16f634 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:08.482125 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946444a-3b1f-41fd-b87f-72b5188e4493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:08.483059 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946444a-3b1f-41fd-b87f-72b5188e4493 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:08.483497 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946444a-3b1f-41fd-b87f-72b5188e4493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:08.483941 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946444a-3b1f-41fd-b87f-72b5188e4493 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:08.495991 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946444a-3b1f-41fd-b87f-72b5188e4493 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:08.497978 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946444a-3b1f-41fd-b87f-72b5188e4493 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:08.514480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-e946444a-3b1f-41fd-b87f-72b5188e4493 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:08.516156 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 424/850] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:08.522016 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b841ca-8d75-4713-83c7-4666ce2e667f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:08.531805 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b841ca-8d75-4713-83c7-4666ce2e667f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:08.537238 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe32a23-e4ee-488c-acd5-231dec2b208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:08.538221 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe32a23-e4ee-488c-acd5-231dec2b208d admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:08.538657 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe32a23-e4ee-488c-acd5-231dec2b208d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:08.539064 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe32a23-e4ee-488c-acd5-231dec2b208d admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:08.540004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe32a23-e4ee-488c-acd5-231dec2b208d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:08.540448 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe32a23-e4ee-488c-acd5-231dec2b208d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:08.542263 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe32a23-e4ee-488c-acd5-231dec2b208d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:08.555461 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 427/851] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:08.561022 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946444a-3b1f-41fd-b87f-72b5188e4493 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:08.572096 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946444a-3b1f-41fd-b87f-72b5188e4493 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:08.576911 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418aa442-cac2-4256-ab24-2089ca33fc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:08.577894 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418aa442-cac2-4256-ab24-2089ca33fc0b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:08.578331 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418aa442-cac2-4256-ab24-2089ca33fc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:08.578749 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418aa442-cac2-4256-ab24-2089ca33fc0b admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:08.588087 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418aa442-cac2-4256-ab24-2089ca33fc0b admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:08.590099 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418aa442-cac2-4256-ab24-2089ca33fc0b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:08.603767 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-418aa442-cac2-4256-ab24-2089ca33fc0b admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 10 23:04:08.605241 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 425/852] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:04:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:08.610785 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe32a23-e4ee-488c-acd5-231dec2b208d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:08.621141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe32a23-e4ee-488c-acd5-231dec2b208d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:08.625682 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f1e25-bc21-4a45-a2af-4a8e91d59324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:08.626329 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f1e25-bc21-4a45-a2af-4a8e91d59324 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:08.626661 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f1e25-bc21-4a45-a2af-4a8e91d59324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:08.626932 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f1e25-bc21-4a45-a2af-4a8e91d59324 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:08.627841 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f1e25-bc21-4a45-a2af-4a8e91d59324 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:08.628152 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f1e25-bc21-4a45-a2af-4a8e91d59324 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:08.630034 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f1e25-bc21-4a45-a2af-4a8e91d59324 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:08.649769 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 428/853] 10.222.0.77 () {56 vars in 1156 bytes} [Thu Feb 10 23:04:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:08.655324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418aa442-cac2-4256-ab24-2089ca33fc0b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:08.665058 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418aa442-cac2-4256-ab24-2089ca33fc0b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:08.669581 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d57b4-7ca7-469f-9620-618bbd6827c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:08.670300 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d57b4-7ca7-469f-9620-618bbd6827c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:08.670584 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d57b4-7ca7-469f-9620-618bbd6827c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:08.670852 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d57b4-7ca7-469f-9620-618bbd6827c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:08.679534 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d57b4-7ca7-469f-9620-618bbd6827c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:08.681389 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d57b4-7ca7-469f-9620-618bbd6827c6 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:08.688360 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90fdb4-d0ca-429a-bc6f-d8552a46ac47 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:08.688750 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90fdb4-d0ca-429a-bc6f-d8552a46ac47 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:08.689095 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90fdb4-d0ca-429a-bc6f-d8552a46ac47 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:08.691040 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 429/854] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:04:08.695022 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 426/855] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:04:08 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:04:08.699511 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ca5f1-bec6-4a25-83f4-8d8b7f0a62f2 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:08.699511 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ca5f1-bec6-4a25-83f4-8d8b7f0a62f2 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:08.699511 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ca5f1-bec6-4a25-83f4-8d8b7f0a62f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:08.701538 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d57b4-7ca7-469f-9620-618bbd6827c6 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:08.711284 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d57b4-7ca7-469f-9620-618bbd6827c6 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:08.716609 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca4df2-f4e4-4660-853b-e90b287fd2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:08.717381 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca4df2-f4e4-4660-853b-e90b287fd2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:08.717672 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca4df2-f4e4-4660-853b-e90b287fd2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:08.717947 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca4df2-f4e4-4660-853b-e90b287fd2d7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:08.719774 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-2e5ca5f1-bec6-4a25-83f4-8d8b7f0a62f2 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:08.721240 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2e5ca5f1-bec6-4a25-83f4-8d8b7f0a62f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:08.729306 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca4df2-f4e4-4660-853b-e90b287fd2d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:08.730249 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 430/856] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:08 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:08.731142 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca4df2-f4e4-4660-853b-e90b287fd2d7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:08.753962 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-43ca4df2-f4e4-4660-853b-e90b287fd2d7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:08.755062 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 427/857] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:08.756053 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ca5f1-bec6-4a25-83f4-8d8b7f0a62f2 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:08.765583 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca4df2-f4e4-4660-853b-e90b287fd2d7 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:08.769275 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ca5f1-bec6-4a25-83f4-8d8b7f0a62f2 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:08.774945 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0718e9e-4ff8-485f-854d-cbacf04086f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:08.775913 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0718e9e-4ff8-485f-854d-cbacf04086f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:08.776301 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0718e9e-4ff8-485f-854d-cbacf04086f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:08.776695 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0718e9e-4ff8-485f-854d-cbacf04086f0 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:08.777355 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca4df2-f4e4-4660-853b-e90b287fd2d7 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:08.777549 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0718e9e-4ff8-485f-854d-cbacf04086f0 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:08.779217 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0718e9e-4ff8-485f-854d-cbacf04086f0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:08.782525 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d488f-198a-4ff8-a84b-b56a61f280ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:08.783379 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d488f-198a-4ff8-a84b-b56a61f280ff admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:08.783804 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d488f-198a-4ff8-a84b-b56a61f280ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:08.784266 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d488f-198a-4ff8-a84b-b56a61f280ff admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:08.785232 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d488f-198a-4ff8-a84b-b56a61f280ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:08.785704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d488f-198a-4ff8-a84b-b56a61f280ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:08.788297 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d488f-198a-4ff8-a84b-b56a61f280ff admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:08.792317 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-a0718e9e-4ff8-485f-854d-cbacf04086f0 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 10 23:04:08.798590 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 431/858] 10.222.0.77 () {56 vars in 1153 bytes} [Thu Feb 10 23:04:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:08.799591 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0718e9e-4ff8-485f-854d-cbacf04086f0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:08.806874 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 428/859] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:08.807964 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d488f-198a-4ff8-a84b-b56a61f280ff admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:08.810664 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0718e9e-4ff8-485f-854d-cbacf04086f0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:08.815311 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100b43e-7918-4055-93dd-34167b19bbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:08.816142 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100b43e-7918-4055-93dd-34167b19bbdf admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:08.816511 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100b43e-7918-4055-93dd-34167b19bbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:08.816886 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100b43e-7918-4055-93dd-34167b19bbdf admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:08.817778 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100b43e-7918-4055-93dd-34167b19bbdf admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:08.818189 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100b43e-7918-4055-93dd-34167b19bbdf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:08.819630 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d488f-198a-4ff8-a84b-b56a61f280ff admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:08.819983 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100b43e-7918-4055-93dd-34167b19bbdf admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:08.825053 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 432/860] 10.222.0.77 () {56 vars in 1147 bytes} [Thu Feb 10 23:04:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:08.825591 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b08abd-940e-4339-bafb-edcf715bd16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:08.826626 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b08abd-940e-4339-bafb-edcf715bd16a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:08.827032 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b08abd-940e-4339-bafb-edcf715bd16a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:08.827447 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b08abd-940e-4339-bafb-edcf715bd16a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:08.830394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100b43e-7918-4055-93dd-34167b19bbdf admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:08.836406 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b08abd-940e-4339-bafb-edcf715bd16a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:08.839492 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b08abd-940e-4339-bafb-edcf715bd16a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:08.840726 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100b43e-7918-4055-93dd-34167b19bbdf admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:08.845302 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e639f6c-227e-4044-938a-c4972dc1b9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:08.846076 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e639f6c-227e-4044-938a-c4972dc1b9ec admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:08.846462 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e639f6c-227e-4044-938a-c4972dc1b9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:08.846841 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e639f6c-227e-4044-938a-c4972dc1b9ec admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:08.847666 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e639f6c-227e-4044-938a-c4972dc1b9ec admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:08.848113 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e639f6c-227e-4044-938a-c4972dc1b9ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:08.850359 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e639f6c-227e-4044-938a-c4972dc1b9ec admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:08.855187 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 433/861] 10.222.0.77 () {56 vars in 1147 bytes} [Thu Feb 10 23:04:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:08.857365 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-27b08abd-940e-4339-bafb-edcf715bd16a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:04:08.858697 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 429/862] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:04:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:08.870595 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e639f6c-227e-4044-938a-c4972dc1b9ec admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:08.881621 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e639f6c-227e-4044-938a-c4972dc1b9ec admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:08.886816 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24164da2-2a33-4616-8cd3-62e6f6aed127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:08.887690 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24164da2-2a33-4616-8cd3-62e6f6aed127 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:08.888106 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24164da2-2a33-4616-8cd3-62e6f6aed127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:08.888510 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24164da2-2a33-4616-8cd3-62e6f6aed127 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:08.889482 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24164da2-2a33-4616-8cd3-62e6f6aed127 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:08.889892 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24164da2-2a33-4616-8cd3-62e6f6aed127 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:08.892017 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24164da2-2a33-4616-8cd3-62e6f6aed127 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:08.906553 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 434/863] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:04:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:08.913436 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b08abd-940e-4339-bafb-edcf715bd16a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:08.925100 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b08abd-940e-4339-bafb-edcf715bd16a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:08.930434 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4826e9c-6760-4ccf-b374-a0f0d5fb5754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:08.931270 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4826e9c-6760-4ccf-b374-a0f0d5fb5754 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:08.931690 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4826e9c-6760-4ccf-b374-a0f0d5fb5754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:08.932099 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4826e9c-6760-4ccf-b374-a0f0d5fb5754 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:08.933130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4826e9c-6760-4ccf-b374-a0f0d5fb5754 admin admin] RBAC: Adding query filter params (role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=ce55b64dc528447993e32b00ae4d3a2a) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:08.933568 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4826e9c-6760-4ccf-b374-a0f0d5fb5754 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:08.935702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4826e9c-6760-4ccf-b374-a0f0d5fb5754 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:08.943253 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 430/864] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:04:08 2022] GET /identity/v3/role_assignments?user.id=ce55b64dc528447993e32b00ae4d3a2a&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:09.456614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2169d-03f3-46e0-8277-15e027fcb8bf None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:09.456908 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2169d-03f3-46e0-8277-15e027fcb8bf None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:09.457191 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2169d-03f3-46e0-8277-15e027fcb8bf None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:09.459877 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 435/865] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:09.465086 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee9ebe-7625-4105-9171-df4118ad7f2f None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:09.465490 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee9ebe-7625-4105-9171-df4118ad7f2f None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:09.465872 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee9ebe-7625-4105-9171-df4118ad7f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:09.485546 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-8eee9ebe-7625-4105-9171-df4118ad7f2f None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:09.487162 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-8eee9ebe-7625-4105-9171-df4118ad7f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:09.495195 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 431/866] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:09 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:09.522410 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2169d-03f3-46e0-8277-15e027fcb8bf None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:09.536442 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2169d-03f3-46e0-8277-15e027fcb8bf None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:09.541598 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f896ae-f2f9-4317-bf61-586232b48ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:09.542729 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f896ae-f2f9-4317-bf61-586232b48ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:09.543431 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f896ae-f2f9-4317-bf61-586232b48ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:09.544163 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f896ae-f2f9-4317-bf61-586232b48ae4 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:09.545632 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f896ae-f2f9-4317-bf61-586232b48ae4 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:09.548944 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f896ae-f2f9-4317-bf61-586232b48ae4 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:09.564005 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-50f896ae-f2f9-4317-bf61-586232b48ae4 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 10 23:04:09.565693 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 436/867] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:04:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:09.572471 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee9ebe-7625-4105-9171-df4118ad7f2f None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:09.581981 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee9ebe-7625-4105-9171-df4118ad7f2f None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:09.587575 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a87ce-3358-41fb-aa18-36b307ae25c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:09.588469 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a87ce-3358-41fb-aa18-36b307ae25c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:09.588916 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a87ce-3358-41fb-aa18-36b307ae25c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:09.589339 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a87ce-3358-41fb-aa18-36b307ae25c5 admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:09.590210 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a87ce-3358-41fb-aa18-36b307ae25c5 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:09.590669 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a87ce-3358-41fb-aa18-36b307ae25c5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:09.592460 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a87ce-3358-41fb-aa18-36b307ae25c5 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:09.597718 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 432/868] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:04:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:09.604026 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f896ae-f2f9-4317-bf61-586232b48ae4 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:09.614259 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f896ae-f2f9-4317-bf61-586232b48ae4 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:09.619639 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47cc06-20be-4173-ac32-23cfd08eb8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:09.620506 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47cc06-20be-4173-ac32-23cfd08eb8ff admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:09.620940 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47cc06-20be-4173-ac32-23cfd08eb8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:09.621362 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47cc06-20be-4173-ac32-23cfd08eb8ff admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:09.622241 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47cc06-20be-4173-ac32-23cfd08eb8ff admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:09.622699 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47cc06-20be-4173-ac32-23cfd08eb8ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:09.624545 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47cc06-20be-4173-ac32-23cfd08eb8ff admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:09.629686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 437/869] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:04:09 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:10.072730 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfa5ee-283e-4986-acfe-c7456972156f None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:10.073012 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfa5ee-283e-4986-acfe-c7456972156f None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:10.073283 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfa5ee-283e-4986-acfe-c7456972156f None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:10.075696 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 433/870] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:10.083048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5714f1-07fc-4d21-9c48-724f31eaf1bc None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:10.083984 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5714f1-07fc-4d21-9c48-724f31eaf1bc None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:10.084272 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5714f1-07fc-4d21-9c48-724f31eaf1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:10.102099 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-9a5714f1-07fc-4d21-9c48-724f31eaf1bc None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:10.103268 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-9a5714f1-07fc-4d21-9c48-724f31eaf1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:10.115918 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 438/871] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:10 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:10.135261 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfa5ee-283e-4986-acfe-c7456972156f None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:10.148163 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfa5ee-283e-4986-acfe-c7456972156f None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:10.152405 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b635f-3b20-4afc-aec8-0baff73a8f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:10.153211 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b635f-3b20-4afc-aec8-0baff73a8f5f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:10.153488 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b635f-3b20-4afc-aec8-0baff73a8f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:10.153759 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b635f-3b20-4afc-aec8-0baff73a8f5f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:10.165118 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b635f-3b20-4afc-aec8-0baff73a8f5f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:04:10.172401 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-586b635f-3b20-4afc-aec8-0baff73a8f5f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 10 23:04:10.178501 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 434/872] 10.222.0.77 () {56 vars in 1141 bytes} [Thu Feb 10 23:04:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:10.179829 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5714f1-07fc-4d21-9c48-724f31eaf1bc None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:10.188719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5714f1-07fc-4d21-9c48-724f31eaf1bc None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:10.193600 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ef850-61c8-4faa-ad23-a4364755ccb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:10.194243 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ef850-61c8-4faa-ad23-a4364755ccb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:10.194523 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ef850-61c8-4faa-ad23-a4364755ccb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:10.194792 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ef850-61c8-4faa-ad23-a4364755ccb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:10.195536 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ef850-61c8-4faa-ad23-a4364755ccb3 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:10.195856 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ef850-61c8-4faa-ad23-a4364755ccb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:10.197428 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ef850-61c8-4faa-ad23-a4364755ccb3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:10.209843 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 439/873] 10.222.0.77 () {56 vars in 1136 bytes} [Thu Feb 10 23:04:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:10.211705 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b635f-3b20-4afc-aec8-0baff73a8f5f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:10.221286 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b635f-3b20-4afc-aec8-0baff73a8f5f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:10.226455 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1b5a7-b396-40dc-bc8e-8fb63227858a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:10.227218 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1b5a7-b396-40dc-bc8e-8fb63227858a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:10.227496 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1b5a7-b396-40dc-bc8e-8fb63227858a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:10.227767 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1b5a7-b396-40dc-bc8e-8fb63227858a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:10.238847 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1b5a7-b396-40dc-bc8e-8fb63227858a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:10.240929 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1b5a7-b396-40dc-bc8e-8fb63227858a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:10.257295 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-9aa1b5a7-b396-40dc-bc8e-8fb63227858a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:10.262957 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 435/874] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:10.264291 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ef850-61c8-4faa-ad23-a4364755ccb3 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:10.274592 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ef850-61c8-4faa-ad23-a4364755ccb3 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:10.279805 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be710a-f53d-43ec-9e55-678e2b5dfe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:10.280552 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be710a-f53d-43ec-9e55-678e2b5dfe6f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:10.280832 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be710a-f53d-43ec-9e55-678e2b5dfe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:10.281106 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be710a-f53d-43ec-9e55-678e2b5dfe6f admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:10.281835 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be710a-f53d-43ec-9e55-678e2b5dfe6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:10.282268 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be710a-f53d-43ec-9e55-678e2b5dfe6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:10.283875 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be710a-f53d-43ec-9e55-678e2b5dfe6f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:10.301258 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 440/875] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:10.302631 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1b5a7-b396-40dc-bc8e-8fb63227858a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:10.312516 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1b5a7-b396-40dc-bc8e-8fb63227858a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:10.317043 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10786f6-6cd5-4513-81c1-0b868c486a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:10.318025 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10786f6-6cd5-4513-81c1-0b868c486a7e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:10.318302 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10786f6-6cd5-4513-81c1-0b868c486a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:10.318577 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10786f6-6cd5-4513-81c1-0b868c486a7e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:10.327058 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10786f6-6cd5-4513-81c1-0b868c486a7e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:10.329000 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10786f6-6cd5-4513-81c1-0b868c486a7e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:10.343429 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-b10786f6-6cd5-4513-81c1-0b868c486a7e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 10 23:04:10.349625 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 436/876] 10.222.0.77 () {56 vars in 1138 bytes} [Thu Feb 10 23:04:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:10.351249 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be710a-f53d-43ec-9e55-678e2b5dfe6f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:10.361348 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be710a-f53d-43ec-9e55-678e2b5dfe6f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:10.366100 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc3b85-f9cf-4932-a8ce-3a6368c2cc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:10.366741 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc3b85-f9cf-4932-a8ce-3a6368c2cc51 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:10.367070 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc3b85-f9cf-4932-a8ce-3a6368c2cc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:10.367342 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc3b85-f9cf-4932-a8ce-3a6368c2cc51 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:10.368262 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc3b85-f9cf-4932-a8ce-3a6368c2cc51 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:10.368565 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc3b85-f9cf-4932-a8ce-3a6368c2cc51 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:10.370470 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc3b85-f9cf-4932-a8ce-3a6368c2cc51 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:10.388420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 441/877] 10.222.0.77 () {56 vars in 1170 bytes} [Thu Feb 10 23:04:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:10.394181 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10786f6-6cd5-4513-81c1-0b868c486a7e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:10.404704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10786f6-6cd5-4513-81c1-0b868c486a7e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:10.409344 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764b25e-e6d9-4e96-aa26-fe2ed073d67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:10.410027 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764b25e-e6d9-4e96-aa26-fe2ed073d67e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:10.410311 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764b25e-e6d9-4e96-aa26-fe2ed073d67e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:10.410583 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764b25e-e6d9-4e96-aa26-fe2ed073d67e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:10.419330 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764b25e-e6d9-4e96-aa26-fe2ed073d67e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:10.421071 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764b25e-e6d9-4e96-aa26-fe2ed073d67e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:10.434920 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 437/878] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:04:10 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:04:10.436294 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc3b85-f9cf-4932-a8ce-3a6368c2cc51 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:10.446570 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc3b85-f9cf-4932-a8ce-3a6368c2cc51 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:10.452252 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4fe91-b41d-491e-af86-73621adc0fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:10.453141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4fe91-b41d-491e-af86-73621adc0fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:10.453541 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4fe91-b41d-491e-af86-73621adc0fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:10.453976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4fe91-b41d-491e-af86-73621adc0fb3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:10.465044 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4fe91-b41d-491e-af86-73621adc0fb3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:10.466996 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4fe91-b41d-491e-af86-73621adc0fb3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:10.484259 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-4df4fe91-b41d-491e-af86-73621adc0fb3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:10.485753 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 442/879] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:10.492230 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764b25e-e6d9-4e96-aa26-fe2ed073d67e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:10.501223 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764b25e-e6d9-4e96-aa26-fe2ed073d67e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:10.506325 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea30cd2-1b27-44b9-aee2-838074ad3246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:10.506967 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea30cd2-1b27-44b9-aee2-838074ad3246 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:10.507251 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea30cd2-1b27-44b9-aee2-838074ad3246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:10.507526 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea30cd2-1b27-44b9-aee2-838074ad3246 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:10.508296 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea30cd2-1b27-44b9-aee2-838074ad3246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:10.508601 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea30cd2-1b27-44b9-aee2-838074ad3246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:10.510221 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea30cd2-1b27-44b9-aee2-838074ad3246 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:10.527459 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 438/880] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:10.528851 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4fe91-b41d-491e-af86-73621adc0fb3 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:10.539320 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4fe91-b41d-491e-af86-73621adc0fb3 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:10.544080 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3f30a-f0c3-4e9e-b56b-5be2478ae59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:10.545104 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3f30a-f0c3-4e9e-b56b-5be2478ae59c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:10.545602 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3f30a-f0c3-4e9e-b56b-5be2478ae59c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:10.546071 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3f30a-f0c3-4e9e-b56b-5be2478ae59c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:10.554166 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3f30a-f0c3-4e9e-b56b-5be2478ae59c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:10.556392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3f30a-f0c3-4e9e-b56b-5be2478ae59c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:10.570178 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-d6d3f30a-f0c3-4e9e-b56b-5be2478ae59c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:04:10.571670 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 443/881] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:04:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:10.577288 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea30cd2-1b27-44b9-aee2-838074ad3246 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:10.587965 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea30cd2-1b27-44b9-aee2-838074ad3246 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:10.592677 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83818b37-5939-40b2-95ed-b9b7204b856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:10.593540 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83818b37-5939-40b2-95ed-b9b7204b856d admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:10.594036 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83818b37-5939-40b2-95ed-b9b7204b856d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:10.594508 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83818b37-5939-40b2-95ed-b9b7204b856d admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:10.595478 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83818b37-5939-40b2-95ed-b9b7204b856d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:10.596022 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83818b37-5939-40b2-95ed-b9b7204b856d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:10.598054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83818b37-5939-40b2-95ed-b9b7204b856d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:10.615935 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 439/882] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:04:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:10.618443 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3f30a-f0c3-4e9e-b56b-5be2478ae59c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:10.629328 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3f30a-f0c3-4e9e-b56b-5be2478ae59c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:10.634847 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396d44b-e368-41cd-b32b-f4ac4b40a786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:10.635803 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396d44b-e368-41cd-b32b-f4ac4b40a786 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:10.636345 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396d44b-e368-41cd-b32b-f4ac4b40a786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:10.636855 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396d44b-e368-41cd-b32b-f4ac4b40a786 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:10.637894 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396d44b-e368-41cd-b32b-f4ac4b40a786 admin admin] RBAC: Adding query filter params (role.id=ba41bad22bbb402082f3c8d0b387644b, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=9dca4ea4f2c8490e823a73dca6c303ed) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:10.638429 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396d44b-e368-41cd-b32b-f4ac4b40a786 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:10.640590 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396d44b-e368-41cd-b32b-f4ac4b40a786 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:10.651945 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 444/883] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:04:10 2022] GET /identity/v3/role_assignments?user.id=9dca4ea4f2c8490e823a73dca6c303ed&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=ba41bad22bbb402082f3c8d0b387644b => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:11.212709 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100c9fd-9eab-46de-a11c-6887695ada89 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:11.213063 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100c9fd-9eab-46de-a11c-6887695ada89 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:11.213259 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100c9fd-9eab-46de-a11c-6887695ada89 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:11.215190 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 440/884] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:11.220382 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4d383-d144-476d-b212-f2e9e17538a9 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:11.220671 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4d383-d144-476d-b212-f2e9e17538a9 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:11.220947 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4d383-d144-476d-b212-f2e9e17538a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:11.240432 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-15c4d383-d144-476d-b212-f2e9e17538a9 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:11.241604 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-15c4d383-d144-476d-b212-f2e9e17538a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:11.249458 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 445/885] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:11 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:11.272252 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100c9fd-9eab-46de-a11c-6887695ada89 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:11.273421 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6027a3a-4b1d-490f-ac4e-6cb9a1472811 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:11.273703 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6027a3a-4b1d-490f-ac4e-6cb9a1472811 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:11.273975 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6027a3a-4b1d-490f-ac4e-6cb9a1472811 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:11.276116 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 446/886] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:11.281361 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d50b5-3647-4b60-8104-5b46ef5461af None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:11.281651 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d50b5-3647-4b60-8104-5b46ef5461af None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:11.281942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d50b5-3647-4b60-8104-5b46ef5461af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:11.287525 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100c9fd-9eab-46de-a11c-6887695ada89 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:11.293522 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4289d6-c890-420a-8ad9-5b8a53e710f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:11.294416 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4289d6-c890-420a-8ad9-5b8a53e710f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:11.295317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4289d6-c890-420a-8ad9-5b8a53e710f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:11.295794 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4289d6-c890-420a-8ad9-5b8a53e710f6 admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:11.296848 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4289d6-c890-420a-8ad9-5b8a53e710f6 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:11.298696 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4289d6-c890-420a-8ad9-5b8a53e710f6 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:11.314943 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 441/887] 10.222.0.77 () {60 vars in 1162 bytes} [Thu Feb 10 23:04:11 2022] POST /identity/v3/services => generated 269 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:04:11.421407 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-ec3d50b5-3647-4b60-8104-5b46ef5461af None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:11.422611 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-ec3d50b5-3647-4b60-8104-5b46ef5461af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:11.440530 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 447/888] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:11 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:04:11.464029 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4289d6-c890-420a-8ad9-5b8a53e710f6 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:11.476944 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4289d6-c890-420a-8ad9-5b8a53e710f6 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:11.481547 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b73ab-e8b7-4de2-8a0d-1f1aaa59336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:11.482373 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b73ab-e8b7-4de2-8a0d-1f1aaa59336f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:11.482709 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b73ab-e8b7-4de2-8a0d-1f1aaa59336f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:11.482990 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b73ab-e8b7-4de2-8a0d-1f1aaa59336f admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:11.483665 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b73ab-e8b7-4de2-8a0d-1f1aaa59336f admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:11.485334 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b73ab-e8b7-4de2-8a0d-1f1aaa59336f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:11.498469 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-582b73ab-e8b7-4de2-8a0d-1f1aaa59336f admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 10 23:04:11.500106 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 442/889] 10.222.0.77 () {56 vars in 1147 bytes} [Thu Feb 10 23:04:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:11.506007 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d50b5-3647-4b60-8104-5b46ef5461af None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:11.515706 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d50b5-3647-4b60-8104-5b46ef5461af None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:11.520984 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f2dda-dfd8-43a4-b793-1eb37cd24731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:11.521747 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f2dda-dfd8-43a4-b793-1eb37cd24731 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:11.522025 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f2dda-dfd8-43a4-b793-1eb37cd24731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:11.522292 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f2dda-dfd8-43a4-b793-1eb37cd24731 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:11.523015 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f2dda-dfd8-43a4-b793-1eb37cd24731 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:11.523312 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f2dda-dfd8-43a4-b793-1eb37cd24731 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:11.524931 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f2dda-dfd8-43a4-b793-1eb37cd24731 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:11.529917 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 448/890] 10.222.0.77 () {56 vars in 1143 bytes} [Thu Feb 10 23:04:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:11.535875 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b73ab-e8b7-4de2-8a0d-1f1aaa59336f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:11.546510 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b73ab-e8b7-4de2-8a0d-1f1aaa59336f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:11.551033 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac2c45-9c6f-413e-859b-74af8bdcab53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:11.551682 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac2c45-9c6f-413e-859b-74af8bdcab53 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:11.552734 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac2c45-9c6f-413e-859b-74af8bdcab53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:11.552922 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac2c45-9c6f-413e-859b-74af8bdcab53 admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:11.553600 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac2c45-9c6f-413e-859b-74af8bdcab53 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:11.553898 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac2c45-9c6f-413e-859b-74af8bdcab53 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:11.555471 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac2c45-9c6f-413e-859b-74af8bdcab53 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:11.561321 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 443/891] 10.222.0.77 () {56 vars in 1143 bytes} [Thu Feb 10 23:04:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:11.939679 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b9eb5-3110-4cb0-b3ad-d5adece2b4fb None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:11.940243 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b9eb5-3110-4cb0-b3ad-d5adece2b4fb None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:11.940243 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b9eb5-3110-4cb0-b3ad-d5adece2b4fb None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:11.942277 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 449/892] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:11.948268 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29da8f-62a6-4e6d-aa88-c873c521865e None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:11.948675 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29da8f-62a6-4e6d-aa88-c873c521865e None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:11.948847 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29da8f-62a6-4e6d-aa88-c873c521865e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:11.966503 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-5d29da8f-62a6-4e6d-aa88-c873c521865e None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:11.967697 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-5d29da8f-62a6-4e6d-aa88-c873c521865e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:11.976157 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 444/893] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:11 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:11.998758 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b9eb5-3110-4cb0-b3ad-d5adece2b4fb None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:12.010943 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b9eb5-3110-4cb0-b3ad-d5adece2b4fb None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:12.015287 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a3663-5335-491a-8a49-77fffafabc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:12.015958 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a3663-5335-491a-8a49-77fffafabc9c admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:12.016304 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a3663-5335-491a-8a49-77fffafabc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:12.016580 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a3663-5335-491a-8a49-77fffafabc9c admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:12.017372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a3663-5335-491a-8a49-77fffafabc9c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:12.018957 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a3663-5335-491a-8a49-77fffafabc9c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:12.038057 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 450/894] 10.222.0.77 () {60 vars in 1162 bytes} [Thu Feb 10 23:04:11 2022] POST /identity/v3/services => generated 251 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:04:12.935176 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dc3e0-f320-4507-8742-9345965c9125 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:12.935981 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dc3e0-f320-4507-8742-9345965c9125 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:12.936487 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dc3e0-f320-4507-8742-9345965c9125 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:12.938667 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 445/895] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:12.944776 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd990e40-93e6-4279-b0f3-efd6e75fb562 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:12.945644 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd990e40-93e6-4279-b0f3-efd6e75fb562 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:12.946109 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd990e40-93e6-4279-b0f3-efd6e75fb562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:12.964403 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-fd990e40-93e6-4279-b0f3-efd6e75fb562 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:12.965877 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-fd990e40-93e6-4279-b0f3-efd6e75fb562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:12.982860 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 451/896] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:12 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:13.006282 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dc3e0-f320-4507-8742-9345965c9125 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:13.019093 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dc3e0-f320-4507-8742-9345965c9125 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:13.024378 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd455e-5760-47d3-8cde-36c4939c16f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:13.025410 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd455e-5760-47d3-8cde-36c4939c16f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:13.025907 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd455e-5760-47d3-8cde-36c4939c16f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:13.026369 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd455e-5760-47d3-8cde-36c4939c16f6 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:13.037510 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd455e-5760-47d3-8cde-36c4939c16f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:04:13.045000 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-0bfd455e-5760-47d3-8cde-36c4939c16f6 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 10 23:04:13.046687 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 446/897] 10.222.0.77 () {56 vars in 1141 bytes} [Thu Feb 10 23:04:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:13.052647 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd990e40-93e6-4279-b0f3-efd6e75fb562 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:13.061747 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd990e40-93e6-4279-b0f3-efd6e75fb562 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:13.066454 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc4fe7-3566-4560-827d-d3c23c249609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:13.067328 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc4fe7-3566-4560-827d-d3c23c249609 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:13.068337 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc4fe7-3566-4560-827d-d3c23c249609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:13.068819 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc4fe7-3566-4560-827d-d3c23c249609 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:13.069760 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc4fe7-3566-4560-827d-d3c23c249609 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:13.070252 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc4fe7-3566-4560-827d-d3c23c249609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:13.072056 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc4fe7-3566-4560-827d-d3c23c249609 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:13.081008 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 452/898] 10.222.0.77 () {56 vars in 1136 bytes} [Thu Feb 10 23:04:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:13.089138 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd455e-5760-47d3-8cde-36c4939c16f6 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:13.099476 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd455e-5760-47d3-8cde-36c4939c16f6 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:13.104227 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecd970-ee99-4eea-997b-bca64d552e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:13.105008 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecd970-ee99-4eea-997b-bca64d552e46 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:13.105288 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecd970-ee99-4eea-997b-bca64d552e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:13.105563 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecd970-ee99-4eea-997b-bca64d552e46 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:13.116863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecd970-ee99-4eea-997b-bca64d552e46 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:13.118676 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecd970-ee99-4eea-997b-bca64d552e46 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:13.135680 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-81ecd970-ee99-4eea-997b-bca64d552e46 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:13.137231 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 447/899] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:13.142791 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc4fe7-3566-4560-827d-d3c23c249609 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:13.153561 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc4fe7-3566-4560-827d-d3c23c249609 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:13.158191 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad196b28-c719-4ab7-9579-7d702064c0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:13.158889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad196b28-c719-4ab7-9579-7d702064c0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:13.159168 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad196b28-c719-4ab7-9579-7d702064c0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:13.159442 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad196b28-c719-4ab7-9579-7d702064c0b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:13.160260 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad196b28-c719-4ab7-9579-7d702064c0b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:13.160561 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad196b28-c719-4ab7-9579-7d702064c0b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:13.162775 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad196b28-c719-4ab7-9579-7d702064c0b8 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:13.180178 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 453/900] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:13.185400 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecd970-ee99-4eea-997b-bca64d552e46 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:13.195831 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecd970-ee99-4eea-997b-bca64d552e46 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:13.201984 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77373d4c-b167-4709-a06e-5f697b8cb698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:13.202841 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77373d4c-b167-4709-a06e-5f697b8cb698 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:13.203122 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77373d4c-b167-4709-a06e-5f697b8cb698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:13.203392 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77373d4c-b167-4709-a06e-5f697b8cb698 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:13.212165 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77373d4c-b167-4709-a06e-5f697b8cb698 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:13.214156 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77373d4c-b167-4709-a06e-5f697b8cb698 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:13.229489 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-77373d4c-b167-4709-a06e-5f697b8cb698 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 10 23:04:13.230961 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 448/901] 10.222.0.77 () {56 vars in 1138 bytes} [Thu Feb 10 23:04:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:13.236829 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad196b28-c719-4ab7-9579-7d702064c0b8 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:13.246814 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad196b28-c719-4ab7-9579-7d702064c0b8 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:13.251391 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d01e28-897e-4851-8fb3-ab3a1c872c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:13.252112 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d01e28-897e-4851-8fb3-ab3a1c872c18 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:13.252394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d01e28-897e-4851-8fb3-ab3a1c872c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:13.252665 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d01e28-897e-4851-8fb3-ab3a1c872c18 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:13.253568 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d01e28-897e-4851-8fb3-ab3a1c872c18 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:13.253869 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d01e28-897e-4851-8fb3-ab3a1c872c18 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:13.256031 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d01e28-897e-4851-8fb3-ab3a1c872c18 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:13.274981 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 454/902] 10.222.0.77 () {56 vars in 1170 bytes} [Thu Feb 10 23:04:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:13.280827 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77373d4c-b167-4709-a06e-5f697b8cb698 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:13.292526 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77373d4c-b167-4709-a06e-5f697b8cb698 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:13.297238 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64234495-8294-4b9f-bf93-a0771eba570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:13.298022 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64234495-8294-4b9f-bf93-a0771eba570a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:13.298351 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64234495-8294-4b9f-bf93-a0771eba570a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:13.298622 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64234495-8294-4b9f-bf93-a0771eba570a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:13.309512 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64234495-8294-4b9f-bf93-a0771eba570a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:13.311421 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64234495-8294-4b9f-bf93-a0771eba570a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:13.328259 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-64234495-8294-4b9f-bf93-a0771eba570a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:13.329803 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 449/903] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:13.335768 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d01e28-897e-4851-8fb3-ab3a1c872c18 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:13.345843 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d01e28-897e-4851-8fb3-ab3a1c872c18 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:13.351120 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6f5de-45bb-4e70-a4e8-e33e9c163375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:13.351779 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6f5de-45bb-4e70-a4e8-e33e9c163375 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:13.352094 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6f5de-45bb-4e70-a4e8-e33e9c163375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:13.352378 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6f5de-45bb-4e70-a4e8-e33e9c163375 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:13.353124 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6f5de-45bb-4e70-a4e8-e33e9c163375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:13.353425 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6f5de-45bb-4e70-a4e8-e33e9c163375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:13.355008 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6f5de-45bb-4e70-a4e8-e33e9c163375 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:13.367367 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 455/904] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:13.372791 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64234495-8294-4b9f-bf93-a0771eba570a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:13.382400 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64234495-8294-4b9f-bf93-a0771eba570a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:13.386994 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d429e00-75b7-44b7-b0fe-0df01054bc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:13.387807 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d429e00-75b7-44b7-b0fe-0df01054bc14 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:13.388112 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d429e00-75b7-44b7-b0fe-0df01054bc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:13.388380 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d429e00-75b7-44b7-b0fe-0df01054bc14 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:13.395470 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d429e00-75b7-44b7-b0fe-0df01054bc14 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:13.398037 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d429e00-75b7-44b7-b0fe-0df01054bc14 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:13.412247 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-1d429e00-75b7-44b7-b0fe-0df01054bc14 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:04:13.413966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 450/905] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:04:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:13.419651 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6f5de-45bb-4e70-a4e8-e33e9c163375 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:13.430472 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6f5de-45bb-4e70-a4e8-e33e9c163375 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:13.435752 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7e380-8182-429b-8a10-6f4be6e84b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:13.436796 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7e380-8182-429b-8a10-6f4be6e84b69 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:13.437317 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7e380-8182-429b-8a10-6f4be6e84b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:13.437797 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7e380-8182-429b-8a10-6f4be6e84b69 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:13.438847 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7e380-8182-429b-8a10-6f4be6e84b69 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:13.439371 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7e380-8182-429b-8a10-6f4be6e84b69 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:13.441488 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7e380-8182-429b-8a10-6f4be6e84b69 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:13.455337 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 456/906] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:04:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:13.462174 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d429e00-75b7-44b7-b0fe-0df01054bc14 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:13.472446 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d429e00-75b7-44b7-b0fe-0df01054bc14 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:13.477611 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2814afb-3b27-451a-a987-883ea4c9b098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:13.478466 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2814afb-3b27-451a-a987-883ea4c9b098 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:13.478742 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2814afb-3b27-451a-a987-883ea4c9b098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:13.479010 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2814afb-3b27-451a-a987-883ea4c9b098 admin admin] PATH_INFO: `/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/9dca4ea4f2c8490e823a73dca6c303ed/roles/ba41bad22bbb402082f3c8d0b387644b` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:13.481256 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2814afb-3b27-451a-a987-883ea4c9b098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ab195cc240497c9ac12843d738c4b9, user_id=9dca4ea4f2c8490e823a73dca6c303ed, role_id=ba41bad22bbb402082f3c8d0b387644b)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:13.483882 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2814afb-3b27-451a-a987-883ea4c9b098 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:13.500321 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 451/907] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:04:13 2022] PUT /identity/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/9dca4ea4f2c8490e823a73dca6c303ed/roles/ba41bad22bbb402082f3c8d0b387644b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:04:13.723377 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959c16a-dced-4c0b-bb4b-a3eaa8c9c4ce None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:13.724279 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959c16a-dced-4c0b-bb4b-a3eaa8c9c4ce None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:13.724438 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959c16a-dced-4c0b-bb4b-a3eaa8c9c4ce None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:13.726836 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 457/908] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:13.732386 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40898236-ce67-4515-be30-7c456aa76dab None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:13.732953 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40898236-ce67-4515-be30-7c456aa76dab None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:13.733450 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40898236-ce67-4515-be30-7c456aa76dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:13.752754 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-40898236-ce67-4515-be30-7c456aa76dab None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:13.754246 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-40898236-ce67-4515-be30-7c456aa76dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:13.813915 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 452/909] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:13 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:13.838539 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959c16a-dced-4c0b-bb4b-a3eaa8c9c4ce None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:13.853918 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959c16a-dced-4c0b-bb4b-a3eaa8c9c4ce None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:13.858291 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26ad25-95d9-4ba6-9d5b-a7e73a7aa98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:13.859369 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26ad25-95d9-4ba6-9d5b-a7e73a7aa98f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:13.859933 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26ad25-95d9-4ba6-9d5b-a7e73a7aa98f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:13.860435 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26ad25-95d9-4ba6-9d5b-a7e73a7aa98f admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:13.861614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e26ad25-95d9-4ba6-9d5b-a7e73a7aa98f admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:13.863496 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e26ad25-95d9-4ba6-9d5b-a7e73a7aa98f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:13.876509 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-7e26ad25-95d9-4ba6-9d5b-a7e73a7aa98f admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 10 23:04:13.878310 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 458/910] 10.222.0.77 () {56 vars in 1153 bytes} [Thu Feb 10 23:04:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:13.884295 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40898236-ce67-4515-be30-7c456aa76dab None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:13.893510 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40898236-ce67-4515-be30-7c456aa76dab None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:13.898281 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b83a9-81ae-44cc-9a11-55b80d58de79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:13.898949 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b83a9-81ae-44cc-9a11-55b80d58de79 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:13.899210 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b83a9-81ae-44cc-9a11-55b80d58de79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:13.899480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b83a9-81ae-44cc-9a11-55b80d58de79 admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:13.900242 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b83a9-81ae-44cc-9a11-55b80d58de79 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:13.900541 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b83a9-81ae-44cc-9a11-55b80d58de79 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:13.902111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b83a9-81ae-44cc-9a11-55b80d58de79 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:13.905492 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34192c-7843-4233-8490-18aabff7df97 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:13.905810 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34192c-7843-4233-8490-18aabff7df97 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:13.906090 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34192c-7843-4233-8490-18aabff7df97 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:13.907393 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 453/911] 10.222.0.77 () {56 vars in 1147 bytes} [Thu Feb 10 23:04:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:13.907872 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 459/912] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:04:13.914251 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b83a9-81ae-44cc-9a11-55b80d58de79 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:13.917404 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519ae8b-40f8-45cc-8572-71881b713b7d None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:13.917689 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519ae8b-40f8-45cc-8572-71881b713b7d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:13.917972 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519ae8b-40f8-45cc-8572-71881b713b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:13.925145 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b83a9-81ae-44cc-9a11-55b80d58de79 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:13.930968 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e5136-a1e3-4d37-8802-119b8a6b2cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:13.931929 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e5136-a1e3-4d37-8802-119b8a6b2cda admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:13.932441 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e5136-a1e3-4d37-8802-119b8a6b2cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:13.932930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e5136-a1e3-4d37-8802-119b8a6b2cda admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:13.933840 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e5136-a1e3-4d37-8802-119b8a6b2cda admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:13.934342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e5136-a1e3-4d37-8802-119b8a6b2cda admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:13.936230 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e5136-a1e3-4d37-8802-119b8a6b2cda admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:13.936786 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-f519ae8b-40f8-45cc-8572-71881b713b7d None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:13.937984 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-f519ae8b-40f8-45cc-8572-71881b713b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:13.945896 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 460/914] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:13 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:04:13.946553 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 454/914] 10.222.0.77 () {56 vars in 1147 bytes} [Thu Feb 10 23:04:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:13.951852 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519ae8b-40f8-45cc-8572-71881b713b7d None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:13.960300 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519ae8b-40f8-45cc-8572-71881b713b7d None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:13.964797 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643df8d7-5afe-4407-9ef8-08d13a731476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:13.965442 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643df8d7-5afe-4407-9ef8-08d13a731476 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:13.965726 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643df8d7-5afe-4407-9ef8-08d13a731476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:13.966133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643df8d7-5afe-4407-9ef8-08d13a731476 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:13.967261 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643df8d7-5afe-4407-9ef8-08d13a731476 admin admin] RBAC: Adding query filter params (interface=public, service_id=34113e88e3d349f88546029c302fd817, region_id=RegionOne) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:13.967724 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643df8d7-5afe-4407-9ef8-08d13a731476 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:13.969871 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e5136-a1e3-4d37-8802-119b8a6b2cda admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:13.971187 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643df8d7-5afe-4407-9ef8-08d13a731476 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:13.978136 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 461/915] 10.222.0.77 () {56 vars in 1272 bytes} [Thu Feb 10 23:04:13 2022] GET /identity/v3/endpoints?service_id=34113e88e3d349f88546029c302fd817&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:13.984360 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643df8d7-5afe-4407-9ef8-08d13a731476 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:13.985831 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e5136-a1e3-4d37-8802-119b8a6b2cda admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:13.992115 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee2a5d-5e55-40c5-9ae0-92b8c3acf0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:13.992772 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee2a5d-5e55-40c5-9ae0-92b8c3acf0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:13.993059 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee2a5d-5e55-40c5-9ae0-92b8c3acf0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:13.993333 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee2a5d-5e55-40c5-9ae0-92b8c3acf0c1 admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:13.994078 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee2a5d-5e55-40c5-9ae0-92b8c3acf0c1 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:13.995661 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee2a5d-5e55-40c5-9ae0-92b8c3acf0c1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:13.996180 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643df8d7-5afe-4407-9ef8-08d13a731476 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:14.001611 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04007bfa-a2af-4086-93ea-4552b82aecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:14.002363 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04007bfa-a2af-4086-93ea-4552b82aecc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:14.002602 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04007bfa-a2af-4086-93ea-4552b82aecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:14.002885 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04007bfa-a2af-4086-93ea-4552b82aecc6 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:14.003562 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04007bfa-a2af-4086-93ea-4552b82aecc6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:14.005238 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04007bfa-a2af-4086-93ea-4552b82aecc6 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:14.011846 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 462/916] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Feb 10 23:04:13 2022] GET /identity/v3/services => generated 1497 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:04:14.018679 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 455/917] 10.222.0.77 () {60 vars in 1162 bytes} [Thu Feb 10 23:04:13 2022] POST /identity/v3/services => generated 241 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:04:14.375993 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec4168-6c9a-46ce-a68d-f1f3edcad6cc None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:14.376349 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec4168-6c9a-46ce-a68d-f1f3edcad6cc None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:14.376669 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec4168-6c9a-46ce-a68d-f1f3edcad6cc None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:14.378718 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 463/918] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:14.384618 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a1f46-b1df-459a-b3f5-404754ab101d None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:14.384907 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a1f46-b1df-459a-b3f5-404754ab101d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:14.385189 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a1f46-b1df-459a-b3f5-404754ab101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:14.404246 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-e09a1f46-b1df-459a-b3f5-404754ab101d None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:14.405480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e09a1f46-b1df-459a-b3f5-404754ab101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:14.428117 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 456/919] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:14 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:14.447010 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec4168-6c9a-46ce-a68d-f1f3edcad6cc None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:14.460047 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec4168-6c9a-46ce-a68d-f1f3edcad6cc None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:14.464417 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365772c4-d182-4849-a9da-f8d9f3131e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:14.465195 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365772c4-d182-4849-a9da-f8d9f3131e40 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:14.465477 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365772c4-d182-4849-a9da-f8d9f3131e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:14.465751 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365772c4-d182-4849-a9da-f8d9f3131e40 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:14.466433 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365772c4-d182-4849-a9da-f8d9f3131e40 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:14.468038 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365772c4-d182-4849-a9da-f8d9f3131e40 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:14.480339 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-365772c4-d182-4849-a9da-f8d9f3131e40 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 10 23:04:14.486686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 464/920] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:04:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:14.488060 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a1f46-b1df-459a-b3f5-404754ab101d None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:14.497929 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a1f46-b1df-459a-b3f5-404754ab101d None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:14.502525 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae12442-9344-4e4a-966f-fc9f0272e2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:14.503174 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae12442-9344-4e4a-966f-fc9f0272e2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:14.503454 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae12442-9344-4e4a-966f-fc9f0272e2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:14.503728 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae12442-9344-4e4a-966f-fc9f0272e2c0 admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:14.504529 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae12442-9344-4e4a-966f-fc9f0272e2c0 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:14.504831 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae12442-9344-4e4a-966f-fc9f0272e2c0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:14.506854 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae12442-9344-4e4a-966f-fc9f0272e2c0 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:14.515940 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 457/921] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:04:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:14.517583 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365772c4-d182-4849-a9da-f8d9f3131e40 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:14.528154 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365772c4-d182-4849-a9da-f8d9f3131e40 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:14.532924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f834f4-cf9a-4342-a2e5-e9ade603f400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:14.533569 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f834f4-cf9a-4342-a2e5-e9ade603f400 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:14.533903 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f834f4-cf9a-4342-a2e5-e9ade603f400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:14.534183 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f834f4-cf9a-4342-a2e5-e9ade603f400 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:14.534949 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f834f4-cf9a-4342-a2e5-e9ade603f400 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:14.535260 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f834f4-cf9a-4342-a2e5-e9ade603f400 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:14.537855 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f834f4-cf9a-4342-a2e5-e9ade603f400 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:14.547645 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 465/922] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:04:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:14.548971 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae12442-9344-4e4a-966f-fc9f0272e2c0 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:14.559788 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae12442-9344-4e4a-966f-fc9f0272e2c0 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:14.564459 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233440d-d922-4d09-b56c-ca2f0b495ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:14.565149 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233440d-d922-4d09-b56c-ca2f0b495ece admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:14.565430 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233440d-d922-4d09-b56c-ca2f0b495ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:14.565748 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233440d-d922-4d09-b56c-ca2f0b495ece admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:14.566544 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233440d-d922-4d09-b56c-ca2f0b495ece admin admin] RBAC: Adding query filter params (interface=public, service_id=b5114c16046a426cbedde8bd4add8889, region_id=RegionOne) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:14.566855 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233440d-d922-4d09-b56c-ca2f0b495ece admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:14.568877 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233440d-d922-4d09-b56c-ca2f0b495ece admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:14.578623 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 458/923] 10.222.0.77 () {56 vars in 1272 bytes} [Thu Feb 10 23:04:14 2022] GET /identity/v3/endpoints?service_id=b5114c16046a426cbedde8bd4add8889&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:14.579974 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f834f4-cf9a-4342-a2e5-e9ade603f400 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:14.591431 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f834f4-cf9a-4342-a2e5-e9ade603f400 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:14.596195 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccf963-60c7-4aee-be49-baa8e46268e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:14.596845 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccf963-60c7-4aee-be49-baa8e46268e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:14.597182 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccf963-60c7-4aee-be49-baa8e46268e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:14.597462 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccf963-60c7-4aee-be49-baa8e46268e1 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:14.598154 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccf963-60c7-4aee-be49-baa8e46268e1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:14.600913 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccf963-60c7-4aee-be49-baa8e46268e1 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:14.611956 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 466/924] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Feb 10 23:04:14 2022] GET /identity/v3/services => generated 1497 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:04:15.816782 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad837d-18b4-43d0-9d92-09588004e4b8 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:15.818210 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad837d-18b4-43d0-9d92-09588004e4b8 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:15.818516 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad837d-18b4-43d0-9d92-09588004e4b8 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:15.822081 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 459/925] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:15.827283 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fabae-19fd-4bba-8bc2-fccfd3668c7f None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:15.827805 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fabae-19fd-4bba-8bc2-fccfd3668c7f None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:15.827805 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fabae-19fd-4bba-8bc2-fccfd3668c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:15.845794 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-546fabae-19fd-4bba-8bc2-fccfd3668c7f None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:15.846965 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-546fabae-19fd-4bba-8bc2-fccfd3668c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:15.855827 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 467/926] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:15 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:15.879846 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad837d-18b4-43d0-9d92-09588004e4b8 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:15.896596 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad837d-18b4-43d0-9d92-09588004e4b8 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:15.901070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a9a6b-36fd-48c4-bafc-942c3aa088d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:15.901863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a9a6b-36fd-48c4-bafc-942c3aa088d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:15.902138 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a9a6b-36fd-48c4-bafc-942c3aa088d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:15.902410 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a9a6b-36fd-48c4-bafc-942c3aa088d4 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:15.913466 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a9a6b-36fd-48c4-bafc-942c3aa088d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:04:15.920719 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-b29a9a6b-36fd-48c4-bafc-942c3aa088d4 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 10 23:04:15.922186 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 460/927] 10.222.0.77 () {56 vars in 1141 bytes} [Thu Feb 10 23:04:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:15.928581 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fabae-19fd-4bba-8bc2-fccfd3668c7f None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:15.937604 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fabae-19fd-4bba-8bc2-fccfd3668c7f None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:15.942108 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ad3b8-f9e3-4174-b756-c2a0d7c92d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:15.943522 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ad3b8-f9e3-4174-b756-c2a0d7c92d42 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:15.943809 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ad3b8-f9e3-4174-b756-c2a0d7c92d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:15.944112 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ad3b8-f9e3-4174-b756-c2a0d7c92d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:15.944918 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ad3b8-f9e3-4174-b756-c2a0d7c92d42 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:15.945216 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ad3b8-f9e3-4174-b756-c2a0d7c92d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:15.946776 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ad3b8-f9e3-4174-b756-c2a0d7c92d42 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:15.955389 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 468/928] 10.222.0.77 () {56 vars in 1136 bytes} [Thu Feb 10 23:04:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:15.961667 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a9a6b-36fd-48c4-bafc-942c3aa088d4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:15.971736 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a9a6b-36fd-48c4-bafc-942c3aa088d4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:15.976363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f15774-685a-4d6a-8508-0df2f99ee690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:15.977128 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f15774-685a-4d6a-8508-0df2f99ee690 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:15.977402 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f15774-685a-4d6a-8508-0df2f99ee690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:15.977671 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f15774-685a-4d6a-8508-0df2f99ee690 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:15.988388 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f15774-685a-4d6a-8508-0df2f99ee690 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:15.990366 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f15774-685a-4d6a-8508-0df2f99ee690 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:16.008080 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-c5f15774-685a-4d6a-8508-0df2f99ee690 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:16.009543 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 461/929] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:16.015165 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ad3b8-f9e3-4174-b756-c2a0d7c92d42 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:16.025555 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ad3b8-f9e3-4174-b756-c2a0d7c92d42 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:16.030172 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6510abc-492e-4f21-9f98-7c3e2634c773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:16.030812 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6510abc-492e-4f21-9f98-7c3e2634c773 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.031137 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6510abc-492e-4f21-9f98-7c3e2634c773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.031415 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6510abc-492e-4f21-9f98-7c3e2634c773 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.032180 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6510abc-492e-4f21-9f98-7c3e2634c773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:16.032481 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6510abc-492e-4f21-9f98-7c3e2634c773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:16.034097 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6510abc-492e-4f21-9f98-7c3e2634c773 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:16.046871 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 469/930] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:16.052633 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f15774-685a-4d6a-8508-0df2f99ee690 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:16.063182 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f15774-685a-4d6a-8508-0df2f99ee690 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:16.068788 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8554df5-7bb8-4afb-ace8-171cc3f0fd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:16.069591 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8554df5-7bb8-4afb-ace8-171cc3f0fd25 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.069867 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8554df5-7bb8-4afb-ace8-171cc3f0fd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.070133 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8554df5-7bb8-4afb-ace8-171cc3f0fd25 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.078834 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8554df5-7bb8-4afb-ace8-171cc3f0fd25 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:16.080904 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8554df5-7bb8-4afb-ace8-171cc3f0fd25 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:16.098449 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-c8554df5-7bb8-4afb-ace8-171cc3f0fd25 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 10 23:04:16.100494 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 462/931] 10.222.0.77 () {56 vars in 1138 bytes} [Thu Feb 10 23:04:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:16.106050 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6510abc-492e-4f21-9f98-7c3e2634c773 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:16.117051 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6510abc-492e-4f21-9f98-7c3e2634c773 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:16.121821 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98510f12-538a-422e-ae62-9f40cbb07c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:16.122503 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98510f12-538a-422e-ae62-9f40cbb07c0c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.122833 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98510f12-538a-422e-ae62-9f40cbb07c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.123110 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98510f12-538a-422e-ae62-9f40cbb07c0c admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.124085 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98510f12-538a-422e-ae62-9f40cbb07c0c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:16.124393 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98510f12-538a-422e-ae62-9f40cbb07c0c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:16.126335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98510f12-538a-422e-ae62-9f40cbb07c0c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:16.147376 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 470/932] 10.222.0.77 () {56 vars in 1170 bytes} [Thu Feb 10 23:04:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:16.153019 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8554df5-7bb8-4afb-ace8-171cc3f0fd25 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:16.163684 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8554df5-7bb8-4afb-ace8-171cc3f0fd25 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:16.168322 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a89105-81a4-4b7a-9e5b-06f1872740ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:16.169004 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a89105-81a4-4b7a-9e5b-06f1872740ad admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.169284 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a89105-81a4-4b7a-9e5b-06f1872740ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.169556 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a89105-81a4-4b7a-9e5b-06f1872740ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.178738 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a89105-81a4-4b7a-9e5b-06f1872740ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:16.180577 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a89105-81a4-4b7a-9e5b-06f1872740ad admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:16.189751 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 463/933] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:04:16 2022] GET /identity/v3/auth/tokens => generated 1765 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:04:16.195352 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98510f12-538a-422e-ae62-9f40cbb07c0c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:16.205193 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98510f12-538a-422e-ae62-9f40cbb07c0c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:16.210438 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f706b-b5c3-43f6-8213-2a6ec197f835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:16.211223 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f706b-b5c3-43f6-8213-2a6ec197f835 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.211502 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f706b-b5c3-43f6-8213-2a6ec197f835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.211770 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f706b-b5c3-43f6-8213-2a6ec197f835 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.222540 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f706b-b5c3-43f6-8213-2a6ec197f835 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:16.225215 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f706b-b5c3-43f6-8213-2a6ec197f835 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:16.243191 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-f03f706b-b5c3-43f6-8213-2a6ec197f835 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:16.244685 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 471/934] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:16.250186 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a89105-81a4-4b7a-9e5b-06f1872740ad admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:16.259849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a89105-81a4-4b7a-9e5b-06f1872740ad admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:16.264489 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ebf07-9934-4a94-a1f5-02dfa3a30770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:16.265131 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ebf07-9934-4a94-a1f5-02dfa3a30770 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.265455 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ebf07-9934-4a94-a1f5-02dfa3a30770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.265730 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ebf07-9934-4a94-a1f5-02dfa3a30770 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.266456 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ebf07-9934-4a94-a1f5-02dfa3a30770 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:16.266756 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ebf07-9934-4a94-a1f5-02dfa3a30770 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:16.268480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ebf07-9934-4a94-a1f5-02dfa3a30770 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:16.280727 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 464/935] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:16.286299 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f706b-b5c3-43f6-8213-2a6ec197f835 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:16.296342 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f706b-b5c3-43f6-8213-2a6ec197f835 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:16.301230 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b5a95-ca27-48a5-bf0b-f02bcf426b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:16.302604 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b5a95-ca27-48a5-bf0b-f02bcf426b7b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.302928 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b5a95-ca27-48a5-bf0b-f02bcf426b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.303227 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b5a95-ca27-48a5-bf0b-f02bcf426b7b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.310706 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b5a95-ca27-48a5-bf0b-f02bcf426b7b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:16.312739 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b5a95-ca27-48a5-bf0b-f02bcf426b7b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:16.327505 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-d32b5a95-ca27-48a5-bf0b-f02bcf426b7b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:04:16.328974 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 472/936] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:04:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:16.335346 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ebf07-9934-4a94-a1f5-02dfa3a30770 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:16.343285 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b99aa-630f-463c-b781-ab6cacc82846 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.343499 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b99aa-630f-463c-b781-ab6cacc82846 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.343949 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b99aa-630f-463c-b781-ab6cacc82846 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.346809 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 473/937] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:04:16.347330 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ebf07-9934-4a94-a1f5-02dfa3a30770 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:16.355858 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f8bf5-cb46-4ded-851f-5688aec180f1 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.355858 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f8bf5-cb46-4ded-851f-5688aec180f1 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.355858 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f8bf5-cb46-4ded-851f-5688aec180f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.356344 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c0fad-c681-4d25-b170-6ee3ad2277d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:16.356344 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c0fad-c681-4d25-b170-6ee3ad2277d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.356344 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c0fad-c681-4d25-b170-6ee3ad2277d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.356344 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c0fad-c681-4d25-b170-6ee3ad2277d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.356908 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c0fad-c681-4d25-b170-6ee3ad2277d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:16.356908 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c0fad-c681-4d25-b170-6ee3ad2277d6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:16.356908 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c0fad-c681-4d25-b170-6ee3ad2277d6 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:16.370242 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 465/938] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:04:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:16.370854 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-997f8bf5-cb46-4ded-851f-5688aec180f1 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:16.375430 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-997f8bf5-cb46-4ded-851f-5688aec180f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:16.377696 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c0fad-c681-4d25-b170-6ee3ad2277d6 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:16.384436 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 474/939] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:16 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:04:16.388102 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c0fad-c681-4d25-b170-6ee3ad2277d6 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:16.392702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4481f-428d-4374-8547-561a6081ddd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:16.393561 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4481f-428d-4374-8547-561a6081ddd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.394036 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4481f-428d-4374-8547-561a6081ddd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.394521 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4481f-428d-4374-8547-561a6081ddd4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.396170 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4481f-428d-4374-8547-561a6081ddd4 admin admin] RBAC: Adding query filter params (role.id=ba41bad22bbb402082f3c8d0b387644b, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=9dca4ea4f2c8490e823a73dca6c303ed) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:16.396702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4481f-428d-4374-8547-561a6081ddd4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:16.398709 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4481f-428d-4374-8547-561a6081ddd4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:16.405332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 466/940] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:04:16 2022] GET /identity/v3/role_assignments?user.id=9dca4ea4f2c8490e823a73dca6c303ed&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=ba41bad22bbb402082f3c8d0b387644b => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:16.411921 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f8bf5-cb46-4ded-851f-5688aec180f1 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:16.420176 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f8bf5-cb46-4ded-851f-5688aec180f1 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:16.425206 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee256c-a0b4-4784-81ad-32646aed08d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:16.426136 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee256c-a0b4-4784-81ad-32646aed08d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.426420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee256c-a0b4-4784-81ad-32646aed08d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.426700 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee256c-a0b4-4784-81ad-32646aed08d7 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.427656 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee256c-a0b4-4784-81ad-32646aed08d7 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:16.429469 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee256c-a0b4-4784-81ad-32646aed08d7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:16.442088 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-89ee256c-a0b4-4784-81ad-32646aed08d7 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 10 23:04:16.443787 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 475/941] 10.222.0.77 () {56 vars in 1147 bytes} [Thu Feb 10 23:04:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:16.449828 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cf5d2-b2c2-4b1c-a648-dd7dc8d35e03 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.450037 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee256c-a0b4-4784-81ad-32646aed08d7 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:16.450129 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cf5d2-b2c2-4b1c-a648-dd7dc8d35e03 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.450372 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cf5d2-b2c2-4b1c-a648-dd7dc8d35e03 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.452496 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 467/942] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:16.458527 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f81700-ef31-47a8-96d6-d74381204963 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.458825 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f81700-ef31-47a8-96d6-d74381204963 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.459368 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f81700-ef31-47a8-96d6-d74381204963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.462114 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee256c-a0b4-4784-81ad-32646aed08d7 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:16.467016 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ab665-12d3-4cfe-a26a-c6d54aea9bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:16.467966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ab665-12d3-4cfe-a26a-c6d54aea9bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.468426 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ab665-12d3-4cfe-a26a-c6d54aea9bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.468850 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ab665-12d3-4cfe-a26a-c6d54aea9bd3 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.469754 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ab665-12d3-4cfe-a26a-c6d54aea9bd3 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:16.470216 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ab665-12d3-4cfe-a26a-c6d54aea9bd3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:16.472030 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ab665-12d3-4cfe-a26a-c6d54aea9bd3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:16.478909 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 476/943] 10.222.0.77 () {56 vars in 1143 bytes} [Thu Feb 10 23:04:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:16.483578 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-b7f81700-ef31-47a8-96d6-d74381204963 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:16.483578 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-b7f81700-ef31-47a8-96d6-d74381204963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:16.484827 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ab665-12d3-4cfe-a26a-c6d54aea9bd3 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:16.490536 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 468/944] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:16 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:04:16.496489 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ab665-12d3-4cfe-a26a-c6d54aea9bd3 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:16.501400 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7b127-dd6c-44cd-9dd1-457dda623476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:16.502315 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7b127-dd6c-44cd-9dd1-457dda623476 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.502749 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7b127-dd6c-44cd-9dd1-457dda623476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.503185 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7b127-dd6c-44cd-9dd1-457dda623476 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.504124 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7b127-dd6c-44cd-9dd1-457dda623476 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:16.504581 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7b127-dd6c-44cd-9dd1-457dda623476 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:16.507171 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7b127-dd6c-44cd-9dd1-457dda623476 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:16.513473 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 477/945] 10.222.0.77 () {56 vars in 1143 bytes} [Thu Feb 10 23:04:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:16.518470 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f81700-ef31-47a8-96d6-d74381204963 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:16.519763 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7b127-dd6c-44cd-9dd1-457dda623476 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:16.525590 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f81700-ef31-47a8-96d6-d74381204963 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:16.530424 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a55051-51f3-4c28-b143-eec1cf39ffac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:16.530917 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7b127-dd6c-44cd-9dd1-457dda623476 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:16.531288 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a55051-51f3-4c28-b143-eec1cf39ffac admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.531573 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a55051-51f3-4c28-b143-eec1cf39ffac admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.531938 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a55051-51f3-4c28-b143-eec1cf39ffac admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.532659 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a55051-51f3-4c28-b143-eec1cf39ffac admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:16.534374 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a55051-51f3-4c28-b143-eec1cf39ffac admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:16.537095 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638697b5-641d-444d-833f-f8c684f1dda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:16.537969 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638697b5-641d-444d-833f-f8c684f1dda0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.538399 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638697b5-641d-444d-833f-f8c684f1dda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.538829 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638697b5-641d-444d-833f-f8c684f1dda0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.539789 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638697b5-641d-444d-833f-f8c684f1dda0 admin admin] RBAC: Adding query filter params (interface=public, service_id=fc702ada12f142d1be768cd8eeced156, region_id=RegionOne) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:16.540292 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638697b5-641d-444d-833f-f8c684f1dda0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:16.542049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638697b5-641d-444d-833f-f8c684f1dda0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:16.548095 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-a7a55051-51f3-4c28-b143-eec1cf39ffac admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 10 23:04:16.548581 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 478/946] 10.222.0.77 () {56 vars in 1272 bytes} [Thu Feb 10 23:04:16 2022] GET /identity/v3/endpoints?service_id=fc702ada12f142d1be768cd8eeced156&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:16.553866 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 469/947] 10.222.0.77 () {56 vars in 1153 bytes} [Thu Feb 10 23:04:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:16.555166 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638697b5-641d-444d-833f-f8c684f1dda0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:16.556606 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a55051-51f3-4c28-b143-eec1cf39ffac admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:16.565869 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638697b5-641d-444d-833f-f8c684f1dda0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:16.566767 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a55051-51f3-4c28-b143-eec1cf39ffac admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:16.571514 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71141932-971c-4af5-949c-49a563575f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:16.572457 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bc11c-8478-4d8f-8103-22be2a625d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:16.572738 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71141932-971c-4af5-949c-49a563575f2e admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.573129 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bc11c-8478-4d8f-8103-22be2a625d75 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.573340 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71141932-971c-4af5-949c-49a563575f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.573448 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bc11c-8478-4d8f-8103-22be2a625d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.573725 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bc11c-8478-4d8f-8103-22be2a625d75 admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.574012 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71141932-971c-4af5-949c-49a563575f2e admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.574450 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bc11c-8478-4d8f-8103-22be2a625d75 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:16.574808 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bc11c-8478-4d8f-8103-22be2a625d75 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:16.575165 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71141932-971c-4af5-949c-49a563575f2e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:16.576660 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bc11c-8478-4d8f-8103-22be2a625d75 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:16.577153 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71141932-971c-4af5-949c-49a563575f2e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:16.582454 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 470/948] 10.222.0.77 () {56 vars in 1147 bytes} [Thu Feb 10 23:04:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:16.584425 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 479/949] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Feb 10 23:04:16 2022] GET /identity/v3/services => generated 1497 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:04:16.589260 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bc11c-8478-4d8f-8103-22be2a625d75 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:16.600263 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bc11c-8478-4d8f-8103-22be2a625d75 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:16.605277 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9765e2-a573-453b-9227-80424dbd2824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:16.606699 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9765e2-a573-453b-9227-80424dbd2824 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.606978 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9765e2-a573-453b-9227-80424dbd2824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.607286 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9765e2-a573-453b-9227-80424dbd2824 admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.608058 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9765e2-a573-453b-9227-80424dbd2824 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:16.608364 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9765e2-a573-453b-9227-80424dbd2824 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:16.610107 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9765e2-a573-453b-9227-80424dbd2824 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:16.617437 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 471/950] 10.222.0.77 () {56 vars in 1147 bytes} [Thu Feb 10 23:04:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:16.623201 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71141932-971c-4af5-949c-49a563575f2e admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:16.635291 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71141932-971c-4af5-949c-49a563575f2e admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:16.639777 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d1e6c-9771-48bd-85ef-b891b24f322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:16.640470 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d1e6c-9771-48bd-85ef-b891b24f322d admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.640750 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d1e6c-9771-48bd-85ef-b891b24f322d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.641023 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d1e6c-9771-48bd-85ef-b891b24f322d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.641799 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d1e6c-9771-48bd-85ef-b891b24f322d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:16.643424 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d1e6c-9771-48bd-85ef-b891b24f322d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:16.668653 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 480/951] 10.222.0.77 () {60 vars in 1165 bytes} [Thu Feb 10 23:04:16 2022] POST /identity/v3/endpoints => generated 347 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:04:16.980047 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea9473-4cb2-4d3a-a746-3cff89b85df5 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.980585 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea9473-4cb2-4d3a-a746-3cff89b85df5 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.980585 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea9473-4cb2-4d3a-a746-3cff89b85df5 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:16.982350 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 472/952] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:16.988168 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c7a89-2e14-4520-9c84-b447a44c1d39 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:16.988586 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c7a89-2e14-4520-9c84-b447a44c1d39 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:16.988758 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c7a89-2e14-4520-9c84-b447a44c1d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:17.008718 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-763c7a89-2e14-4520-9c84-b447a44c1d39 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:17.009888 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-763c7a89-2e14-4520-9c84-b447a44c1d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:17.027560 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 481/953] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:16 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:17.051308 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea9473-4cb2-4d3a-a746-3cff89b85df5 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:17.063797 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea9473-4cb2-4d3a-a746-3cff89b85df5 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:17.068545 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11490b4a-0d68-4016-9d41-f20d5ffec4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:17.069328 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11490b4a-0d68-4016-9d41-f20d5ffec4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:17.069605 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11490b4a-0d68-4016-9d41-f20d5ffec4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:17.069877 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11490b4a-0d68-4016-9d41-f20d5ffec4c4 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:17.070539 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11490b4a-0d68-4016-9d41-f20d5ffec4c4 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:17.072142 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11490b4a-0d68-4016-9d41-f20d5ffec4c4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:17.091582 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-11490b4a-0d68-4016-9d41-f20d5ffec4c4 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 10 23:04:17.097964 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 473/954] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:04:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:17.100204 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c7a89-2e14-4520-9c84-b447a44c1d39 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:17.109039 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c7a89-2e14-4520-9c84-b447a44c1d39 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:17.113826 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf3715-1a74-4324-947f-d676c038006a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:17.115280 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf3715-1a74-4324-947f-d676c038006a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:17.115553 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf3715-1a74-4324-947f-d676c038006a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:17.115842 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf3715-1a74-4324-947f-d676c038006a admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:17.116567 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf3715-1a74-4324-947f-d676c038006a admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:17.116868 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf3715-1a74-4324-947f-d676c038006a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:17.118441 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf3715-1a74-4324-947f-d676c038006a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:17.123400 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 482/955] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:04:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:17.129131 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11490b4a-0d68-4016-9d41-f20d5ffec4c4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:17.140507 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11490b4a-0d68-4016-9d41-f20d5ffec4c4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:17.145297 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f782aef-68d2-4a1d-a9cf-e1969a2869c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:17.146401 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f782aef-68d2-4a1d-a9cf-e1969a2869c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:17.146891 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f782aef-68d2-4a1d-a9cf-e1969a2869c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:17.147412 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f782aef-68d2-4a1d-a9cf-e1969a2869c1 admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:17.148363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f782aef-68d2-4a1d-a9cf-e1969a2869c1 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:17.148923 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f782aef-68d2-4a1d-a9cf-e1969a2869c1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:17.150743 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f782aef-68d2-4a1d-a9cf-e1969a2869c1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:17.159927 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 474/956] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Feb 10 23:04:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:17.162165 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf3715-1a74-4324-947f-d676c038006a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:17.172214 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf3715-1a74-4324-947f-d676c038006a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:17.178177 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f4eca-1b1d-42f4-a787-11e4df509897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:17.179130 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f4eca-1b1d-42f4-a787-11e4df509897 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:17.179614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f4eca-1b1d-42f4-a787-11e4df509897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:17.180164 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f4eca-1b1d-42f4-a787-11e4df509897 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:17.181139 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f4eca-1b1d-42f4-a787-11e4df509897 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:17.183023 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f4eca-1b1d-42f4-a787-11e4df509897 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:17.204641 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 483/957] 10.222.0.77 () {60 vars in 1165 bytes} [Thu Feb 10 23:04:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:04:18.752148 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96bb24-16dd-4ad4-9223-77b06cea20d1 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:18.753168 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96bb24-16dd-4ad4-9223-77b06cea20d1 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:18.753678 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96bb24-16dd-4ad4-9223-77b06cea20d1 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:18.756856 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 475/958] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:18.761875 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf38321-c41d-48d6-b1e3-e1a6c664f5ed None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:18.762291 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf38321-c41d-48d6-b1e3-e1a6c664f5ed None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:18.762464 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf38321-c41d-48d6-b1e3-e1a6c664f5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:18.780738 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-3bf38321-c41d-48d6-b1e3-e1a6c664f5ed None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:18.781909 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-3bf38321-c41d-48d6-b1e3-e1a6c664f5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:18.798996 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 484/959] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:18 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:04:18.822240 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96bb24-16dd-4ad4-9223-77b06cea20d1 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:18.834609 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96bb24-16dd-4ad4-9223-77b06cea20d1 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:18.838980 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79323b-c908-4490-9878-13b0c6546c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:18.839755 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79323b-c908-4490-9878-13b0c6546c73 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:18.840057 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79323b-c908-4490-9878-13b0c6546c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:18.840325 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79323b-c908-4490-9878-13b0c6546c73 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:18.840985 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79323b-c908-4490-9878-13b0c6546c73 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:18.842546 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79323b-c908-4490-9878-13b0c6546c73 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:18.854138 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-2c79323b-c908-4490-9878-13b0c6546c73 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 10 23:04:18.855616 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 476/960] 10.222.0.77 () {56 vars in 1126 bytes} [Thu Feb 10 23:04:18 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:18.861905 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf38321-c41d-48d6-b1e3-e1a6c664f5ed None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:18.871627 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf38321-c41d-48d6-b1e3-e1a6c664f5ed None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:18.876190 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586433d-1188-4351-a16b-8adcfe673bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:18.876837 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586433d-1188-4351-a16b-8adcfe673bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:18.877115 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586433d-1188-4351-a16b-8adcfe673bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:18.877382 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586433d-1188-4351-a16b-8adcfe673bb6 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:18.878103 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586433d-1188-4351-a16b-8adcfe673bb6 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:18.878395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586433d-1188-4351-a16b-8adcfe673bb6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:18.880057 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586433d-1188-4351-a16b-8adcfe673bb6 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:18.885122 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 485/961] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:18.890617 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79323b-c908-4490-9878-13b0c6546c73 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:18.898434 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff777e-8ea1-410a-bcbb-70e095cf567a None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:18.898725 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff777e-8ea1-410a-bcbb-70e095cf567a None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:18.899006 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff777e-8ea1-410a-bcbb-70e095cf567a None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:18.900588 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79323b-c908-4490-9878-13b0c6546c73 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:18.901037 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 486/962] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:18.905432 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd5d5b-a8e8-4a07-af84-832ce41cc4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:18.906155 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd5d5b-a8e8-4a07-af84-832ce41cc4fd admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:18.906311 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8c8b2-d9c6-4a13-8f79-3a9f5d7427b3 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:18.906446 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8c8b2-d9c6-4a13-8f79-3a9f5d7427b3 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:18.906600 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd5d5b-a8e8-4a07-af84-832ce41cc4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:18.906736 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8c8b2-d9c6-4a13-8f79-3a9f5d7427b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:18.906987 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd5d5b-a8e8-4a07-af84-832ce41cc4fd admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:18.907765 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd5d5b-a8e8-4a07-af84-832ce41cc4fd admin admin] RBAC: Adding query filter params (type=image) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:18.908174 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd5d5b-a8e8-4a07-af84-832ce41cc4fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:18.909813 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd5d5b-a8e8-4a07-af84-832ce41cc4fd admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:18.915243 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 477/963] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:18 2022] GET /identity/v3/services?type=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:18.926322 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-a3b8c8b2-d9c6-4a13-8f79-3a9f5d7427b3 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:18.928334 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a3b8c8b2-d9c6-4a13-8f79-3a9f5d7427b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:18.936859 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 487/964] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:18 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:04:18.962183 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd5d5b-a8e8-4a07-af84-832ce41cc4fd admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:18.972797 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd5d5b-a8e8-4a07-af84-832ce41cc4fd admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:18.978762 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d55d82-261c-424f-963e-d223baa1ee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:18.979604 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d55d82-261c-424f-963e-d223baa1ee3c admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:18.979920 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d55d82-261c-424f-963e-d223baa1ee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:18.980173 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e2539-4b62-4a99-b768-4f1cb956773b None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:18.980345 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d55d82-261c-424f-963e-d223baa1ee3c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:18.980561 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e2539-4b62-4a99-b768-4f1cb956773b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:18.980713 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e2539-4b62-4a99-b768-4f1cb956773b None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:18.980855 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d55d82-261c-424f-963e-d223baa1ee3c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:18.982484 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d55d82-261c-424f-963e-d223baa1ee3c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:18.982795 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 488/965] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:04:18.988707 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71681c-e311-473d-acb7-3379d0e41a2e None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:18.989020 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71681c-e311-473d-acb7-3379d0e41a2e None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:18.989847 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71681c-e311-473d-acb7-3379d0e41a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:18.996633 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-c8d55d82-261c-424f-963e-d223baa1ee3c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 10 23:04:18.998178 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 478/966] 10.222.0.77 () {56 vars in 1147 bytes} [Thu Feb 10 23:04:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:19.004542 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d55d82-261c-424f-963e-d223baa1ee3c admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:19.008739 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-aa71681c-e311-473d-acb7-3379d0e41a2e None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:19.009958 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-aa71681c-e311-473d-acb7-3379d0e41a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:19.015460 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d55d82-261c-424f-963e-d223baa1ee3c admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:19.018310 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 489/967] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:18 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:04:19.021726 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02990456-aa34-4ec5-9665-2faf08429504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:19.022410 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02990456-aa34-4ec5-9665-2faf08429504 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:19.022692 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02990456-aa34-4ec5-9665-2faf08429504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:19.022965 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02990456-aa34-4ec5-9665-2faf08429504 admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:19.023690 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02990456-aa34-4ec5-9665-2faf08429504 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:19.024028 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02990456-aa34-4ec5-9665-2faf08429504 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:19.025713 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02990456-aa34-4ec5-9665-2faf08429504 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:19.031573 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 479/968] 10.222.0.77 () {56 vars in 1143 bytes} [Thu Feb 10 23:04:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:19.038161 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71681c-e311-473d-acb7-3379d0e41a2e None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:19.047692 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02990456-aa34-4ec5-9665-2faf08429504 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:19.054707 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71681c-e311-473d-acb7-3379d0e41a2e None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:19.059361 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02990456-aa34-4ec5-9665-2faf08429504 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:19.060748 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14652720-2047-4ecc-ac1a-03f658b17890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:19.061711 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14652720-2047-4ecc-ac1a-03f658b17890 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:19.062237 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14652720-2047-4ecc-ac1a-03f658b17890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:19.062799 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14652720-2047-4ecc-ac1a-03f658b17890 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:19.063740 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14652720-2047-4ecc-ac1a-03f658b17890 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:19.064007 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610e44a-28e1-4cf0-9f9c-ec037283473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:19.064552 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14652720-2047-4ecc-ac1a-03f658b17890 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:19.064810 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610e44a-28e1-4cf0-9f9c-ec037283473c admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:19.065085 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610e44a-28e1-4cf0-9f9c-ec037283473c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:19.065366 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610e44a-28e1-4cf0-9f9c-ec037283473c admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:19.066042 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610e44a-28e1-4cf0-9f9c-ec037283473c admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:19.067886 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14652720-2047-4ecc-ac1a-03f658b17890 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:19.068229 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610e44a-28e1-4cf0-9f9c-ec037283473c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:19.074576 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 490/969] 10.222.0.77 () {56 vars in 1143 bytes} [Thu Feb 10 23:04:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:19.080926 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-0610e44a-28e1-4cf0-9f9c-ec037283473c admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 10 23:04:19.081991 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14652720-2047-4ecc-ac1a-03f658b17890 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:19.082718 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 480/970] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:04:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:19.089434 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610e44a-28e1-4cf0-9f9c-ec037283473c admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:19.099567 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14652720-2047-4ecc-ac1a-03f658b17890 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:19.099997 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610e44a-28e1-4cf0-9f9c-ec037283473c admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:19.104953 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbf2de-7c57-49c9-9993-eda932ad7526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:19.105619 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbf2de-7c57-49c9-9993-eda932ad7526 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:19.105877 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295d68a-5032-4765-a322-cf9a6b45b0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:19.106000 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbf2de-7c57-49c9-9993-eda932ad7526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:19.106162 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbf2de-7c57-49c9-9993-eda932ad7526 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:19.106534 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295d68a-5032-4765-a322-cf9a6b45b0dc admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:19.106819 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295d68a-5032-4765-a322-cf9a6b45b0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:19.106916 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbf2de-7c57-49c9-9993-eda932ad7526 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:19.107090 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295d68a-5032-4765-a322-cf9a6b45b0dc admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:19.107829 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295d68a-5032-4765-a322-cf9a6b45b0dc admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:19.108147 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295d68a-5032-4765-a322-cf9a6b45b0dc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:19.108555 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbf2de-7c57-49c9-9993-eda932ad7526 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:19.109855 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295d68a-5032-4765-a322-cf9a6b45b0dc admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:19.117055 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 481/971] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Feb 10 23:04:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:19.122356 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295d68a-5032-4765-a322-cf9a6b45b0dc admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:19.133874 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295d68a-5032-4765-a322-cf9a6b45b0dc admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:19.141448 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 491/972] 10.222.0.77 () {60 vars in 1165 bytes} [Thu Feb 10 23:04:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:04:19.154435 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ac16f-3ba7-4444-a791-288549231382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:19.155161 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ac16f-3ba7-4444-a791-288549231382 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:19.155504 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ac16f-3ba7-4444-a791-288549231382 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:19.155843 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ac16f-3ba7-4444-a791-288549231382 admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:19.156657 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ac16f-3ba7-4444-a791-288549231382 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:19.157011 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ac16f-3ba7-4444-a791-288549231382 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:19.158713 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ac16f-3ba7-4444-a791-288549231382 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:19.164903 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 482/973] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Feb 10 23:04:19 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:19.584374 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dae1e3-e567-444f-89e1-f34330677939 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:19.584895 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dae1e3-e567-444f-89e1-f34330677939 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:19.585400 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dae1e3-e567-444f-89e1-f34330677939 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:19.589036 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 492/974] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:19.594913 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9deb2-6c78-4ce4-a32d-9d1fd30a7866 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:19.595204 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9deb2-6c78-4ce4-a32d-9d1fd30a7866 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:19.595482 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9deb2-6c78-4ce4-a32d-9d1fd30a7866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:19.614368 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-5da9deb2-6c78-4ce4-a32d-9d1fd30a7866 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:19.615884 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-5da9deb2-6c78-4ce4-a32d-9d1fd30a7866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:19.631976 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 483/975] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:19 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:04:19.651624 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dae1e3-e567-444f-89e1-f34330677939 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:19.664433 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dae1e3-e567-444f-89e1-f34330677939 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:19.668909 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5d4ab-892d-4e70-b797-77a64d20e01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:19.669551 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5d4ab-892d-4e70-b797-77a64d20e01b admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:19.669834 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5d4ab-892d-4e70-b797-77a64d20e01b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:19.670107 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5d4ab-892d-4e70-b797-77a64d20e01b admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:19.670837 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5d4ab-892d-4e70-b797-77a64d20e01b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:19.674143 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5d4ab-892d-4e70-b797-77a64d20e01b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:19.675015 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.common [None req-9fc5d4ab-892d-4e70-b797-77a64d20e01b admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 10 23:04:19.694468 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.sql.core [None req-9fc5d4ab-892d-4e70-b797-77a64d20e01b admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 10 23:04:19.694468 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 10 23:04:19.694468 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [parameters: {'id': '95ffe381fcf144e0a7712e89aac6f860', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 10 23:04:19.694468 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79313) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 10 23:04:19.701539 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-9fc5d4ab-892d-4e70-b797-77a64d20e01b admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 95ffe381fcf144e0a7712e89aac6f860.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 95ffe381fcf144e0a7712e89aac6f860. Feb 10 23:04:19.708578 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 493/976] 10.222.0.77 () {60 vars in 1161 bytes} [Thu Feb 10 23:04:19 2022] POST /identity/v3/projects => generated 262 bytes in 52 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:19.710333 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9deb2-6c78-4ce4-a32d-9d1fd30a7866 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:19.719627 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9deb2-6c78-4ce4-a32d-9d1fd30a7866 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:19.725201 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a97f6-724c-47e6-bece-cc4909b40fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:19.725988 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a97f6-724c-47e6-bece-cc4909b40fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:19.726274 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a97f6-724c-47e6-bece-cc4909b40fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:19.726645 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a97f6-724c-47e6-bece-cc4909b40fe7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:19.733881 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a97f6-724c-47e6-bece-cc4909b40fe7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:19.736332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a97f6-724c-47e6-bece-cc4909b40fe7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:19.750668 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-3d1a97f6-724c-47e6-bece-cc4909b40fe7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:04:19.755950 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 484/977] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:04:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:19.758674 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5d4ab-892d-4e70-b797-77a64d20e01b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:19.770675 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5d4ab-892d-4e70-b797-77a64d20e01b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:19.776277 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83348ba2-bf37-4576-ab4f-24cda0fc13cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:19.777121 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83348ba2-bf37-4576-ab4f-24cda0fc13cf admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:19.777581 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83348ba2-bf37-4576-ab4f-24cda0fc13cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:19.778062 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83348ba2-bf37-4576-ab4f-24cda0fc13cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:19.779073 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83348ba2-bf37-4576-ab4f-24cda0fc13cf admin admin] RBAC: Adding query filter params (name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:19.779555 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83348ba2-bf37-4576-ab4f-24cda0fc13cf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:19.782057 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83348ba2-bf37-4576-ab4f-24cda0fc13cf admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:19.805203 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 494/978] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Feb 10 23:04:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:21.201405 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bbb45-6ceb-4b9e-99ec-1ae6ae6475e8 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:21.201937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bbb45-6ceb-4b9e-99ec-1ae6ae6475e8 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:21.201937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bbb45-6ceb-4b9e-99ec-1ae6ae6475e8 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:21.203975 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 485/979] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:21.210414 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df2b80-41ff-46f2-a2cb-b5bc112bfea2 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:21.210973 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df2b80-41ff-46f2-a2cb-b5bc112bfea2 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:21.210973 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df2b80-41ff-46f2-a2cb-b5bc112bfea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:21.230847 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-64df2b80-41ff-46f2-a2cb-b5bc112bfea2 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:21.232456 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-64df2b80-41ff-46f2-a2cb-b5bc112bfea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:21.242036 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 495/980] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:21 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:21.266229 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bbb45-6ceb-4b9e-99ec-1ae6ae6475e8 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:21.280103 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bbb45-6ceb-4b9e-99ec-1ae6ae6475e8 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:21.284546 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585b799-b59a-4451-b8d9-95d8911588ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:21.285191 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585b799-b59a-4451-b8d9-95d8911588ee admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:21.285475 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585b799-b59a-4451-b8d9-95d8911588ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:21.285748 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585b799-b59a-4451-b8d9-95d8911588ee admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:21.286946 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585b799-b59a-4451-b8d9-95d8911588ee admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:21.288563 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585b799-b59a-4451-b8d9-95d8911588ee admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:21.304504 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 486/981] 10.222.0.77 () {60 vars in 1162 bytes} [Thu Feb 10 23:04:21 2022] POST /identity/v3/services => generated 242 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:04:21.480259 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19195281-d701-4624-9bc7-d0c3fb8389d6 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:21.480559 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19195281-d701-4624-9bc7-d0c3fb8389d6 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:21.480806 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19195281-d701-4624-9bc7-d0c3fb8389d6 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:21.482747 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 496/982] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:21.488337 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b67b9b-6e0c-4d58-8fb9-f35813d740ce None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:21.488622 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b67b9b-6e0c-4d58-8fb9-f35813d740ce None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:21.488898 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b67b9b-6e0c-4d58-8fb9-f35813d740ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:21.508160 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-27b67b9b-6e0c-4d58-8fb9-f35813d740ce None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:21.509358 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-27b67b9b-6e0c-4d58-8fb9-f35813d740ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:21.527228 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 487/983] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:21 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:21.532087 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa35035-135f-42d7-b473-52e2dd59f780 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:21.532372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa35035-135f-42d7-b473-52e2dd59f780 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:21.532649 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa35035-135f-42d7-b473-52e2dd59f780 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:21.534384 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 497/984] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:21.540305 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0289749-b880-46e0-80fd-c3233295e192 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:21.540592 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0289749-b880-46e0-80fd-c3233295e192 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:21.540869 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0289749-b880-46e0-80fd-c3233295e192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:21.556817 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa35035-135f-42d7-b473-52e2dd59f780 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:21.558563 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-c0289749-b880-46e0-80fd-c3233295e192 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:21.559756 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-c0289749-b880-46e0-80fd-c3233295e192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:21.568165 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 488/985] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:21 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:21.571614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa35035-135f-42d7-b473-52e2dd59f780 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:21.579909 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869754c-d48d-4cdd-a14c-ae09559e29fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:21.579909 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869754c-d48d-4cdd-a14c-ae09559e29fd admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:21.579909 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869754c-d48d-4cdd-a14c-ae09559e29fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:21.579909 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869754c-d48d-4cdd-a14c-ae09559e29fd admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:21.580249 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869754c-d48d-4cdd-a14c-ae09559e29fd admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:21.580249 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869754c-d48d-4cdd-a14c-ae09559e29fd admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:21.590972 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0289749-b880-46e0-80fd-c3233295e192 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:21.592310 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-4869754c-d48d-4cdd-a14c-ae09559e29fd admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 10 23:04:21.595908 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 498/986] 10.222.0.77 () {56 vars in 1147 bytes} [Thu Feb 10 23:04:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:04:21.601377 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869754c-d48d-4cdd-a14c-ae09559e29fd admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:21.605316 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0289749-b880-46e0-80fd-c3233295e192 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:21.611726 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da66c1-abeb-4895-869c-7dc691dd9efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:21.612582 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869754c-d48d-4cdd-a14c-ae09559e29fd admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:21.612843 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da66c1-abeb-4895-869c-7dc691dd9efa admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:21.613480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da66c1-abeb-4895-869c-7dc691dd9efa admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:21.614127 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da66c1-abeb-4895-869c-7dc691dd9efa admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:21.615790 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da66c1-abeb-4895-869c-7dc691dd9efa admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:21.617606 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da66c1-abeb-4895-869c-7dc691dd9efa admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:21.617796 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911107b7-3fed-4385-a877-0262df763c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:21.618415 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911107b7-3fed-4385-a877-0262df763c79 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:21.618701 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911107b7-3fed-4385-a877-0262df763c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:21.618973 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911107b7-3fed-4385-a877-0262df763c79 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:21.619695 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911107b7-3fed-4385-a877-0262df763c79 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:21.620049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911107b7-3fed-4385-a877-0262df763c79 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:21.621863 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911107b7-3fed-4385-a877-0262df763c79 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:21.628225 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 499/987] 10.222.0.77 () {56 vars in 1143 bytes} [Thu Feb 10 23:04:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:21.634310 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911107b7-3fed-4385-a877-0262df763c79 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:21.638182 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 489/988] 10.222.0.77 () {60 vars in 1162 bytes} [Thu Feb 10 23:04:21 2022] POST /identity/v3/services => generated 242 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:04:21.649591 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911107b7-3fed-4385-a877-0262df763c79 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:21.668115 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf4f0a-85d1-48cc-8a60-487e2f31ea47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:21.668789 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf4f0a-85d1-48cc-8a60-487e2f31ea47 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:21.669073 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf4f0a-85d1-48cc-8a60-487e2f31ea47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:21.669408 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf4f0a-85d1-48cc-8a60-487e2f31ea47 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:21.670206 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf4f0a-85d1-48cc-8a60-487e2f31ea47 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:21.670615 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf4f0a-85d1-48cc-8a60-487e2f31ea47 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:21.672455 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf4f0a-85d1-48cc-8a60-487e2f31ea47 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:21.684007 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 500/989] 10.222.0.77 () {56 vars in 1143 bytes} [Thu Feb 10 23:04:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:21.686553 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da66c1-abeb-4895-869c-7dc691dd9efa admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:21.700003 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da66c1-abeb-4895-869c-7dc691dd9efa admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:21.704974 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6d0e9-30dd-46e4-9feb-7a87eb5906de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:21.705712 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6d0e9-30dd-46e4-9feb-7a87eb5906de admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:21.705995 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6d0e9-30dd-46e4-9feb-7a87eb5906de admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:21.706271 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6d0e9-30dd-46e4-9feb-7a87eb5906de admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:21.707178 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6d0e9-30dd-46e4-9feb-7a87eb5906de admin admin] RBAC: Adding query filter params (interface=admin, service_id=fc702ada12f142d1be768cd8eeced156, region_id=RegionOne) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:21.707495 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6d0e9-30dd-46e4-9feb-7a87eb5906de admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:21.710296 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6d0e9-30dd-46e4-9feb-7a87eb5906de admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:21.721898 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 490/990] 10.222.0.77 () {56 vars in 1270 bytes} [Thu Feb 10 23:04:21 2022] GET /identity/v3/endpoints?service_id=fc702ada12f142d1be768cd8eeced156&interface=admin®ion_id=RegionOne => generated 193 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:21.723397 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf4f0a-85d1-48cc-8a60-487e2f31ea47 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:21.735790 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf4f0a-85d1-48cc-8a60-487e2f31ea47 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:21.742098 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af26d5-1c41-4d1f-a7a0-c2dad917e892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:21.742877 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af26d5-1c41-4d1f-a7a0-c2dad917e892 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:21.743216 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af26d5-1c41-4d1f-a7a0-c2dad917e892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:21.743501 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af26d5-1c41-4d1f-a7a0-c2dad917e892 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:21.744281 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af26d5-1c41-4d1f-a7a0-c2dad917e892 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:21.746075 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af26d5-1c41-4d1f-a7a0-c2dad917e892 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:21.758943 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 501/991] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Feb 10 23:04:21 2022] GET /identity/v3/services => generated 1957 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:04:22.155774 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f510ed-8eaf-477e-bca9-a825b25abda1 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:22.156136 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f510ed-8eaf-477e-bca9-a825b25abda1 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:22.156347 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f510ed-8eaf-477e-bca9-a825b25abda1 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:22.158095 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 491/992] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:22.163672 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95af57-af29-40f7-a98c-fdc433959653 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:22.163987 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95af57-af29-40f7-a98c-fdc433959653 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:22.164262 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95af57-af29-40f7-a98c-fdc433959653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:22.183051 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-bf95af57-af29-40f7-a98c-fdc433959653 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:22.184259 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-bf95af57-af29-40f7-a98c-fdc433959653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:22.192871 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 502/993] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:22 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:22.218609 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f510ed-8eaf-477e-bca9-a825b25abda1 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:22.230951 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f510ed-8eaf-477e-bca9-a825b25abda1 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:22.235438 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffae4bd-ff0e-4800-aecd-655cd5f1113c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:22.236372 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffae4bd-ff0e-4800-aecd-655cd5f1113c admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:22.236651 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffae4bd-ff0e-4800-aecd-655cd5f1113c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:22.236920 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffae4bd-ff0e-4800-aecd-655cd5f1113c admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:22.237634 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffae4bd-ff0e-4800-aecd-655cd5f1113c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:22.240005 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffae4bd-ff0e-4800-aecd-655cd5f1113c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:22.241283 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.common [None req-bffae4bd-ff0e-4800-aecd-655cd5f1113c admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 10 23:04:22.255877 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.sql.core [None req-bffae4bd-ff0e-4800-aecd-655cd5f1113c admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 10 23:04:22.255877 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 10 23:04:22.255877 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [parameters: {'user_id': '243ee2b2c5b94c81b8c01ec814c0fb27', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 10 23:04:22.255877 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79312) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 10 23:04:22.270450 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-bffae4bd-ff0e-4800-aecd-655cd5f1113c admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 10 23:04:22.276150 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 492/994] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:04:22 2022] POST /identity/v3/users => generated 160 bytes in 58 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:22.277916 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95af57-af29-40f7-a98c-fdc433959653 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:22.288288 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95af57-af29-40f7-a98c-fdc433959653 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:22.293045 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813cac1-789e-4772-89f5-de81d30136e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:22.293826 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813cac1-789e-4772-89f5-de81d30136e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:22.294100 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813cac1-789e-4772-89f5-de81d30136e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:22.294365 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813cac1-789e-4772-89f5-de81d30136e9 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:22.302266 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813cac1-789e-4772-89f5-de81d30136e9 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:22.304499 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813cac1-789e-4772-89f5-de81d30136e9 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:22.319183 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-1813cac1-789e-4772-89f5-de81d30136e9 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 10 23:04:22.320720 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 503/995] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:04:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:22.326509 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffae4bd-ff0e-4800-aecd-655cd5f1113c admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:22.339144 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffae4bd-ff0e-4800-aecd-655cd5f1113c admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:22.343802 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513cc01-f75b-40f9-8923-da123f49f1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:22.344532 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513cc01-f75b-40f9-8923-da123f49f1fa admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:22.344812 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513cc01-f75b-40f9-8923-da123f49f1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:22.345135 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513cc01-f75b-40f9-8923-da123f49f1fa admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:22.345988 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513cc01-f75b-40f9-8923-da123f49f1fa admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:22.346286 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513cc01-f75b-40f9-8923-da123f49f1fa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:22.348651 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513cc01-f75b-40f9-8923-da123f49f1fa admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:22.390393 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 493/996] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Feb 10 23:04:22 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:23.607450 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05943e-8605-4b3a-a61d-c6cd3905fb08 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:23.608108 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05943e-8605-4b3a-a61d-c6cd3905fb08 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:23.608108 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05943e-8605-4b3a-a61d-c6cd3905fb08 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:23.609816 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 504/997] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:23.615346 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515ec7b-7d31-41dd-9bc6-bf0e7a513513 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:23.615737 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515ec7b-7d31-41dd-9bc6-bf0e7a513513 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:23.615946 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515ec7b-7d31-41dd-9bc6-bf0e7a513513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:23.635282 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-4515ec7b-7d31-41dd-9bc6-bf0e7a513513 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:23.636826 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-4515ec7b-7d31-41dd-9bc6-bf0e7a513513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:23.644574 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 494/998] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:23 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:23.669287 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05943e-8605-4b3a-a61d-c6cd3905fb08 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:23.682919 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05943e-8605-4b3a-a61d-c6cd3905fb08 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:23.687338 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7920cf-5518-48f2-9e31-7118da363334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:23.688156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7920cf-5518-48f2-9e31-7118da363334 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:23.688432 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7920cf-5518-48f2-9e31-7118da363334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:23.688699 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7920cf-5518-48f2-9e31-7118da363334 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:23.689363 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7920cf-5518-48f2-9e31-7118da363334 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:23.690924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7920cf-5518-48f2-9e31-7118da363334 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:23.701937 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-9b7920cf-5518-48f2-9e31-7118da363334 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 10 23:04:23.703125 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 505/999] 10.222.0.77 () {56 vars in 1126 bytes} [Thu Feb 10 23:04:23 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:23.710518 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515ec7b-7d31-41dd-9bc6-bf0e7a513513 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:23.719304 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515ec7b-7d31-41dd-9bc6-bf0e7a513513 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:23.724510 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0cd0c-6f9b-48bd-9b52-91f4fa8f7a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:23.725259 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0cd0c-6f9b-48bd-9b52-91f4fa8f7a9b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:23.725542 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0cd0c-6f9b-48bd-9b52-91f4fa8f7a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:23.725812 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0cd0c-6f9b-48bd-9b52-91f4fa8f7a9b admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:23.726573 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0cd0c-6f9b-48bd-9b52-91f4fa8f7a9b admin admin] RBAC: Adding query filter params (name=image) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:23.726881 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0cd0c-6f9b-48bd-9b52-91f4fa8f7a9b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:23.728476 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0cd0c-6f9b-48bd-9b52-91f4fa8f7a9b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:23.733964 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 495/1000] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:23.739603 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7920cf-5518-48f2-9e31-7118da363334 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:23.749387 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7920cf-5518-48f2-9e31-7118da363334 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:23.753919 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680129b-8d0b-4bae-8e77-43fe32ece987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:23.754567 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680129b-8d0b-4bae-8e77-43fe32ece987 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:23.755013 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680129b-8d0b-4bae-8e77-43fe32ece987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:23.755358 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680129b-8d0b-4bae-8e77-43fe32ece987 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:23.756114 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680129b-8d0b-4bae-8e77-43fe32ece987 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:23.756427 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680129b-8d0b-4bae-8e77-43fe32ece987 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:23.758072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680129b-8d0b-4bae-8e77-43fe32ece987 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:23.763143 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 506/1001] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:23.769017 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0cd0c-6f9b-48bd-9b52-91f4fa8f7a9b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:23.779193 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0cd0c-6f9b-48bd-9b52-91f4fa8f7a9b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:23.783618 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b952d4-9bef-4481-ac90-ce7d4fa41d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:23.784374 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b952d4-9bef-4481-ac90-ce7d4fa41d2a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:23.784721 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b952d4-9bef-4481-ac90-ce7d4fa41d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:23.785066 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b952d4-9bef-4481-ac90-ce7d4fa41d2a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:23.785922 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b952d4-9bef-4481-ac90-ce7d4fa41d2a admin admin] RBAC: Adding query filter params (interface=public, service_id=83411ee65f334957b67b128de8bf951b, region_id=RegionOne) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:23.786944 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b952d4-9bef-4481-ac90-ce7d4fa41d2a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:23.788539 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b952d4-9bef-4481-ac90-ce7d4fa41d2a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:23.793665 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 496/1002] 10.222.0.77 () {56 vars in 1272 bytes} [Thu Feb 10 23:04:23 2022] GET /identity/v3/endpoints?service_id=83411ee65f334957b67b128de8bf951b&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:23.798906 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680129b-8d0b-4bae-8e77-43fe32ece987 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:23.808555 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680129b-8d0b-4bae-8e77-43fe32ece987 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:23.813173 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a69441-8dbd-4ce2-8718-922ee3f6d2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:23.813849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a69441-8dbd-4ce2-8718-922ee3f6d2ac admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:23.814132 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a69441-8dbd-4ce2-8718-922ee3f6d2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:23.814408 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a69441-8dbd-4ce2-8718-922ee3f6d2ac admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:23.815114 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a69441-8dbd-4ce2-8718-922ee3f6d2ac admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:23.816774 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a69441-8dbd-4ce2-8718-922ee3f6d2ac admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:23.824460 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 507/1003] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Feb 10 23:04:23 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:04:23.945897 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3fc02-3327-4a2c-bac8-a3928dff6e26 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:23.946204 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3fc02-3327-4a2c-bac8-a3928dff6e26 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:23.946407 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3fc02-3327-4a2c-bac8-a3928dff6e26 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:23.948409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 497/1004] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:23.954059 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b7878-5686-44f4-84bb-24c771fec464 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:23.954431 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b7878-5686-44f4-84bb-24c771fec464 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:23.954770 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b7878-5686-44f4-84bb-24c771fec464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:23.974942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-fa7b7878-5686-44f4-84bb-24c771fec464 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:23.976344 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-fa7b7878-5686-44f4-84bb-24c771fec464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:23.984221 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 508/1005] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:23 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:04:24.008830 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3fc02-3327-4a2c-bac8-a3928dff6e26 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:24.021519 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3fc02-3327-4a2c-bac8-a3928dff6e26 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:24.025882 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab3b4f-aa0b-4449-84fe-6725fddec576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:24.026656 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab3b4f-aa0b-4449-84fe-6725fddec576 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:24.026934 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab3b4f-aa0b-4449-84fe-6725fddec576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:24.027202 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab3b4f-aa0b-4449-84fe-6725fddec576 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:24.027888 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab3b4f-aa0b-4449-84fe-6725fddec576 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:24.029468 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab3b4f-aa0b-4449-84fe-6725fddec576 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:24.041165 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-e1ab3b4f-aa0b-4449-84fe-6725fddec576 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 10 23:04:24.042326 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 498/1006] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:04:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:24.048290 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b7878-5686-44f4-84bb-24c771fec464 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:24.057793 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b7878-5686-44f4-84bb-24c771fec464 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:24.062464 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe05c03-24b7-4592-8838-73aa7cf07311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:24.063114 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe05c03-24b7-4592-8838-73aa7cf07311 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:24.063456 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe05c03-24b7-4592-8838-73aa7cf07311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:24.063790 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe05c03-24b7-4592-8838-73aa7cf07311 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:24.064607 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe05c03-24b7-4592-8838-73aa7cf07311 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:24.064973 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe05c03-24b7-4592-8838-73aa7cf07311 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:24.066608 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe05c03-24b7-4592-8838-73aa7cf07311 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:24.072551 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 509/1007] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Feb 10 23:04:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:24.081005 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab3b4f-aa0b-4449-84fe-6725fddec576 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:24.090868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab3b4f-aa0b-4449-84fe-6725fddec576 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:24.095257 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d00794-1066-459e-8472-005fd8665717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:24.095921 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d00794-1066-459e-8472-005fd8665717 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:24.096203 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d00794-1066-459e-8472-005fd8665717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:24.096474 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d00794-1066-459e-8472-005fd8665717 admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:24.097178 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d00794-1066-459e-8472-005fd8665717 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:24.097478 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d00794-1066-459e-8472-005fd8665717 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:24.099673 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d00794-1066-459e-8472-005fd8665717 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:24.104699 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 499/1008] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Feb 10 23:04:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:24.110527 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe05c03-24b7-4592-8838-73aa7cf07311 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:24.121295 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe05c03-24b7-4592-8838-73aa7cf07311 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:24.121441 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c61675-ceae-430f-bfd2-b81010fb5e59 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:24.121630 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c61675-ceae-430f-bfd2-b81010fb5e59 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:24.121853 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c61675-ceae-430f-bfd2-b81010fb5e59 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:24.124016 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 500/1009] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:04:24.128781 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e6c3d-0a75-40ea-a94b-e192cfe3c81e None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:24.129067 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e6c3d-0a75-40ea-a94b-e192cfe3c81e None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:24.129167 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7daddd-8447-45ce-bf40-8b311671e15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:24.129356 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e6c3d-0a75-40ea-a94b-e192cfe3c81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:24.130579 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7daddd-8447-45ce-bf40-8b311671e15a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:24.130883 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7daddd-8447-45ce-bf40-8b311671e15a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:24.131156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7daddd-8447-45ce-bf40-8b311671e15a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:24.132049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7daddd-8447-45ce-bf40-8b311671e15a admin admin] RBAC: Adding query filter params (interface=public, service_id=0290138737be48749b0cff582d90a061, region_id=RegionOne) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:24.132359 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7daddd-8447-45ce-bf40-8b311671e15a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:24.133936 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7daddd-8447-45ce-bf40-8b311671e15a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:24.139457 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 510/1010] 10.222.0.77 () {56 vars in 1272 bytes} [Thu Feb 10 23:04:24 2022] GET /identity/v3/endpoints?service_id=0290138737be48749b0cff582d90a061&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:24.144576 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7daddd-8447-45ce-bf40-8b311671e15a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:24.148111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-8d6e6c3d-0a75-40ea-a94b-e192cfe3c81e None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:24.149268 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-8d6e6c3d-0a75-40ea-a94b-e192cfe3c81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:24.154522 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7daddd-8447-45ce-bf40-8b311671e15a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:24.157638 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 501/1011] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:24 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:04:24.159308 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7730c-4639-4c68-a45b-9ab5938d49d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:24.159987 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7730c-4639-4c68-a45b-9ab5938d49d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:24.160267 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7730c-4639-4c68-a45b-9ab5938d49d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:24.160537 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7730c-4639-4c68-a45b-9ab5938d49d9 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:24.161284 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7730c-4639-4c68-a45b-9ab5938d49d9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:24.162832 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7730c-4639-4c68-a45b-9ab5938d49d9 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:24.169534 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 511/1012] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Feb 10 23:04:24 2022] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:04:24.180832 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e6c3d-0a75-40ea-a94b-e192cfe3c81e None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:24.190243 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e6c3d-0a75-40ea-a94b-e192cfe3c81e None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:24.195555 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac995d-2a2e-4393-9d2f-7274cb2bea56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:24.196490 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac995d-2a2e-4393-9d2f-7274cb2bea56 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:24.196714 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac995d-2a2e-4393-9d2f-7274cb2bea56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:24.196983 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac995d-2a2e-4393-9d2f-7274cb2bea56 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:24.197666 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac995d-2a2e-4393-9d2f-7274cb2bea56 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:24.199300 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac995d-2a2e-4393-9d2f-7274cb2bea56 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:24.212014 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-e5ac995d-2a2e-4393-9d2f-7274cb2bea56 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 10 23:04:24.213893 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 502/1013] 10.222.0.77 () {56 vars in 1147 bytes} [Thu Feb 10 23:04:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:24.219489 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7730c-4639-4c68-a45b-9ab5938d49d9 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:24.230480 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7730c-4639-4c68-a45b-9ab5938d49d9 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:24.235335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9170311-6411-4ff4-985a-72e792fb010d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:24.236318 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9170311-6411-4ff4-985a-72e792fb010d admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:24.236604 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9170311-6411-4ff4-985a-72e792fb010d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:24.236880 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9170311-6411-4ff4-985a-72e792fb010d admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:24.237610 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9170311-6411-4ff4-985a-72e792fb010d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:24.237917 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9170311-6411-4ff4-985a-72e792fb010d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:24.240400 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9170311-6411-4ff4-985a-72e792fb010d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:24.246167 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 512/1014] 10.222.0.77 () {56 vars in 1143 bytes} [Thu Feb 10 23:04:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:24.252250 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac995d-2a2e-4393-9d2f-7274cb2bea56 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:24.262328 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac995d-2a2e-4393-9d2f-7274cb2bea56 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:24.266842 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21dadc-0d8b-46d9-b12b-16a58546be69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:24.267506 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21dadc-0d8b-46d9-b12b-16a58546be69 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:24.267782 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21dadc-0d8b-46d9-b12b-16a58546be69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:24.268083 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21dadc-0d8b-46d9-b12b-16a58546be69 admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:24.268804 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21dadc-0d8b-46d9-b12b-16a58546be69 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:24.269106 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21dadc-0d8b-46d9-b12b-16a58546be69 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:24.270793 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21dadc-0d8b-46d9-b12b-16a58546be69 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:24.276538 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 503/1015] 10.222.0.77 () {56 vars in 1143 bytes} [Thu Feb 10 23:04:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:24.282140 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9170311-6411-4ff4-985a-72e792fb010d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:24.293291 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9170311-6411-4ff4-985a-72e792fb010d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:24.297845 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98de57-c480-41eb-abe5-58e295452698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:24.298506 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98de57-c480-41eb-abe5-58e295452698 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:24.298786 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98de57-c480-41eb-abe5-58e295452698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:24.299059 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98de57-c480-41eb-abe5-58e295452698 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:24.299873 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98de57-c480-41eb-abe5-58e295452698 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:24.301451 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98de57-c480-41eb-abe5-58e295452698 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:24.320233 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 513/1016] 10.222.0.77 () {60 vars in 1165 bytes} [Thu Feb 10 23:04:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:04:26.063468 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd5d2a-9889-4404-8f8e-243a53a68f27 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:26.064016 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd5d2a-9889-4404-8f8e-243a53a68f27 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:26.064123 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd5d2a-9889-4404-8f8e-243a53a68f27 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:26.065951 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 504/1017] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:26.071187 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc302904-711a-438d-81da-91cb8e0c0cd4 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:26.071637 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc302904-711a-438d-81da-91cb8e0c0cd4 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:26.071725 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc302904-711a-438d-81da-91cb8e0c0cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:26.093538 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-bc302904-711a-438d-81da-91cb8e0c0cd4 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:26.094700 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-bc302904-711a-438d-81da-91cb8e0c0cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:26.112078 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 514/1018] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:26 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:04:26.135542 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd5d2a-9889-4404-8f8e-243a53a68f27 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:26.148430 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd5d2a-9889-4404-8f8e-243a53a68f27 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:26.152650 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c80b16-1736-4d57-a2e9-c84d7fa82235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:26.153424 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c80b16-1736-4d57-a2e9-c84d7fa82235 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:26.153702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c80b16-1736-4d57-a2e9-c84d7fa82235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:26.153972 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c80b16-1736-4d57-a2e9-c84d7fa82235 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:26.154624 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c80b16-1736-4d57-a2e9-c84d7fa82235 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:26.156231 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c80b16-1736-4d57-a2e9-c84d7fa82235 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:26.167667 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-84c80b16-1736-4d57-a2e9-c84d7fa82235 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 10 23:04:26.168994 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 505/1019] 10.222.0.77 () {56 vars in 1126 bytes} [Thu Feb 10 23:04:26 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:26.174783 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc302904-711a-438d-81da-91cb8e0c0cd4 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:26.184362 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc302904-711a-438d-81da-91cb8e0c0cd4 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:26.188945 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91c3be-018c-4e2a-9bb6-80eadbc9ee9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:26.189685 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91c3be-018c-4e2a-9bb6-80eadbc9ee9d admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:26.190039 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91c3be-018c-4e2a-9bb6-80eadbc9ee9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:26.190387 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91c3be-018c-4e2a-9bb6-80eadbc9ee9d admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:26.191178 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91c3be-018c-4e2a-9bb6-80eadbc9ee9d admin admin] RBAC: Adding query filter params (name=image) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:26.191488 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91c3be-018c-4e2a-9bb6-80eadbc9ee9d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:26.193734 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91c3be-018c-4e2a-9bb6-80eadbc9ee9d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:26.198690 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 515/1020] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:26.204310 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c80b16-1736-4d57-a2e9-c84d7fa82235 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:26.214405 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c80b16-1736-4d57-a2e9-c84d7fa82235 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:26.218851 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69689a3c-9085-4f18-984c-c22bb0b1faf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:26.219489 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69689a3c-9085-4f18-984c-c22bb0b1faf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:26.219768 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69689a3c-9085-4f18-984c-c22bb0b1faf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:26.220076 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69689a3c-9085-4f18-984c-c22bb0b1faf6 admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:26.220900 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69689a3c-9085-4f18-984c-c22bb0b1faf6 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:26.221204 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69689a3c-9085-4f18-984c-c22bb0b1faf6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:26.222767 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69689a3c-9085-4f18-984c-c22bb0b1faf6 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:26.227941 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 506/1021] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:26.233441 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91c3be-018c-4e2a-9bb6-80eadbc9ee9d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:26.244058 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91c3be-018c-4e2a-9bb6-80eadbc9ee9d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:26.248651 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067209d-46b6-4e70-85dc-637eef0fd23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:26.249290 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067209d-46b6-4e70-85dc-637eef0fd23e admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:26.249573 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067209d-46b6-4e70-85dc-637eef0fd23e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:26.249848 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067209d-46b6-4e70-85dc-637eef0fd23e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:26.250612 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067209d-46b6-4e70-85dc-637eef0fd23e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:26.252219 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067209d-46b6-4e70-85dc-637eef0fd23e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:26.273080 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 516/1022] 10.222.0.77 () {60 vars in 1165 bytes} [Thu Feb 10 23:04:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:04:26.410220 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c860786-85ff-45c3-9991-9a44fb7a170a None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:26.410599 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c860786-85ff-45c3-9991-9a44fb7a170a None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:26.411408 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c860786-85ff-45c3-9991-9a44fb7a170a None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:26.413234 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 507/1023] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:26.419056 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a30dd5-69e2-485b-817e-473838af1cf6 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:26.419390 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a30dd5-69e2-485b-817e-473838af1cf6 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:26.419615 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a30dd5-69e2-485b-817e-473838af1cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:26.439121 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-58a30dd5-69e2-485b-817e-473838af1cf6 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:26.440320 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-58a30dd5-69e2-485b-817e-473838af1cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:26.458168 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 517/1024] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:26 2022] POST /identity/v3/auth/tokens => generated 2817 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:26.482025 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c860786-85ff-45c3-9991-9a44fb7a170a None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:26.495421 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c860786-85ff-45c3-9991-9a44fb7a170a None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:26.499980 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701d81a-2634-4804-8997-64baffaa16cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:26.500951 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701d81a-2634-4804-8997-64baffaa16cd admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:26.501431 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701d81a-2634-4804-8997-64baffaa16cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:26.501907 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701d81a-2634-4804-8997-64baffaa16cd admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:26.502732 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701d81a-2634-4804-8997-64baffaa16cd admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:26.505327 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701d81a-2634-4804-8997-64baffaa16cd admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:26.516458 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-5701d81a-2634-4804-8997-64baffaa16cd admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 10 23:04:26.518106 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 508/1025] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:04:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:26.524820 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a30dd5-69e2-485b-817e-473838af1cf6 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:26.533902 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a30dd5-69e2-485b-817e-473838af1cf6 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:26.538591 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1ec74-6d1b-4476-8577-138b153aa774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:26.539328 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1ec74-6d1b-4476-8577-138b153aa774 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:26.539676 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1ec74-6d1b-4476-8577-138b153aa774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:26.540051 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1ec74-6d1b-4476-8577-138b153aa774 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:26.540831 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1ec74-6d1b-4476-8577-138b153aa774 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:26.541199 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1ec74-6d1b-4476-8577-138b153aa774 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:26.542833 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1ec74-6d1b-4476-8577-138b153aa774 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:26.547924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 518/1026] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Feb 10 23:04:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:26.554121 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701d81a-2634-4804-8997-64baffaa16cd admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:26.563635 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701d81a-2634-4804-8997-64baffaa16cd admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:26.569090 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cadaa-5450-4c36-9ab2-998f3969b70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:26.569722 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cadaa-5450-4c36-9ab2-998f3969b70d admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:26.570004 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cadaa-5450-4c36-9ab2-998f3969b70d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:26.570281 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cadaa-5450-4c36-9ab2-998f3969b70d admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:26.571004 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cadaa-5450-4c36-9ab2-998f3969b70d admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:26.571303 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cadaa-5450-4c36-9ab2-998f3969b70d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:26.573027 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cadaa-5450-4c36-9ab2-998f3969b70d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:26.576127 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c311e1-165d-4bbc-b869-116b6483f7a1 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:26.576421 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c311e1-165d-4bbc-b869-116b6483f7a1 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:26.576701 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c311e1-165d-4bbc-b869-116b6483f7a1 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:26.578556 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 509/1027] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Feb 10 23:04:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:26.578721 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 519/1028] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:04:26.584490 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c311e1-165d-4bbc-b869-116b6483f7a1 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:26.584960 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461d1c5-7b3d-4bfa-bceb-9d50697b7b39 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:26.585405 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461d1c5-7b3d-4bfa-bceb-9d50697b7b39 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:26.585689 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461d1c5-7b3d-4bfa-bceb-9d50697b7b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:26.597159 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c311e1-165d-4bbc-b869-116b6483f7a1 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:26.601963 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440eff5-a7c6-4559-b38a-16c4559fb992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:26.602600 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440eff5-a7c6-4559-b38a-16c4559fb992 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:26.602886 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440eff5-a7c6-4559-b38a-16c4559fb992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:26.603093 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-b461d1c5-7b3d-4bfa-bceb-9d50697b7b39 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:26.603194 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440eff5-a7c6-4559-b38a-16c4559fb992 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:26.603931 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440eff5-a7c6-4559-b38a-16c4559fb992 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:26.604331 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-b461d1c5-7b3d-4bfa-bceb-9d50697b7b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:26.605504 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440eff5-a7c6-4559-b38a-16c4559fb992 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:26.615899 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 510/1029] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:26 2022] POST /identity/v3/auth/tokens => generated 2817 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:26.627879 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 520/1030] 10.222.0.77 () {60 vars in 1165 bytes} [Thu Feb 10 23:04:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:04:26.637848 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461d1c5-7b3d-4bfa-bceb-9d50697b7b39 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:26.648034 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461d1c5-7b3d-4bfa-bceb-9d50697b7b39 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:26.668280 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacabbe-dff0-4550-9844-3af1eeef9408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:26.668986 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacabbe-dff0-4550-9844-3af1eeef9408 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:26.669268 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacabbe-dff0-4550-9844-3af1eeef9408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:26.669539 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacabbe-dff0-4550-9844-3af1eeef9408 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:26.670769 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacabbe-dff0-4550-9844-3af1eeef9408 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:26.672627 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacabbe-dff0-4550-9844-3af1eeef9408 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:26.675864 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 511/1031] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:26.681322 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440eff5-a7c6-4559-b38a-16c4559fb992 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:26.692758 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440eff5-a7c6-4559-b38a-16c4559fb992 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:26.697634 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30699db8-e647-433c-bf44-d781a48fea16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:26.698316 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30699db8-e647-433c-bf44-d781a48fea16 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:26.698594 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30699db8-e647-433c-bf44-d781a48fea16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:26.698862 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30699db8-e647-433c-bf44-d781a48fea16 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:26.699607 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30699db8-e647-433c-bf44-d781a48fea16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:26.701552 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30699db8-e647-433c-bf44-d781a48fea16 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:26.737738 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 521/1032] 10.222.0.77 () {60 vars in 1162 bytes} [Thu Feb 10 23:04:26 2022] POST /identity/v3/projects => generated 311 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:04:28.500798 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86d719-0261-4862-a473-28bd2008141c None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:28.501330 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86d719-0261-4862-a473-28bd2008141c None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:28.501330 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86d719-0261-4862-a473-28bd2008141c None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:28.503242 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 512/1033] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:28.508986 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980f354-3f99-4e24-8120-aa1a7cc81d17 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:28.509427 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980f354-3f99-4e24-8120-aa1a7cc81d17 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:28.509724 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980f354-3f99-4e24-8120-aa1a7cc81d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:28.527261 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-2980f354-3f99-4e24-8120-aa1a7cc81d17 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:28.528655 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2980f354-3f99-4e24-8120-aa1a7cc81d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:28.585223 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 522/1034] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:28 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:28.607868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86d719-0261-4862-a473-28bd2008141c None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:28.620806 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86d719-0261-4862-a473-28bd2008141c None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:28.625170 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f6b84-64d9-47c9-8568-d1c650ae573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:28.625900 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f6b84-64d9-47c9-8568-d1c650ae573b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:28.626279 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f6b84-64d9-47c9-8568-d1c650ae573b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:28.626645 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f6b84-64d9-47c9-8568-d1c650ae573b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:28.634554 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f6b84-64d9-47c9-8568-d1c650ae573b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:28.636486 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f6b84-64d9-47c9-8568-d1c650ae573b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:28.645649 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 513/1035] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:04:28 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:04:28.651392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980f354-3f99-4e24-8120-aa1a7cc81d17 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:28.660349 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980f354-3f99-4e24-8120-aa1a7cc81d17 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:28.665559 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6090be-328c-4373-bd01-56ff9b4bdc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:28.666442 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6090be-328c-4373-bd01-56ff9b4bdc09 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:28.666821 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6090be-328c-4373-bd01-56ff9b4bdc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:28.667188 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6090be-328c-4373-bd01-56ff9b4bdc09 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:28.668493 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6090be-328c-4373-bd01-56ff9b4bdc09 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:28.670255 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6090be-328c-4373-bd01-56ff9b4bdc09 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:28.672872 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 523/1036] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:29.006694 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738691a-b599-450a-898c-7b2d70ef9eb1 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:29.006988 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738691a-b599-450a-898c-7b2d70ef9eb1 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:29.007266 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738691a-b599-450a-898c-7b2d70ef9eb1 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:29.009073 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 514/1037] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:29.014439 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c38e69-00db-4880-9786-524893e57347 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:29.014797 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c38e69-00db-4880-9786-524893e57347 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:29.015144 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c38e69-00db-4880-9786-524893e57347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:29.033048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-f9c38e69-00db-4880-9786-524893e57347 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:29.034213 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-f9c38e69-00db-4880-9786-524893e57347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:29.042600 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 524/1038] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:29 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:04:29.056854 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b0449-4500-49ec-82d1-82802d4b51d5 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:29.057144 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b0449-4500-49ec-82d1-82802d4b51d5 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:29.057421 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b0449-4500-49ec-82d1-82802d4b51d5 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:29.059167 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 515/1039] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:29.064416 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551effcb-3292-4675-8871-74df4c82a338 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:29.064701 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551effcb-3292-4675-8871-74df4c82a338 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:29.064974 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551effcb-3292-4675-8871-74df4c82a338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:29.066342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b0449-4500-49ec-82d1-82802d4b51d5 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:29.078129 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b0449-4500-49ec-82d1-82802d4b51d5 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:29.082406 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-551effcb-3292-4675-8871-74df4c82a338 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:29.083778 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a2320-b6cf-48f1-9f58-ac0fbc0e2a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:29.084383 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-551effcb-3292-4675-8871-74df4c82a338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:29.084595 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a2320-b6cf-48f1-9f58-ac0fbc0e2a5e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:29.084877 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a2320-b6cf-48f1-9f58-ac0fbc0e2a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:29.085156 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a2320-b6cf-48f1-9f58-ac0fbc0e2a5e admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:29.092082 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 525/1040] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:29 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:04:29.096786 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a2320-b6cf-48f1-9f58-ac0fbc0e2a5e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:04:29.104888 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-a21a2320-b6cf-48f1-9f58-ac0fbc0e2a5e admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 10 23:04:29.106085 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 516/1041] 10.222.0.77 () {56 vars in 1141 bytes} [Thu Feb 10 23:04:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:04:29.112077 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551effcb-3292-4675-8871-74df4c82a338 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:29.118049 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a2320-b6cf-48f1-9f58-ac0fbc0e2a5e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:29.121090 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551effcb-3292-4675-8871-74df4c82a338 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:29.125500 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fabb80-bbe4-4512-bfb6-8c916f9b6235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:29.126133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fabb80-bbe4-4512-bfb6-8c916f9b6235 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:29.126410 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fabb80-bbe4-4512-bfb6-8c916f9b6235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:29.126678 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fabb80-bbe4-4512-bfb6-8c916f9b6235 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:29.127418 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fabb80-bbe4-4512-bfb6-8c916f9b6235 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:29.127744 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a2320-b6cf-48f1-9f58-ac0fbc0e2a5e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:29.127866 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fabb80-bbe4-4512-bfb6-8c916f9b6235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:29.129373 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fabb80-bbe4-4512-bfb6-8c916f9b6235 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:29.132474 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4dbc6-4250-48ca-832d-ada1b413556d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:29.133205 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4dbc6-4250-48ca-832d-ada1b413556d admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:29.133487 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4dbc6-4250-48ca-832d-ada1b413556d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:29.133762 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4dbc6-4250-48ca-832d-ada1b413556d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:29.134916 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4dbc6-4250-48ca-832d-ada1b413556d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:29.136608 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4dbc6-4250-48ca-832d-ada1b413556d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:29.137409 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 526/1042] 10.222.0.77 () {56 vars in 1136 bytes} [Thu Feb 10 23:04:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:29.138319 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 517/1043] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:29.142741 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fabb80-bbe4-4512-bfb6-8c916f9b6235 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:29.143389 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4dbc6-4250-48ca-832d-ada1b413556d admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:29.152376 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fabb80-bbe4-4512-bfb6-8c916f9b6235 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:29.153344 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4dbc6-4250-48ca-832d-ada1b413556d admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:29.156752 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6af218-7a9e-4b21-8d90-e3c5843f4d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:29.157490 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6af218-7a9e-4b21-8d90-e3c5843f4d89 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:29.157677 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7a25e-f17e-4b1b-88e4-bf197cefe18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:29.157795 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6af218-7a9e-4b21-8d90-e3c5843f4d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:29.158025 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6af218-7a9e-4b21-8d90-e3c5843f4d89 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:29.158288 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7a25e-f17e-4b1b-88e4-bf197cefe18a admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:29.158571 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7a25e-f17e-4b1b-88e4-bf197cefe18a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:29.158844 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7a25e-f17e-4b1b-88e4-bf197cefe18a admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:29.159548 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7a25e-f17e-4b1b-88e4-bf197cefe18a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:29.162389 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7a25e-f17e-4b1b-88e4-bf197cefe18a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:29.168908 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6af218-7a9e-4b21-8d90-e3c5843f4d89 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:29.170672 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6af218-7a9e-4b21-8d90-e3c5843f4d89 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:29.182422 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 518/1044] 10.222.0.77 () {60 vars in 1153 bytes} [Thu Feb 10 23:04:29 2022] POST /identity/v3/users => generated 285 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:04:29.187584 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-0d6af218-7a9e-4b21-8d90-e3c5843f4d89 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:29.188854 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 527/1045] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:29.194893 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7a25e-f17e-4b1b-88e4-bf197cefe18a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:29.205096 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7a25e-f17e-4b1b-88e4-bf197cefe18a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:29.210889 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d7f67-16e7-4144-b35d-87259e64542c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:29.211579 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d7f67-16e7-4144-b35d-87259e64542c admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:29.211959 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d7f67-16e7-4144-b35d-87259e64542c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:29.212242 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d7f67-16e7-4144-b35d-87259e64542c admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:29.213007 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d7f67-16e7-4144-b35d-87259e64542c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:29.213377 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d7f67-16e7-4144-b35d-87259e64542c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:29.214992 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d7f67-16e7-4144-b35d-87259e64542c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:29.229402 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 519/1046] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:29.235383 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6af218-7a9e-4b21-8d90-e3c5843f4d89 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:29.246799 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6af218-7a9e-4b21-8d90-e3c5843f4d89 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:29.251560 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f9d26-1f19-4468-bc05-57d8817a9755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:29.252526 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f9d26-1f19-4468-bc05-57d8817a9755 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:29.252882 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f9d26-1f19-4468-bc05-57d8817a9755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:29.253228 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f9d26-1f19-4468-bc05-57d8817a9755 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:29.262752 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f9d26-1f19-4468-bc05-57d8817a9755 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:29.264727 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f9d26-1f19-4468-bc05-57d8817a9755 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:29.279182 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-631f9d26-1f19-4468-bc05-57d8817a9755 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 23:04:29.280463 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 528/1047] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Feb 10 23:04:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:04:29.287783 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d7f67-16e7-4144-b35d-87259e64542c admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:29.298772 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d7f67-16e7-4144-b35d-87259e64542c admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:29.303955 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d4d0c-cd62-4b76-bba1-ba2807934018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:29.304633 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d4d0c-cd62-4b76-bba1-ba2807934018 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:29.304912 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d4d0c-cd62-4b76-bba1-ba2807934018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:29.305182 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d4d0c-cd62-4b76-bba1-ba2807934018 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:29.306070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d4d0c-cd62-4b76-bba1-ba2807934018 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:29.306375 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d4d0c-cd62-4b76-bba1-ba2807934018 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:29.308320 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d4d0c-cd62-4b76-bba1-ba2807934018 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:29.328189 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 520/1048] 10.222.0.77 () {56 vars in 1154 bytes} [Thu Feb 10 23:04:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:29.334075 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f9d26-1f19-4468-bc05-57d8817a9755 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:29.344475 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f9d26-1f19-4468-bc05-57d8817a9755 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:29.349542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c207cb-25ec-4f99-a730-feaf4fbac574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:29.350250 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c207cb-25ec-4f99-a730-feaf4fbac574 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:29.350532 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c207cb-25ec-4f99-a730-feaf4fbac574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:29.350802 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c207cb-25ec-4f99-a730-feaf4fbac574 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:29.358542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c207cb-25ec-4f99-a730-feaf4fbac574 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:29.360317 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c207cb-25ec-4f99-a730-feaf4fbac574 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:29.369953 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 529/1049] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:04:29 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:04:29.375939 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d4d0c-cd62-4b76-bba1-ba2807934018 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:29.385738 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d4d0c-cd62-4b76-bba1-ba2807934018 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:29.390233 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa05bf-1bd0-457a-bb6e-fee5fbe0a113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:29.391003 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa05bf-1bd0-457a-bb6e-fee5fbe0a113 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:29.391282 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa05bf-1bd0-457a-bb6e-fee5fbe0a113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:29.391557 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa05bf-1bd0-457a-bb6e-fee5fbe0a113 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:29.402011 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa05bf-1bd0-457a-bb6e-fee5fbe0a113 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:29.403886 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa05bf-1bd0-457a-bb6e-fee5fbe0a113 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:29.421762 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-2ffa05bf-1bd0-457a-bb6e-fee5fbe0a113 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:29.422959 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 521/1050] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:29.429572 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c207cb-25ec-4f99-a730-feaf4fbac574 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:29.438525 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c207cb-25ec-4f99-a730-feaf4fbac574 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:29.443252 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ec9f7-855a-476a-a76a-cc8049e76b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:29.443924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ec9f7-855a-476a-a76a-cc8049e76b65 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:29.444205 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ec9f7-855a-476a-a76a-cc8049e76b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:29.444475 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ec9f7-855a-476a-a76a-cc8049e76b65 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:29.445198 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ec9f7-855a-476a-a76a-cc8049e76b65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:29.445497 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ec9f7-855a-476a-a76a-cc8049e76b65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:29.447049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ec9f7-855a-476a-a76a-cc8049e76b65 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:29.458862 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 530/1051] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:29.464379 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa05bf-1bd0-457a-bb6e-fee5fbe0a113 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:29.474831 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa05bf-1bd0-457a-bb6e-fee5fbe0a113 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:29.479372 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51847f1a-9e63-4ca8-b328-282bde7c5f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:29.480168 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51847f1a-9e63-4ca8-b328-282bde7c5f31 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:29.480455 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51847f1a-9e63-4ca8-b328-282bde7c5f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:29.480734 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51847f1a-9e63-4ca8-b328-282bde7c5f31 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:29.487800 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51847f1a-9e63-4ca8-b328-282bde7c5f31 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:29.490536 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51847f1a-9e63-4ca8-b328-282bde7c5f31 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:29.503407 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-51847f1a-9e63-4ca8-b328-282bde7c5f31 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:04:29.504760 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 522/1052] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:04:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:29.510827 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ec9f7-855a-476a-a76a-cc8049e76b65 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:29.520523 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ec9f7-855a-476a-a76a-cc8049e76b65 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:29.524908 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2f2ac-4814-4cd8-b297-407d333785cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:29.525547 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2f2ac-4814-4cd8-b297-407d333785cb admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:29.525830 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2f2ac-4814-4cd8-b297-407d333785cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:29.526105 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2f2ac-4814-4cd8-b297-407d333785cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:29.526896 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2f2ac-4814-4cd8-b297-407d333785cb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:29.527204 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2f2ac-4814-4cd8-b297-407d333785cb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:29.529061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2f2ac-4814-4cd8-b297-407d333785cb admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:29.541423 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 531/1053] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:04:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:29.547672 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51847f1a-9e63-4ca8-b328-282bde7c5f31 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:29.558478 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51847f1a-9e63-4ca8-b328-282bde7c5f31 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:29.562972 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54816bd-11aa-4008-b1d3-210b00b8e689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:29.563597 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54816bd-11aa-4008-b1d3-210b00b8e689 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:29.563909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54816bd-11aa-4008-b1d3-210b00b8e689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:29.564181 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54816bd-11aa-4008-b1d3-210b00b8e689 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:29.564998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54816bd-11aa-4008-b1d3-210b00b8e689 admin admin] RBAC: Adding query filter params (role.id=ba41bad22bbb402082f3c8d0b387644b, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=551da2c9fab74cb8b14287a5634adb25) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:29.565302 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54816bd-11aa-4008-b1d3-210b00b8e689 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:29.567669 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54816bd-11aa-4008-b1d3-210b00b8e689 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:29.573182 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 523/1054] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:04:29 2022] GET /identity/v3/role_assignments?user.id=551da2c9fab74cb8b14287a5634adb25&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=ba41bad22bbb402082f3c8d0b387644b => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:31.431262 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794c06a-498e-4ccc-85c7-4683c9ea8715 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:31.431849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794c06a-498e-4ccc-85c7-4683c9ea8715 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:31.431849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794c06a-498e-4ccc-85c7-4683c9ea8715 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:31.433627 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 532/1055] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:31.438917 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a06223-4ead-4f4b-a263-e9332446d558 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:31.439340 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a06223-4ead-4f4b-a263-e9332446d558 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:31.439449 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a06223-4ead-4f4b-a263-e9332446d558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:31.458402 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-43a06223-4ead-4f4b-a263-e9332446d558 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:31.459550 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-43a06223-4ead-4f4b-a263-e9332446d558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:31.466970 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 524/1056] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:31 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:31.491264 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794c06a-498e-4ccc-85c7-4683c9ea8715 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:31.503613 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794c06a-498e-4ccc-85c7-4683c9ea8715 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:31.508809 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ea584-ee85-4ce1-a23e-0815a1aea51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:31.509609 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ea584-ee85-4ce1-a23e-0815a1aea51f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:31.509890 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ea584-ee85-4ce1-a23e-0815a1aea51f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:31.510161 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ea584-ee85-4ce1-a23e-0815a1aea51f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:31.522326 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ea584-ee85-4ce1-a23e-0815a1aea51f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:04:31.529066 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-a49ea584-ee85-4ce1-a23e-0815a1aea51f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:04:31.530454 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 533/1057] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:04:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:04:31.537032 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a06223-4ead-4f4b-a263-e9332446d558 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:31.545724 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a06223-4ead-4f4b-a263-e9332446d558 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:31.550089 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42973ba4-59f6-4211-8f62-56de8c5fc918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:31.550731 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42973ba4-59f6-4211-8f62-56de8c5fc918 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:31.551008 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42973ba4-59f6-4211-8f62-56de8c5fc918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:31.551314 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42973ba4-59f6-4211-8f62-56de8c5fc918 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:31.552253 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42973ba4-59f6-4211-8f62-56de8c5fc918 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:31.552557 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42973ba4-59f6-4211-8f62-56de8c5fc918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:31.554124 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42973ba4-59f6-4211-8f62-56de8c5fc918 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:31.562131 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 525/1058] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:04:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:31.568720 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ea584-ee85-4ce1-a23e-0815a1aea51f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:31.577934 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ea584-ee85-4ce1-a23e-0815a1aea51f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:31.582334 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12d3b9-9eb4-461f-8319-ee066a4b441b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:31.584080 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12d3b9-9eb4-461f-8319-ee066a4b441b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:31.584361 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12d3b9-9eb4-461f-8319-ee066a4b441b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:31.584632 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12d3b9-9eb4-461f-8319-ee066a4b441b admin admin] PATH_INFO: `/v3/users/c84582011ae04ce8a4d242e04607f089` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:31.597610 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12d3b9-9eb4-461f-8319-ee066a4b441b admin admin] RBAC: Authorizing `identity:get_user(user_id=c84582011ae04ce8a4d242e04607f089)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:31.599853 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12d3b9-9eb4-461f-8319-ee066a4b441b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:31.601624 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 534/1059] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:04:31 2022] GET /identity/v3/users/c84582011ae04ce8a4d242e04607f089 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:31.606932 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42973ba4-59f6-4211-8f62-56de8c5fc918 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:31.616779 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42973ba4-59f6-4211-8f62-56de8c5fc918 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:31.621203 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e0865-8c37-49df-b280-36e26bd661cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:31.621834 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e0865-8c37-49df-b280-36e26bd661cb admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:31.622114 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e0865-8c37-49df-b280-36e26bd661cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:31.622388 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e0865-8c37-49df-b280-36e26bd661cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:31.631096 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e0865-8c37-49df-b280-36e26bd661cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:31.632861 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e0865-8c37-49df-b280-36e26bd661cb admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:31.641505 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 526/1060] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:04:31 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:04:31.648159 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12d3b9-9eb4-461f-8319-ee066a4b441b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:31.657578 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12d3b9-9eb4-461f-8319-ee066a4b441b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:31.662772 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca20de0-f124-4aea-a32d-264568e00ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:31.663686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca20de0-f124-4aea-a32d-264568e00ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:31.664067 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca20de0-f124-4aea-a32d-264568e00ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:31.664342 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca20de0-f124-4aea-a32d-264568e00ef2 admin admin] PATH_INFO: `/v3/projects/172b47f468a049aba6a489593275f122` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:31.665520 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca20de0-f124-4aea-a32d-264568e00ef2 admin admin] RBAC: Authorizing `identity:get_project(project_id=172b47f468a049aba6a489593275f122)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:31.667539 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca20de0-f124-4aea-a32d-264568e00ef2 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:31.669263 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 535/1061] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:04:31 2022] GET /identity/v3/projects/172b47f468a049aba6a489593275f122 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:31.675098 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e0865-8c37-49df-b280-36e26bd661cb admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:31.684967 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e0865-8c37-49df-b280-36e26bd661cb admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:31.689354 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fcf0f-10b0-426f-8fa1-8310a711d092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:31.689980 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fcf0f-10b0-426f-8fa1-8310a711d092 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:31.690268 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fcf0f-10b0-426f-8fa1-8310a711d092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:31.690541 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fcf0f-10b0-426f-8fa1-8310a711d092 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:31.691363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fcf0f-10b0-426f-8fa1-8310a711d092 admin admin] RBAC: Adding query filter params (role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f, scope.project.id=172b47f468a049aba6a489593275f122, user.id=c84582011ae04ce8a4d242e04607f089) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:31.691669 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fcf0f-10b0-426f-8fa1-8310a711d092 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:31.694323 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fcf0f-10b0-426f-8fa1-8310a711d092 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:31.699665 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 527/1062] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:04:31 2022] GET /identity/v3/role_assignments?user.id=c84582011ae04ce8a4d242e04607f089&scope.project.id=172b47f468a049aba6a489593275f122&role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:31.793384 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c6c8f-df95-4b92-b0c5-0d21e5289703 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:31.793701 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c6c8f-df95-4b92-b0c5-0d21e5289703 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:31.793933 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c6c8f-df95-4b92-b0c5-0d21e5289703 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:31.795703 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 536/1063] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:31.801405 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def6e92-afe8-49e1-bc89-4ee23a003356 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:31.801846 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def6e92-afe8-49e1-bc89-4ee23a003356 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:31.801998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def6e92-afe8-49e1-bc89-4ee23a003356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:31.937820 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-8def6e92-afe8-49e1-bc89-4ee23a003356 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:31.938930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-8def6e92-afe8-49e1-bc89-4ee23a003356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:31.946791 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 528/1064] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:31 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:31.970305 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c6c8f-df95-4b92-b0c5-0d21e5289703 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:31.982844 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c6c8f-df95-4b92-b0c5-0d21e5289703 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:31.987418 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4ad07-f062-4349-98b5-2790f2c5edb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:31.988229 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4ad07-f062-4349-98b5-2790f2c5edb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:31.988513 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4ad07-f062-4349-98b5-2790f2c5edb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:31.988800 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4ad07-f062-4349-98b5-2790f2c5edb3 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:31.998721 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4ad07-f062-4349-98b5-2790f2c5edb3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:04:32.006042 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-20a4ad07-f062-4349-98b5-2790f2c5edb3 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 10 23:04:32.007188 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 537/1065] 10.222.0.77 () {56 vars in 1141 bytes} [Thu Feb 10 23:04:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:32.013231 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def6e92-afe8-49e1-bc89-4ee23a003356 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:32.022466 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def6e92-afe8-49e1-bc89-4ee23a003356 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:32.026883 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e8dbf-a350-46b0-a87e-7035585159c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:32.027548 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e8dbf-a350-46b0-a87e-7035585159c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:32.027855 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e8dbf-a350-46b0-a87e-7035585159c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:32.028120 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e8dbf-a350-46b0-a87e-7035585159c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:32.028866 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e8dbf-a350-46b0-a87e-7035585159c2 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:32.029163 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e8dbf-a350-46b0-a87e-7035585159c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:32.030733 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e8dbf-a350-46b0-a87e-7035585159c2 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:32.039149 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 529/1066] 10.222.0.77 () {56 vars in 1136 bytes} [Thu Feb 10 23:04:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:32.044944 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4ad07-f062-4349-98b5-2790f2c5edb3 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:32.054993 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4ad07-f062-4349-98b5-2790f2c5edb3 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:32.059421 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da172fb-ea06-4515-a591-994a9c6b2d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:32.060208 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da172fb-ea06-4515-a591-994a9c6b2d17 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:32.060487 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da172fb-ea06-4515-a591-994a9c6b2d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:32.060758 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da172fb-ea06-4515-a591-994a9c6b2d17 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:32.070858 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da172fb-ea06-4515-a591-994a9c6b2d17 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:32.072739 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da172fb-ea06-4515-a591-994a9c6b2d17 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:32.091143 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-7da172fb-ea06-4515-a591-994a9c6b2d17 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:32.092353 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 538/1067] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:32.097982 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e8dbf-a350-46b0-a87e-7035585159c2 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:32.108120 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e8dbf-a350-46b0-a87e-7035585159c2 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:32.112842 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581a0cf-1433-44c2-8bce-1d55cbd7fed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:32.113482 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581a0cf-1433-44c2-8bce-1d55cbd7fed1 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:32.113769 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581a0cf-1433-44c2-8bce-1d55cbd7fed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:32.114040 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581a0cf-1433-44c2-8bce-1d55cbd7fed1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:32.114780 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581a0cf-1433-44c2-8bce-1d55cbd7fed1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:32.115067 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581a0cf-1433-44c2-8bce-1d55cbd7fed1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:32.116685 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581a0cf-1433-44c2-8bce-1d55cbd7fed1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:32.128130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 530/1068] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:32.133598 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da172fb-ea06-4515-a591-994a9c6b2d17 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:32.142940 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da172fb-ea06-4515-a591-994a9c6b2d17 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:32.147995 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c12538-5486-4b58-a7d3-86ae71b1f25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:32.148743 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c12538-5486-4b58-a7d3-86ae71b1f25d admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:32.149023 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c12538-5486-4b58-a7d3-86ae71b1f25d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:32.149293 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c12538-5486-4b58-a7d3-86ae71b1f25d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:32.156306 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c12538-5486-4b58-a7d3-86ae71b1f25d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:32.158261 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c12538-5486-4b58-a7d3-86ae71b1f25d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:32.172178 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-10c12538-5486-4b58-a7d3-86ae71b1f25d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 23:04:32.173304 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 539/1069] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Feb 10 23:04:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:32.179083 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581a0cf-1433-44c2-8bce-1d55cbd7fed1 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:32.188593 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581a0cf-1433-44c2-8bce-1d55cbd7fed1 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:32.192950 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac209cdc-8115-4590-b2cb-c8a4ced79031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:32.193602 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac209cdc-8115-4590-b2cb-c8a4ced79031 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:32.193899 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac209cdc-8115-4590-b2cb-c8a4ced79031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:32.194160 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac209cdc-8115-4590-b2cb-c8a4ced79031 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:32.194997 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac209cdc-8115-4590-b2cb-c8a4ced79031 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:32.195304 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac209cdc-8115-4590-b2cb-c8a4ced79031 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:32.197144 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac209cdc-8115-4590-b2cb-c8a4ced79031 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:32.214291 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 531/1070] 10.222.0.77 () {56 vars in 1154 bytes} [Thu Feb 10 23:04:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:32.219564 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c12538-5486-4b58-a7d3-86ae71b1f25d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:32.229671 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c12538-5486-4b58-a7d3-86ae71b1f25d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:32.234125 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd585628-1af3-48fe-a32f-6f8c60ff2de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:32.234878 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd585628-1af3-48fe-a32f-6f8c60ff2de2 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:32.235165 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd585628-1af3-48fe-a32f-6f8c60ff2de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:32.235438 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd585628-1af3-48fe-a32f-6f8c60ff2de2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:32.245916 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd585628-1af3-48fe-a32f-6f8c60ff2de2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:32.247709 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd585628-1af3-48fe-a32f-6f8c60ff2de2 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:32.264076 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-fd585628-1af3-48fe-a32f-6f8c60ff2de2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:32.265200 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 540/1071] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:04:32.271458 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac209cdc-8115-4590-b2cb-c8a4ced79031 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:32.280885 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac209cdc-8115-4590-b2cb-c8a4ced79031 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:32.286496 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec5ea6-886b-4cfd-9c6b-8342c0c73ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:32.287146 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec5ea6-886b-4cfd-9c6b-8342c0c73ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:32.287430 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec5ea6-886b-4cfd-9c6b-8342c0c73ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:32.287713 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec5ea6-886b-4cfd-9c6b-8342c0c73ea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:32.288484 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec5ea6-886b-4cfd-9c6b-8342c0c73ea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:32.288790 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec5ea6-886b-4cfd-9c6b-8342c0c73ea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:32.290374 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec5ea6-886b-4cfd-9c6b-8342c0c73ea0 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:32.301437 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 532/1072] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:32.306988 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd585628-1af3-48fe-a32f-6f8c60ff2de2 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:32.316415 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd585628-1af3-48fe-a32f-6f8c60ff2de2 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:32.321530 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e34f1a-f2de-4535-9808-b4553bda9023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:32.322294 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e34f1a-f2de-4535-9808-b4553bda9023 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:32.322581 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e34f1a-f2de-4535-9808-b4553bda9023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:32.322855 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e34f1a-f2de-4535-9808-b4553bda9023 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:32.329618 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e34f1a-f2de-4535-9808-b4553bda9023 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:32.331560 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e34f1a-f2de-4535-9808-b4553bda9023 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:32.344892 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-80e34f1a-f2de-4535-9808-b4553bda9023 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:04:32.346200 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 541/1073] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:04:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:32.351905 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec5ea6-886b-4cfd-9c6b-8342c0c73ea0 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:32.361673 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec5ea6-886b-4cfd-9c6b-8342c0c73ea0 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:32.366162 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1d9ca-1074-416c-a9ed-12e91b26f8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:32.366865 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1d9ca-1074-416c-a9ed-12e91b26f8af admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:32.367211 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1d9ca-1074-416c-a9ed-12e91b26f8af admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:32.367550 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1d9ca-1074-416c-a9ed-12e91b26f8af admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:32.368432 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1d9ca-1074-416c-a9ed-12e91b26f8af admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:32.368739 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1d9ca-1074-416c-a9ed-12e91b26f8af admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:32.370544 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1d9ca-1074-416c-a9ed-12e91b26f8af admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:32.382797 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 533/1074] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:04:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:32.388753 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e34f1a-f2de-4535-9808-b4553bda9023 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:32.399585 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e34f1a-f2de-4535-9808-b4553bda9023 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:32.404065 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc13cb-905d-41d7-8a56-985dd162e6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:32.404915 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc13cb-905d-41d7-8a56-985dd162e6ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:32.405195 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc13cb-905d-41d7-8a56-985dd162e6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:32.405463 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc13cb-905d-41d7-8a56-985dd162e6ae admin admin] PATH_INFO: `/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/551da2c9fab74cb8b14287a5634adb25/roles/ba41bad22bbb402082f3c8d0b387644b` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:32.407628 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc13cb-905d-41d7-8a56-985dd162e6ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ab195cc240497c9ac12843d738c4b9, user_id=551da2c9fab74cb8b14287a5634adb25, role_id=ba41bad22bbb402082f3c8d0b387644b)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:32.410273 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc13cb-905d-41d7-8a56-985dd162e6ae admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:32.423392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 542/1075] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:04:32 2022] PUT /identity/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/551da2c9fab74cb8b14287a5634adb25/roles/ba41bad22bbb402082f3c8d0b387644b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:04:33.932715 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c1d28-7b3c-4efe-8690-a9ad402131a2 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:33.933238 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c1d28-7b3c-4efe-8690-a9ad402131a2 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:33.933238 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c1d28-7b3c-4efe-8690-a9ad402131a2 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:33.935018 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 534/1076] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:33.940406 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16712f0-b6ea-4479-8827-1b0b80acd248 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:33.940834 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16712f0-b6ea-4479-8827-1b0b80acd248 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:33.940949 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16712f0-b6ea-4479-8827-1b0b80acd248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:33.959229 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-b16712f0-b6ea-4479-8827-1b0b80acd248 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:33.960407 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-b16712f0-b6ea-4479-8827-1b0b80acd248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:34.014748 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 543/1077] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:04:34.038121 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c1d28-7b3c-4efe-8690-a9ad402131a2 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:34.049956 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c1d28-7b3c-4efe-8690-a9ad402131a2 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:34.054344 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2781a2-b908-47f7-90b9-e4f7578a92fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:34.055109 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2781a2-b908-47f7-90b9-e4f7578a92fd admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:34.055384 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2781a2-b908-47f7-90b9-e4f7578a92fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:34.055650 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2781a2-b908-47f7-90b9-e4f7578a92fd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:34.065578 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2781a2-b908-47f7-90b9-e4f7578a92fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:04:34.072999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-8d2781a2-b908-47f7-90b9-e4f7578a92fd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:04:34.074304 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 535/1078] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:04:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:34.080234 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16712f0-b6ea-4479-8827-1b0b80acd248 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:34.090063 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16712f0-b6ea-4479-8827-1b0b80acd248 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:34.094516 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100cff8-cb06-4f57-8950-ab49eb8fa7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:34.095167 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100cff8-cb06-4f57-8950-ab49eb8fa7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:34.095450 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100cff8-cb06-4f57-8950-ab49eb8fa7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:34.095724 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100cff8-cb06-4f57-8950-ab49eb8fa7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:34.096517 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100cff8-cb06-4f57-8950-ab49eb8fa7a0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:34.096819 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100cff8-cb06-4f57-8950-ab49eb8fa7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:34.098620 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100cff8-cb06-4f57-8950-ab49eb8fa7a0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:34.106995 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 544/1079] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:04:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:34.113203 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2781a2-b908-47f7-90b9-e4f7578a92fd admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:34.123292 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2781a2-b908-47f7-90b9-e4f7578a92fd admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:34.127663 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6f25f-7348-430b-8b0c-85654349e64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:34.128533 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6f25f-7348-430b-8b0c-85654349e64e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:34.128811 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6f25f-7348-430b-8b0c-85654349e64e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:34.129078 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6f25f-7348-430b-8b0c-85654349e64e admin admin] PATH_INFO: `/v3/users/c84582011ae04ce8a4d242e04607f089` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:34.130970 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6f25f-7348-430b-8b0c-85654349e64e admin admin] RBAC: Authorizing `identity:get_user(user_id=c84582011ae04ce8a4d242e04607f089)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:34.133083 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6f25f-7348-430b-8b0c-85654349e64e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:34.134658 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 536/1080] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:04:34 2022] GET /identity/v3/users/c84582011ae04ce8a4d242e04607f089 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:34.140185 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100cff8-cb06-4f57-8950-ab49eb8fa7a0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:34.150544 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100cff8-cb06-4f57-8950-ab49eb8fa7a0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:34.155000 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0e9d6-3e22-49e7-86f0-0a3478adf240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:34.155843 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0e9d6-3e22-49e7-86f0-0a3478adf240 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:34.156152 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0e9d6-3e22-49e7-86f0-0a3478adf240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:34.156423 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0e9d6-3e22-49e7-86f0-0a3478adf240 admin admin] PATH_INFO: `/v3/projects/172b47f468a049aba6a489593275f122` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:34.157593 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0e9d6-3e22-49e7-86f0-0a3478adf240 admin admin] RBAC: Authorizing `identity:get_project(project_id=172b47f468a049aba6a489593275f122)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:34.159620 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0e9d6-3e22-49e7-86f0-0a3478adf240 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:34.165729 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 545/1081] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:04:34 2022] GET /identity/v3/projects/172b47f468a049aba6a489593275f122 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:34.167088 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6f25f-7348-430b-8b0c-85654349e64e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:34.177260 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6f25f-7348-430b-8b0c-85654349e64e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:34.181672 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7893084-5e85-488a-8b11-189ec5a9f089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:34.182531 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7893084-5e85-488a-8b11-189ec5a9f089 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:34.182857 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7893084-5e85-488a-8b11-189ec5a9f089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:34.183079 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7893084-5e85-488a-8b11-189ec5a9f089 admin admin] PATH_INFO: `/v3/projects/172b47f468a049aba6a489593275f122/users/c84582011ae04ce8a4d242e04607f089/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:34.184987 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7893084-5e85-488a-8b11-189ec5a9f089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=172b47f468a049aba6a489593275f122, user_id=c84582011ae04ce8a4d242e04607f089, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:34.187572 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7893084-5e85-488a-8b11-189ec5a9f089 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:34.201667 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 537/1082] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:04:34 2022] PUT /identity/v3/projects/172b47f468a049aba6a489593275f122/users/c84582011ae04ce8a4d242e04607f089/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:04:34.621476 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c024aa-71e1-4904-8722-7759c9501536 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:34.621765 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c024aa-71e1-4904-8722-7759c9501536 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:34.622123 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c024aa-71e1-4904-8722-7759c9501536 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:34.623920 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 546/1083] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:34.629184 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a759f-10a8-4b39-a669-4b9df3d89bdd None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:34.629500 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a759f-10a8-4b39-a669-4b9df3d89bdd None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:34.629773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a759f-10a8-4b39-a669-4b9df3d89bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:34.646922 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-aa1a759f-10a8-4b39-a669-4b9df3d89bdd None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:34.648119 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-aa1a759f-10a8-4b39-a669-4b9df3d89bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:34.704325 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 538/1084] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:34 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:34.728329 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c024aa-71e1-4904-8722-7759c9501536 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:34.740543 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c024aa-71e1-4904-8722-7759c9501536 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:34.744852 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285976d-7a7d-40b8-917f-db976b24aba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:34.745631 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285976d-7a7d-40b8-917f-db976b24aba4 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:34.745915 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285976d-7a7d-40b8-917f-db976b24aba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:34.746188 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285976d-7a7d-40b8-917f-db976b24aba4 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:34.756874 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285976d-7a7d-40b8-917f-db976b24aba4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:04:34.764048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-f285976d-7a7d-40b8-917f-db976b24aba4 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 10 23:04:34.765181 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 547/1085] 10.222.0.77 () {56 vars in 1141 bytes} [Thu Feb 10 23:04:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:04:34.771537 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a759f-10a8-4b39-a669-4b9df3d89bdd None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:34.780424 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a759f-10a8-4b39-a669-4b9df3d89bdd None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:34.784893 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c235911-3cab-4e2d-b918-e82737435222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:34.785548 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c235911-3cab-4e2d-b918-e82737435222 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:34.785952 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c235911-3cab-4e2d-b918-e82737435222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:34.786337 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c235911-3cab-4e2d-b918-e82737435222 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:34.787104 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c235911-3cab-4e2d-b918-e82737435222 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:34.787406 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c235911-3cab-4e2d-b918-e82737435222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:34.789021 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c235911-3cab-4e2d-b918-e82737435222 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:34.796938 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 539/1086] 10.222.0.77 () {56 vars in 1136 bytes} [Thu Feb 10 23:04:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:34.802267 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285976d-7a7d-40b8-917f-db976b24aba4 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:34.812164 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285976d-7a7d-40b8-917f-db976b24aba4 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:34.816531 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ad2ef-a79d-4bde-a976-36f37cb8b3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:34.817780 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ad2ef-a79d-4bde-a976-36f37cb8b3bf admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:34.818057 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ad2ef-a79d-4bde-a976-36f37cb8b3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:34.818325 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ad2ef-a79d-4bde-a976-36f37cb8b3bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:34.828207 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ad2ef-a79d-4bde-a976-36f37cb8b3bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:34.830032 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ad2ef-a79d-4bde-a976-36f37cb8b3bf admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:34.846656 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-810ad2ef-a79d-4bde-a976-36f37cb8b3bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:34.847804 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 548/1087] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:04:34.854365 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c235911-3cab-4e2d-b918-e82737435222 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:34.864856 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c235911-3cab-4e2d-b918-e82737435222 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:34.869289 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b65ba-63f3-48cb-8f28-e53fb1f53e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:34.869939 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b65ba-63f3-48cb-8f28-e53fb1f53e76 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:34.870229 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b65ba-63f3-48cb-8f28-e53fb1f53e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:34.870506 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b65ba-63f3-48cb-8f28-e53fb1f53e76 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:34.871233 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b65ba-63f3-48cb-8f28-e53fb1f53e76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:34.871585 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b65ba-63f3-48cb-8f28-e53fb1f53e76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:34.873144 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b65ba-63f3-48cb-8f28-e53fb1f53e76 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:34.884925 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 540/1088] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:34.890349 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ad2ef-a79d-4bde-a976-36f37cb8b3bf admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:34.899971 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ad2ef-a79d-4bde-a976-36f37cb8b3bf admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:34.904521 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb994f4-f5cd-4e1d-a5ab-09dbb7747c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:34.905279 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb994f4-f5cd-4e1d-a5ab-09dbb7747c9c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:34.905560 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb994f4-f5cd-4e1d-a5ab-09dbb7747c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:34.905834 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb994f4-f5cd-4e1d-a5ab-09dbb7747c9c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:34.913573 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb994f4-f5cd-4e1d-a5ab-09dbb7747c9c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:34.915549 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb994f4-f5cd-4e1d-a5ab-09dbb7747c9c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:34.929275 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-1bb994f4-f5cd-4e1d-a5ab-09dbb7747c9c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 23:04:34.930411 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 549/1089] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Feb 10 23:04:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:04:34.936110 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b65ba-63f3-48cb-8f28-e53fb1f53e76 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:34.945834 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b65ba-63f3-48cb-8f28-e53fb1f53e76 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:34.950329 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7910ba-2050-4812-b5a9-5f43ff9fbe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:34.950978 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7910ba-2050-4812-b5a9-5f43ff9fbe40 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:34.951260 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7910ba-2050-4812-b5a9-5f43ff9fbe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:34.951532 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7910ba-2050-4812-b5a9-5f43ff9fbe40 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:34.952396 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7910ba-2050-4812-b5a9-5f43ff9fbe40 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:34.952701 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7910ba-2050-4812-b5a9-5f43ff9fbe40 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:34.954541 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7910ba-2050-4812-b5a9-5f43ff9fbe40 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:34.971913 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 541/1090] 10.222.0.77 () {56 vars in 1154 bytes} [Thu Feb 10 23:04:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:34.978133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb994f4-f5cd-4e1d-a5ab-09dbb7747c9c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:34.987939 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb994f4-f5cd-4e1d-a5ab-09dbb7747c9c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:34.992515 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2040c-e980-4466-bd22-812998350a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:34.993137 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2040c-e980-4466-bd22-812998350a32 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:34.993414 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2040c-e980-4466-bd22-812998350a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:34.993682 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2040c-e980-4466-bd22-812998350a32 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:35.001276 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2040c-e980-4466-bd22-812998350a32 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:35.002982 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2040c-e980-4466-bd22-812998350a32 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:35.011648 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 550/1091] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:04:34 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:04:35.017410 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7910ba-2050-4812-b5a9-5f43ff9fbe40 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:35.027455 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7910ba-2050-4812-b5a9-5f43ff9fbe40 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:35.031908 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13cbc3-4671-437e-95aa-8da9984600f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:35.032674 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13cbc3-4671-437e-95aa-8da9984600f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:35.032956 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13cbc3-4671-437e-95aa-8da9984600f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:35.033225 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13cbc3-4671-437e-95aa-8da9984600f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:35.043715 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13cbc3-4671-437e-95aa-8da9984600f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:35.045566 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13cbc3-4671-437e-95aa-8da9984600f4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:35.061809 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-cb13cbc3-4671-437e-95aa-8da9984600f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:04:35.063096 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 542/1092] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:35.068718 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2040c-e980-4466-bd22-812998350a32 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:35.077657 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2040c-e980-4466-bd22-812998350a32 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:35.082289 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb64ff-8ee7-49dc-8a1b-4a641c707872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:35.083960 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb64ff-8ee7-49dc-8a1b-4a641c707872 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:35.084466 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb64ff-8ee7-49dc-8a1b-4a641c707872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:35.084958 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb64ff-8ee7-49dc-8a1b-4a641c707872 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:35.086254 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb64ff-8ee7-49dc-8a1b-4a641c707872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:35.086799 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb64ff-8ee7-49dc-8a1b-4a641c707872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:35.088743 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb64ff-8ee7-49dc-8a1b-4a641c707872 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:35.101089 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 551/1093] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:35.106542 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13cbc3-4671-437e-95aa-8da9984600f4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:35.116396 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13cbc3-4671-437e-95aa-8da9984600f4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:35.120784 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1a2da-8a47-4b2d-86c4-33a5156f5f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:35.121550 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1a2da-8a47-4b2d-86c4-33a5156f5f16 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:35.121874 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1a2da-8a47-4b2d-86c4-33a5156f5f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:35.122096 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1a2da-8a47-4b2d-86c4-33a5156f5f16 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:35.128770 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1a2da-8a47-4b2d-86c4-33a5156f5f16 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:35.130685 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1a2da-8a47-4b2d-86c4-33a5156f5f16 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:35.143697 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-15f1a2da-8a47-4b2d-86c4-33a5156f5f16 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:04:35.144840 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 543/1094] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:04:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:35.151052 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb64ff-8ee7-49dc-8a1b-4a641c707872 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:35.161471 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb64ff-8ee7-49dc-8a1b-4a641c707872 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:35.166031 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae8fa8c-2757-44b7-b936-d84632aaa251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:35.166742 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8fa8c-2757-44b7-b936-d84632aaa251 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:35.167094 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8fa8c-2757-44b7-b936-d84632aaa251 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:35.167439 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8fa8c-2757-44b7-b936-d84632aaa251 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:35.168337 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae8fa8c-2757-44b7-b936-d84632aaa251 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:35.168715 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae8fa8c-2757-44b7-b936-d84632aaa251 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:35.170593 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae8fa8c-2757-44b7-b936-d84632aaa251 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:35.183321 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 552/1095] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:04:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:35.189120 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1a2da-8a47-4b2d-86c4-33a5156f5f16 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:35.199254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1a2da-8a47-4b2d-86c4-33a5156f5f16 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:35.203696 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a0f05-715a-4211-8635-9e43c8b6619a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:35.204360 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a0f05-715a-4211-8635-9e43c8b6619a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:35.204645 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a0f05-715a-4211-8635-9e43c8b6619a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:35.204922 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a0f05-715a-4211-8635-9e43c8b6619a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:35.205758 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a0f05-715a-4211-8635-9e43c8b6619a admin admin] RBAC: Adding query filter params (role.id=ba41bad22bbb402082f3c8d0b387644b, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=551da2c9fab74cb8b14287a5634adb25) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:35.206070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a0f05-715a-4211-8635-9e43c8b6619a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:35.207936 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a0f05-715a-4211-8635-9e43c8b6619a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:35.223847 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 544/1096] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:04:35 2022] GET /identity/v3/role_assignments?user.id=551da2c9fab74cb8b14287a5634adb25&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=ba41bad22bbb402082f3c8d0b387644b => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:36.402799 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcdafa-6e74-40ff-9c61-0a439d3a4400 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:36.403344 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcdafa-6e74-40ff-9c61-0a439d3a4400 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:36.403344 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcdafa-6e74-40ff-9c61-0a439d3a4400 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:36.405134 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 553/1097] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:36.410412 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08a222-90aa-4b19-a1b4-9040af520cd7 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:36.410937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08a222-90aa-4b19-a1b4-9040af520cd7 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:36.411226 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08a222-90aa-4b19-a1b4-9040af520cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:36.429162 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-bd08a222-90aa-4b19-a1b4-9040af520cd7 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:36.430344 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-bd08a222-90aa-4b19-a1b4-9040af520cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:36.438008 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 545/1098] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:36 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:36.462556 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcdafa-6e74-40ff-9c61-0a439d3a4400 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:36.475019 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcdafa-6e74-40ff-9c61-0a439d3a4400 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:36.479237 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03baa6b-b41b-43cc-a6aa-5df6007242b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:36.480015 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03baa6b-b41b-43cc-a6aa-5df6007242b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:36.480295 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03baa6b-b41b-43cc-a6aa-5df6007242b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:36.480568 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03baa6b-b41b-43cc-a6aa-5df6007242b0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:36.490566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03baa6b-b41b-43cc-a6aa-5df6007242b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:04:36.497176 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-f03baa6b-b41b-43cc-a6aa-5df6007242b0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:04:36.498277 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 554/1099] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:04:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:36.503769 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08a222-90aa-4b19-a1b4-9040af520cd7 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:36.512562 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08a222-90aa-4b19-a1b4-9040af520cd7 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:36.517034 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98ecc8-7fbd-4c4e-b9f2-32672b7a8dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:36.517672 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98ecc8-7fbd-4c4e-b9f2-32672b7a8dee admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:36.517957 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98ecc8-7fbd-4c4e-b9f2-32672b7a8dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:36.518233 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98ecc8-7fbd-4c4e-b9f2-32672b7a8dee admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:36.518983 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98ecc8-7fbd-4c4e-b9f2-32672b7a8dee admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:36.519289 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98ecc8-7fbd-4c4e-b9f2-32672b7a8dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:36.521491 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98ecc8-7fbd-4c4e-b9f2-32672b7a8dee admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:36.529513 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 546/1100] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:04:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:36.534782 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03baa6b-b41b-43cc-a6aa-5df6007242b0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:36.545487 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03baa6b-b41b-43cc-a6aa-5df6007242b0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:36.549921 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4eabb-f53b-483b-b0aa-ccafdd9a862a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:36.550739 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4eabb-f53b-483b-b0aa-ccafdd9a862a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:36.551021 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4eabb-f53b-483b-b0aa-ccafdd9a862a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:36.551348 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4eabb-f53b-483b-b0aa-ccafdd9a862a admin admin] PATH_INFO: `/v3/users/c84582011ae04ce8a4d242e04607f089` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:36.552742 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4eabb-f53b-483b-b0aa-ccafdd9a862a admin admin] RBAC: Authorizing `identity:get_user(user_id=c84582011ae04ce8a4d242e04607f089)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:36.554806 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4eabb-f53b-483b-b0aa-ccafdd9a862a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:36.556365 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 555/1101] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:04:36 2022] GET /identity/v3/users/c84582011ae04ce8a4d242e04607f089 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:36.561440 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98ecc8-7fbd-4c4e-b9f2-32672b7a8dee admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:36.570940 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98ecc8-7fbd-4c4e-b9f2-32672b7a8dee admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:36.575359 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762ffb3-baa5-481b-86ef-2f65f72255cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:36.576011 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762ffb3-baa5-481b-86ef-2f65f72255cc admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:36.576299 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762ffb3-baa5-481b-86ef-2f65f72255cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:36.576577 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762ffb3-baa5-481b-86ef-2f65f72255cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:36.584684 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762ffb3-baa5-481b-86ef-2f65f72255cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:36.586382 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762ffb3-baa5-481b-86ef-2f65f72255cc admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:36.594967 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 547/1102] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:04:36 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:04:36.600907 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4eabb-f53b-483b-b0aa-ccafdd9a862a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:36.610035 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4eabb-f53b-483b-b0aa-ccafdd9a862a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:36.614886 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598246c2-c161-4937-8261-1c42cfc582d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:36.615686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598246c2-c161-4937-8261-1c42cfc582d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:36.616019 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598246c2-c161-4937-8261-1c42cfc582d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:36.616292 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598246c2-c161-4937-8261-1c42cfc582d6 admin admin] PATH_INFO: `/v3/projects/172b47f468a049aba6a489593275f122` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:36.617431 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598246c2-c161-4937-8261-1c42cfc582d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=172b47f468a049aba6a489593275f122)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:36.619389 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598246c2-c161-4937-8261-1c42cfc582d6 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:36.621039 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 556/1103] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:04:36 2022] GET /identity/v3/projects/172b47f468a049aba6a489593275f122 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:36.626393 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762ffb3-baa5-481b-86ef-2f65f72255cc admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:36.634837 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762ffb3-baa5-481b-86ef-2f65f72255cc admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:36.639310 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c78f95-a791-462d-b24f-51b1e94d720e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:36.639950 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c78f95-a791-462d-b24f-51b1e94d720e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:36.640235 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c78f95-a791-462d-b24f-51b1e94d720e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:36.640509 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c78f95-a791-462d-b24f-51b1e94d720e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:36.641324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c78f95-a791-462d-b24f-51b1e94d720e admin admin] RBAC: Adding query filter params (role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f, scope.project.id=172b47f468a049aba6a489593275f122, user.id=c84582011ae04ce8a4d242e04607f089) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:36.641635 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c78f95-a791-462d-b24f-51b1e94d720e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:36.643406 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c78f95-a791-462d-b24f-51b1e94d720e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:36.649677 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 548/1104] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:04:36 2022] GET /identity/v3/role_assignments?user.id=c84582011ae04ce8a4d242e04607f089&scope.project.id=172b47f468a049aba6a489593275f122&role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:38.865711 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa285bf-b237-4049-a0a6-edf0362b5207 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:38.866344 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa285bf-b237-4049-a0a6-edf0362b5207 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:38.866344 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa285bf-b237-4049-a0a6-edf0362b5207 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:38.868026 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 557/1105] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:38.873300 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11282f7-3060-48f6-a148-3645e1237c34 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:38.873739 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11282f7-3060-48f6-a148-3645e1237c34 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:38.873863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11282f7-3060-48f6-a148-3645e1237c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:38.892759 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-d11282f7-3060-48f6-a148-3645e1237c34 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:38.893936 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-d11282f7-3060-48f6-a148-3645e1237c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:38.901632 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 549/1106] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:38.926587 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa285bf-b237-4049-a0a6-edf0362b5207 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:38.938375 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa285bf-b237-4049-a0a6-edf0362b5207 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:38.943386 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd421d-6eb3-4b80-8acb-fc77707d99bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:38.944160 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd421d-6eb3-4b80-8acb-fc77707d99bd admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:38.944440 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd421d-6eb3-4b80-8acb-fc77707d99bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:38.944717 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd421d-6eb3-4b80-8acb-fc77707d99bd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:38.945860 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd421d-6eb3-4b80-8acb-fc77707d99bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:38.947495 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd421d-6eb3-4b80-8acb-fc77707d99bd admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:38.949037 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 558/1107] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:38.954205 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11282f7-3060-48f6-a148-3645e1237c34 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:38.962869 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11282f7-3060-48f6-a148-3645e1237c34 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:38.967310 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebeef9-d784-4858-aa5e-bbd9075c166a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:38.967985 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebeef9-d784-4858-aa5e-bbd9075c166a admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:38.968269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebeef9-d784-4858-aa5e-bbd9075c166a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:38.968543 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebeef9-d784-4858-aa5e-bbd9075c166a admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:38.969250 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebeef9-d784-4858-aa5e-bbd9075c166a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:38.971121 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebeef9-d784-4858-aa5e-bbd9075c166a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:38.990521 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 550/1108] 10.222.0.77 () {60 vars in 1153 bytes} [Thu Feb 10 23:04:38 2022] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:04:41.210614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e00f4a-90b3-4d7c-a506-3a8995849729 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:41.211160 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e00f4a-90b3-4d7c-a506-3a8995849729 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:41.211160 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e00f4a-90b3-4d7c-a506-3a8995849729 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:41.212950 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 559/1109] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:41.218282 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c93a0-e755-4da2-af96-b0d8ab694a53 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:41.218669 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c93a0-e755-4da2-af96-b0d8ab694a53 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:41.218838 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c93a0-e755-4da2-af96-b0d8ab694a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:41.236400 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-739c93a0-e755-4da2-af96-b0d8ab694a53 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:41.237903 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-739c93a0-e755-4da2-af96-b0d8ab694a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:41.246112 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 551/1110] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:41 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:41.270132 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e00f4a-90b3-4d7c-a506-3a8995849729 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:41.281951 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e00f4a-90b3-4d7c-a506-3a8995849729 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:41.286452 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571260b6-85a9-4e69-8b89-a498bf92bfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:41.287263 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571260b6-85a9-4e69-8b89-a498bf92bfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:41.287547 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571260b6-85a9-4e69-8b89-a498bf92bfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:41.287837 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571260b6-85a9-4e69-8b89-a498bf92bfe0 admin admin] PATH_INFO: `/v3/roles/7f727831e261404999a27a5a15b515b1` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:41.289296 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571260b6-85a9-4e69-8b89-a498bf92bfe0 admin admin] RBAC: Authorizing `identity:get_role(role_id=7f727831e261404999a27a5a15b515b1)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:41.290299 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING py.warnings [None req-571260b6-85a9-4e69-8b89-a498bf92bfe0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:04:41.290299 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: warnings.warn(msg) Feb 10 23:04:41.290299 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: Feb 10 23:04:41.291191 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571260b6-85a9-4e69-8b89-a498bf92bfe0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:41.292522 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 560/1111] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:04:41 2022] GET /identity/v3/roles/7f727831e261404999a27a5a15b515b1 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:41.297877 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c93a0-e755-4da2-af96-b0d8ab694a53 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:41.307290 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c93a0-e755-4da2-af96-b0d8ab694a53 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:41.311727 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c6b0a-5a87-4db9-ac8a-c4adebe31d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:41.312602 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c6b0a-5a87-4db9-ac8a-c4adebe31d23 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:41.312883 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c6b0a-5a87-4db9-ac8a-c4adebe31d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:41.313156 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c6b0a-5a87-4db9-ac8a-c4adebe31d23 admin admin] PATH_INFO: `/v3/users/313e31c82cb4418180b67ff8c4ab4a32` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:41.326746 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c6b0a-5a87-4db9-ac8a-c4adebe31d23 admin admin] RBAC: Authorizing `identity:get_user(user_id=313e31c82cb4418180b67ff8c4ab4a32)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:41.328888 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c6b0a-5a87-4db9-ac8a-c4adebe31d23 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:41.330509 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 552/1112] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:04:41 2022] GET /identity/v3/users/313e31c82cb4418180b67ff8c4ab4a32 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:41.335997 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571260b6-85a9-4e69-8b89-a498bf92bfe0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:41.345599 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571260b6-85a9-4e69-8b89-a498bf92bfe0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:41.350539 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b422528-8de9-4293-a787-6983650bbcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:41.351150 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b422528-8de9-4293-a787-6983650bbcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:41.351440 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b422528-8de9-4293-a787-6983650bbcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:41.351751 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b422528-8de9-4293-a787-6983650bbcd7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:41.359216 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b422528-8de9-4293-a787-6983650bbcd7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:41.360933 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b422528-8de9-4293-a787-6983650bbcd7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:41.370214 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 561/1113] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:04:41 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:04:41.375549 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c6b0a-5a87-4db9-ac8a-c4adebe31d23 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:41.385081 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c6b0a-5a87-4db9-ac8a-c4adebe31d23 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:41.389517 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fbbb1-f161-4f91-ba59-e6280f7a628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:41.390327 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fbbb1-f161-4f91-ba59-e6280f7a628c admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:41.390608 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fbbb1-f161-4f91-ba59-e6280f7a628c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:41.390880 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fbbb1-f161-4f91-ba59-e6280f7a628c admin admin] PATH_INFO: `/v3/projects/172b47f468a049aba6a489593275f122` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:41.392070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9fbbb1-f161-4f91-ba59-e6280f7a628c admin admin] RBAC: Authorizing `identity:get_project(project_id=172b47f468a049aba6a489593275f122)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:41.394043 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9fbbb1-f161-4f91-ba59-e6280f7a628c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:41.395943 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 553/1114] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:04:41 2022] GET /identity/v3/projects/172b47f468a049aba6a489593275f122 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:41.401483 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b422528-8de9-4293-a787-6983650bbcd7 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:41.409948 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b422528-8de9-4293-a787-6983650bbcd7 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:41.415118 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcd7c3-854a-44ba-b7f3-1f9aa3d5b331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:41.415732 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcd7c3-854a-44ba-b7f3-1f9aa3d5b331 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:41.416044 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcd7c3-854a-44ba-b7f3-1f9aa3d5b331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:41.416322 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcd7c3-854a-44ba-b7f3-1f9aa3d5b331 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:41.417145 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bcd7c3-854a-44ba-b7f3-1f9aa3d5b331 admin admin] RBAC: Adding query filter params (role.id=7f727831e261404999a27a5a15b515b1, scope.project.id=172b47f468a049aba6a489593275f122, user.id=313e31c82cb4418180b67ff8c4ab4a32) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:41.417457 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bcd7c3-854a-44ba-b7f3-1f9aa3d5b331 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:41.419236 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bcd7c3-854a-44ba-b7f3-1f9aa3d5b331 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:41.424609 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 562/1115] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:04:41 2022] GET /identity/v3/role_assignments?user.id=313e31c82cb4418180b67ff8c4ab4a32&scope.project.id=172b47f468a049aba6a489593275f122&role.id=7f727831e261404999a27a5a15b515b1 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:43.576581 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a2848-dfcd-44d5-9de8-3f1d63d5dc98 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:43.577142 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a2848-dfcd-44d5-9de8-3f1d63d5dc98 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:43.577142 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a2848-dfcd-44d5-9de8-3f1d63d5dc98 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:43.578872 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 554/1116] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:43.585017 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe028087-be7f-4ec7-9b03-a8064a045690 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:43.585423 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe028087-be7f-4ec7-9b03-a8064a045690 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:43.585574 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe028087-be7f-4ec7-9b03-a8064a045690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:43.602990 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-fe028087-be7f-4ec7-9b03-a8064a045690 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:43.604194 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-fe028087-be7f-4ec7-9b03-a8064a045690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:43.611907 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 563/1117] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:43 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:43.634885 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a2848-dfcd-44d5-9de8-3f1d63d5dc98 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:43.647234 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a2848-dfcd-44d5-9de8-3f1d63d5dc98 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:43.651670 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407da56-eedd-44f0-bb36-c1f2ffeee4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:43.652533 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407da56-eedd-44f0-bb36-c1f2ffeee4ad admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:43.652816 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407da56-eedd-44f0-bb36-c1f2ffeee4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:43.653091 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407da56-eedd-44f0-bb36-c1f2ffeee4ad admin admin] PATH_INFO: `/v3/roles/7f727831e261404999a27a5a15b515b1` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:43.654543 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407da56-eedd-44f0-bb36-c1f2ffeee4ad admin admin] RBAC: Authorizing `identity:get_role(role_id=7f727831e261404999a27a5a15b515b1)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:43.655540 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING py.warnings [None req-9407da56-eedd-44f0-bb36-c1f2ffeee4ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:04:43.655540 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: warnings.warn(msg) Feb 10 23:04:43.655540 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: Feb 10 23:04:43.656442 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407da56-eedd-44f0-bb36-c1f2ffeee4ad admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:43.657728 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 555/1118] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:04:43 2022] GET /identity/v3/roles/7f727831e261404999a27a5a15b515b1 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:43.663224 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe028087-be7f-4ec7-9b03-a8064a045690 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:43.671724 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe028087-be7f-4ec7-9b03-a8064a045690 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:43.676280 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58426a-6cc0-4ed4-858d-1e9a3012a9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:43.677280 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58426a-6cc0-4ed4-858d-1e9a3012a9af admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:43.677585 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58426a-6cc0-4ed4-858d-1e9a3012a9af admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:43.677859 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58426a-6cc0-4ed4-858d-1e9a3012a9af admin admin] PATH_INFO: `/v3/users/313e31c82cb4418180b67ff8c4ab4a32` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:43.679080 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58426a-6cc0-4ed4-858d-1e9a3012a9af admin admin] RBAC: Authorizing `identity:get_user(user_id=313e31c82cb4418180b67ff8c4ab4a32)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:43.681201 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58426a-6cc0-4ed4-858d-1e9a3012a9af admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:43.682734 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 564/1119] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:04:43 2022] GET /identity/v3/users/313e31c82cb4418180b67ff8c4ab4a32 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:43.687888 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407da56-eedd-44f0-bb36-c1f2ffeee4ad admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:43.697468 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407da56-eedd-44f0-bb36-c1f2ffeee4ad admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:43.701847 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67076e82-7b67-4467-b602-47ad121ee678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:43.702630 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67076e82-7b67-4467-b602-47ad121ee678 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:43.702905 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67076e82-7b67-4467-b602-47ad121ee678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:43.703176 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67076e82-7b67-4467-b602-47ad121ee678 admin admin] PATH_INFO: `/v3/projects/172b47f468a049aba6a489593275f122` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:43.704345 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67076e82-7b67-4467-b602-47ad121ee678 admin admin] RBAC: Authorizing `identity:get_project(project_id=172b47f468a049aba6a489593275f122)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:43.706306 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67076e82-7b67-4467-b602-47ad121ee678 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:43.708589 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 556/1120] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:04:43 2022] GET /identity/v3/projects/172b47f468a049aba6a489593275f122 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:43.713872 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58426a-6cc0-4ed4-858d-1e9a3012a9af admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:43.722962 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58426a-6cc0-4ed4-858d-1e9a3012a9af admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:43.727518 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097985bb-b85a-4394-8b27-aad91bdc474b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:43.728380 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097985bb-b85a-4394-8b27-aad91bdc474b admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:43.728662 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097985bb-b85a-4394-8b27-aad91bdc474b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:43.728937 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097985bb-b85a-4394-8b27-aad91bdc474b admin admin] PATH_INFO: `/v3/projects/172b47f468a049aba6a489593275f122/users/313e31c82cb4418180b67ff8c4ab4a32/roles/7f727831e261404999a27a5a15b515b1` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:43.731127 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097985bb-b85a-4394-8b27-aad91bdc474b admin admin] RBAC: Authorizing `identity:create_grant(project_id=172b47f468a049aba6a489593275f122, user_id=313e31c82cb4418180b67ff8c4ab4a32, role_id=7f727831e261404999a27a5a15b515b1)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:43.733743 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097985bb-b85a-4394-8b27-aad91bdc474b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:43.747159 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 565/1121] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:04:43 2022] PUT /identity/v3/projects/172b47f468a049aba6a489593275f122/users/313e31c82cb4418180b67ff8c4ab4a32/roles/7f727831e261404999a27a5a15b515b1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:04:46.107001 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44a5f2-906c-488d-aa68-c0166f3cbbf2 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:46.107451 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44a5f2-906c-488d-aa68-c0166f3cbbf2 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:46.107540 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44a5f2-906c-488d-aa68-c0166f3cbbf2 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:46.109332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 557/1122] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:46.115046 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41656176-a656-40eb-80c2-4107f28f6011 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:46.115450 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41656176-a656-40eb-80c2-4107f28f6011 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:46.115600 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41656176-a656-40eb-80c2-4107f28f6011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:46.140595 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-41656176-a656-40eb-80c2-4107f28f6011 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:46.141774 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-41656176-a656-40eb-80c2-4107f28f6011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:46.202744 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 566/1123] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:46 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:46.226491 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44a5f2-906c-488d-aa68-c0166f3cbbf2 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:46.239163 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44a5f2-906c-488d-aa68-c0166f3cbbf2 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:46.243504 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67270a-45a0-4054-99e9-038b43c107f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:46.244423 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67270a-45a0-4054-99e9-038b43c107f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:46.244707 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67270a-45a0-4054-99e9-038b43c107f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:46.244983 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67270a-45a0-4054-99e9-038b43c107f0 admin admin] PATH_INFO: `/v3/roles/7f727831e261404999a27a5a15b515b1` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:46.246439 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67270a-45a0-4054-99e9-038b43c107f0 admin admin] RBAC: Authorizing `identity:get_role(role_id=7f727831e261404999a27a5a15b515b1)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:46.248046 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67270a-45a0-4054-99e9-038b43c107f0 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:46.249356 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 558/1124] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:04:46 2022] GET /identity/v3/roles/7f727831e261404999a27a5a15b515b1 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:46.255565 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41656176-a656-40eb-80c2-4107f28f6011 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:46.264356 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41656176-a656-40eb-80c2-4107f28f6011 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:46.268871 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f37f6d-020c-44de-9c54-755b1d1be184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:46.269941 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f37f6d-020c-44de-9c54-755b1d1be184 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:46.270221 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f37f6d-020c-44de-9c54-755b1d1be184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:46.270493 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f37f6d-020c-44de-9c54-755b1d1be184 admin admin] PATH_INFO: `/v3/users/313e31c82cb4418180b67ff8c4ab4a32` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:46.271685 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f37f6d-020c-44de-9c54-755b1d1be184 admin admin] RBAC: Authorizing `identity:get_user(user_id=313e31c82cb4418180b67ff8c4ab4a32)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:46.273823 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f37f6d-020c-44de-9c54-755b1d1be184 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:46.275384 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 567/1125] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:04:46 2022] GET /identity/v3/users/313e31c82cb4418180b67ff8c4ab4a32 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:46.280860 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67270a-45a0-4054-99e9-038b43c107f0 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:46.290237 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67270a-45a0-4054-99e9-038b43c107f0 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:46.294911 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bf18a-a9ff-4712-87cf-9f8c3f008092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:46.295525 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bf18a-a9ff-4712-87cf-9f8c3f008092 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:46.295804 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bf18a-a9ff-4712-87cf-9f8c3f008092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:46.296099 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bf18a-a9ff-4712-87cf-9f8c3f008092 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:46.304119 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bf18a-a9ff-4712-87cf-9f8c3f008092 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:46.305825 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bf18a-a9ff-4712-87cf-9f8c3f008092 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:46.314252 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 559/1126] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:04:46 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:04:46.320580 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f37f6d-020c-44de-9c54-755b1d1be184 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:46.329939 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f37f6d-020c-44de-9c54-755b1d1be184 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:46.334300 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7bc1a-178b-499b-a3c1-5f4e7f0e3959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:46.335155 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7bc1a-178b-499b-a3c1-5f4e7f0e3959 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:46.335463 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7bc1a-178b-499b-a3c1-5f4e7f0e3959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:46.335732 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7bc1a-178b-499b-a3c1-5f4e7f0e3959 admin admin] PATH_INFO: `/v3/projects/172b47f468a049aba6a489593275f122` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:46.336934 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7bc1a-178b-499b-a3c1-5f4e7f0e3959 admin admin] RBAC: Authorizing `identity:get_project(project_id=172b47f468a049aba6a489593275f122)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:46.338978 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7bc1a-178b-499b-a3c1-5f4e7f0e3959 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:46.340638 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 568/1127] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:04:46 2022] GET /identity/v3/projects/172b47f468a049aba6a489593275f122 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:46.346390 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bf18a-a9ff-4712-87cf-9f8c3f008092 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:46.355013 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bf18a-a9ff-4712-87cf-9f8c3f008092 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:46.359413 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73206a7-ccdb-4646-9bea-cd4949d5649c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:46.360076 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73206a7-ccdb-4646-9bea-cd4949d5649c admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:46.360357 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73206a7-ccdb-4646-9bea-cd4949d5649c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:46.360629 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73206a7-ccdb-4646-9bea-cd4949d5649c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:46.361709 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73206a7-ccdb-4646-9bea-cd4949d5649c admin admin] RBAC: Adding query filter params (role.id=7f727831e261404999a27a5a15b515b1, scope.project.id=172b47f468a049aba6a489593275f122, user.id=313e31c82cb4418180b67ff8c4ab4a32) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:46.362016 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73206a7-ccdb-4646-9bea-cd4949d5649c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:46.364643 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73206a7-ccdb-4646-9bea-cd4949d5649c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:46.370153 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 560/1128] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:04:46 2022] GET /identity/v3/role_assignments?user.id=313e31c82cb4418180b67ff8c4ab4a32&scope.project.id=172b47f468a049aba6a489593275f122&role.id=7f727831e261404999a27a5a15b515b1 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:48.610514 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccb62c-eefd-40e7-abd5-7a2d4cddfa25 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:48.611074 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccb62c-eefd-40e7-abd5-7a2d4cddfa25 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:48.611074 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccb62c-eefd-40e7-abd5-7a2d4cddfa25 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:48.613099 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 569/1129] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:48.618373 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dba769-3afd-4e26-b5dd-03fa82ce3379 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:48.618816 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dba769-3afd-4e26-b5dd-03fa82ce3379 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:48.618925 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dba769-3afd-4e26-b5dd-03fa82ce3379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:48.636371 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-59dba769-3afd-4e26-b5dd-03fa82ce3379 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:48.637540 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-59dba769-3afd-4e26-b5dd-03fa82ce3379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:48.645798 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 561/1130] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:48 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:48.669666 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccb62c-eefd-40e7-abd5-7a2d4cddfa25 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:48.681473 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccb62c-eefd-40e7-abd5-7a2d4cddfa25 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:48.685700 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379f171-babc-468d-bf76-c7e5455ddb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:48.686457 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379f171-babc-468d-bf76-c7e5455ddb76 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:48.686735 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379f171-babc-468d-bf76-c7e5455ddb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:48.687005 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379f171-babc-468d-bf76-c7e5455ddb76 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:48.688170 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379f171-babc-468d-bf76-c7e5455ddb76 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:48.689809 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379f171-babc-468d-bf76-c7e5455ddb76 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:48.691323 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 570/1131] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:48.696996 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dba769-3afd-4e26-b5dd-03fa82ce3379 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:48.705637 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dba769-3afd-4e26-b5dd-03fa82ce3379 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:48.710783 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67b6db-3557-4cb1-822a-3c7ea00ea767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:48.711417 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67b6db-3557-4cb1-822a-3c7ea00ea767 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:48.711700 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67b6db-3557-4cb1-822a-3c7ea00ea767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:48.712017 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67b6db-3557-4cb1-822a-3c7ea00ea767 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:48.712738 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67b6db-3557-4cb1-822a-3c7ea00ea767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:48.714592 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67b6db-3557-4cb1-822a-3c7ea00ea767 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:48.739496 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 562/1132] 10.222.0.77 () {60 vars in 1162 bytes} [Thu Feb 10 23:04:48 2022] POST /identity/v3/projects => generated 311 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:04:50.984500 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c4715-d65f-4f6b-9d10-d08b61b5e9c3 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:50.985072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c4715-d65f-4f6b-9d10-d08b61b5e9c3 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:50.985072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c4715-d65f-4f6b-9d10-d08b61b5e9c3 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:50.987028 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 571/1133] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:50.992789 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81798945-a948-47c9-9ba9-a821513d05ad None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:50.993168 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81798945-a948-47c9-9ba9-a821513d05ad None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:50.993339 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81798945-a948-47c9-9ba9-a821513d05ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:51.011483 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-81798945-a948-47c9-9ba9-a821513d05ad None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:51.012676 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-81798945-a948-47c9-9ba9-a821513d05ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:51.068190 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 563/1134] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:50 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:51.093031 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c4715-d65f-4f6b-9d10-d08b61b5e9c3 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:51.105435 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c4715-d65f-4f6b-9d10-d08b61b5e9c3 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:51.109641 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc596271-b8f8-45f7-ba60-c4735d59dfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:51.110398 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc596271-b8f8-45f7-ba60-c4735d59dfac admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:51.110677 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc596271-b8f8-45f7-ba60-c4735d59dfac admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:51.110948 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc596271-b8f8-45f7-ba60-c4735d59dfac admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:51.112376 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc596271-b8f8-45f7-ba60-c4735d59dfac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:51.114652 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc596271-b8f8-45f7-ba60-c4735d59dfac admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:51.116201 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 572/1135] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:04:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:51.121476 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81798945-a948-47c9-9ba9-a821513d05ad None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:51.131003 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81798945-a948-47c9-9ba9-a821513d05ad None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:51.135429 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303226d-fe75-4c34-b642-d506627ac22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:51.136111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303226d-fe75-4c34-b642-d506627ac22f admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:51.136400 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303226d-fe75-4c34-b642-d506627ac22f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:51.136673 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303226d-fe75-4c34-b642-d506627ac22f admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:51.137388 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303226d-fe75-4c34-b642-d506627ac22f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:51.139264 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303226d-fe75-4c34-b642-d506627ac22f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:51.159298 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 564/1136] 10.222.0.77 () {60 vars in 1153 bytes} [Thu Feb 10 23:04:51 2022] POST /identity/v3/users => generated 286 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:04:53.403507 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da03d6-9a9e-4c58-8691-42302cd80641 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:53.404078 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da03d6-9a9e-4c58-8691-42302cd80641 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:53.404078 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da03d6-9a9e-4c58-8691-42302cd80641 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:53.405853 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 573/1137] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:53.411909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ec217-321c-4447-9415-815815a0019e None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:53.412317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ec217-321c-4447-9415-815815a0019e None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:53.412457 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ec217-321c-4447-9415-815815a0019e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:53.430197 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-f64ec217-321c-4447-9415-815815a0019e None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:53.431357 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-f64ec217-321c-4447-9415-815815a0019e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:53.438826 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 565/1138] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:53 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:04:53.462328 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da03d6-9a9e-4c58-8691-42302cd80641 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:53.474752 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da03d6-9a9e-4c58-8691-42302cd80641 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:53.479082 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e36bf6-0973-4b99-9a41-916bb75321d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:53.479871 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e36bf6-0973-4b99-9a41-916bb75321d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:53.480158 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e36bf6-0973-4b99-9a41-916bb75321d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:53.480428 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e36bf6-0973-4b99-9a41-916bb75321d0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:53.491138 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e36bf6-0973-4b99-9a41-916bb75321d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:04:53.497843 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-e1e36bf6-0973-4b99-9a41-916bb75321d0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:04:53.498961 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 574/1139] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:04:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:53.504471 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ec217-321c-4447-9415-815815a0019e None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:53.513000 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ec217-321c-4447-9415-815815a0019e None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:53.517350 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38427c-2611-458b-8026-a52253cd8ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:53.517981 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38427c-2611-458b-8026-a52253cd8ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:53.518257 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38427c-2611-458b-8026-a52253cd8ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:53.518528 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38427c-2611-458b-8026-a52253cd8ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:53.519274 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38427c-2611-458b-8026-a52253cd8ab5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:53.519652 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38427c-2611-458b-8026-a52253cd8ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:53.521286 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38427c-2611-458b-8026-a52253cd8ab5 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:53.529171 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 566/1140] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:04:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:53.534658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e36bf6-0973-4b99-9a41-916bb75321d0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:53.544861 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e36bf6-0973-4b99-9a41-916bb75321d0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:53.549189 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d962b08-05d5-4b2c-9f02-98249614192e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:53.549999 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d962b08-05d5-4b2c-9f02-98249614192e admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:53.550277 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d962b08-05d5-4b2c-9f02-98249614192e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:53.550547 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d962b08-05d5-4b2c-9f02-98249614192e admin admin] PATH_INFO: `/v3/users/c97a41d5ed194354932126e0ed9bfe9a` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:53.563477 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d962b08-05d5-4b2c-9f02-98249614192e admin admin] RBAC: Authorizing `identity:get_user(user_id=c97a41d5ed194354932126e0ed9bfe9a)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:53.565634 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d962b08-05d5-4b2c-9f02-98249614192e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:53.567970 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 575/1141] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:04:53 2022] GET /identity/v3/users/c97a41d5ed194354932126e0ed9bfe9a => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:53.573307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38427c-2611-458b-8026-a52253cd8ab5 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:53.583409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38427c-2611-458b-8026-a52253cd8ab5 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:53.587860 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac2265-ca4a-4b1d-9cc2-54c5fe21aaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:53.588478 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac2265-ca4a-4b1d-9cc2-54c5fe21aaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:53.588757 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac2265-ca4a-4b1d-9cc2-54c5fe21aaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:53.589029 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac2265-ca4a-4b1d-9cc2-54c5fe21aaf3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:53.596593 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac2265-ca4a-4b1d-9cc2-54c5fe21aaf3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:53.598792 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac2265-ca4a-4b1d-9cc2-54c5fe21aaf3 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:53.607330 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 567/1142] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:04:53 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:04:53.612874 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d962b08-05d5-4b2c-9f02-98249614192e admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:53.622450 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d962b08-05d5-4b2c-9f02-98249614192e admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:53.626786 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc4f88-08a0-4de7-958c-d36bea3ce8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:53.627591 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc4f88-08a0-4de7-958c-d36bea3ce8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:53.627893 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc4f88-08a0-4de7-958c-d36bea3ce8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:53.628166 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc4f88-08a0-4de7-958c-d36bea3ce8d7 admin admin] PATH_INFO: `/v3/projects/3e03878891a242d1a7c3d434b59fd7c8` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:53.629794 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc4f88-08a0-4de7-958c-d36bea3ce8d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e03878891a242d1a7c3d434b59fd7c8)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:53.631757 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc4f88-08a0-4de7-958c-d36bea3ce8d7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:53.633358 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 576/1143] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:04:53 2022] GET /identity/v3/projects/3e03878891a242d1a7c3d434b59fd7c8 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:53.638802 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac2265-ca4a-4b1d-9cc2-54c5fe21aaf3 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:53.647852 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac2265-ca4a-4b1d-9cc2-54c5fe21aaf3 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:53.652291 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c5231-6820-42ad-a3ca-24cf5c91702a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:53.652892 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c5231-6820-42ad-a3ca-24cf5c91702a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:53.653175 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c5231-6820-42ad-a3ca-24cf5c91702a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:53.653452 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c5231-6820-42ad-a3ca-24cf5c91702a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:53.654304 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c5231-6820-42ad-a3ca-24cf5c91702a admin admin] RBAC: Adding query filter params (role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f, scope.project.id=3e03878891a242d1a7c3d434b59fd7c8, user.id=c97a41d5ed194354932126e0ed9bfe9a) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:53.654562 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c5231-6820-42ad-a3ca-24cf5c91702a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:53.656355 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c5231-6820-42ad-a3ca-24cf5c91702a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:53.661556 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 568/1144] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:04:53 2022] GET /identity/v3/role_assignments?user.id=c97a41d5ed194354932126e0ed9bfe9a&scope.project.id=3e03878891a242d1a7c3d434b59fd7c8&role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:55.810887 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d5aa7-6df0-4e23-b38a-a6ac64bf9b39 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:55.811425 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d5aa7-6df0-4e23-b38a-a6ac64bf9b39 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:55.811425 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d5aa7-6df0-4e23-b38a-a6ac64bf9b39 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:55.813211 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 577/1145] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:55.819037 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9265244-08e3-410c-bdea-209dc15be95c None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:55.819473 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9265244-08e3-410c-bdea-209dc15be95c None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:55.819564 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9265244-08e3-410c-bdea-209dc15be95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:55.837581 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-a9265244-08e3-410c-bdea-209dc15be95c None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:55.838749 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a9265244-08e3-410c-bdea-209dc15be95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:55.846180 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 569/1146] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:55 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:55.870838 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d5aa7-6df0-4e23-b38a-a6ac64bf9b39 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:55.883284 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d5aa7-6df0-4e23-b38a-a6ac64bf9b39 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:55.887536 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256cbd2-1133-4faf-b8ee-046828ea3ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:55.888328 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256cbd2-1133-4faf-b8ee-046828ea3ebd admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:55.888610 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256cbd2-1133-4faf-b8ee-046828ea3ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:55.888883 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256cbd2-1133-4faf-b8ee-046828ea3ebd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:55.899083 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256cbd2-1133-4faf-b8ee-046828ea3ebd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:04:55.905794 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-7256cbd2-1133-4faf-b8ee-046828ea3ebd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:04:55.906911 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 578/1147] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:04:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:55.912942 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9265244-08e3-410c-bdea-209dc15be95c None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:55.921508 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9265244-08e3-410c-bdea-209dc15be95c None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:55.926624 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3799b-f145-4026-9233-d6bb265dfa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:55.927256 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3799b-f145-4026-9233-d6bb265dfa87 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:55.927535 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3799b-f145-4026-9233-d6bb265dfa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:55.927806 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3799b-f145-4026-9233-d6bb265dfa87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:55.928568 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3799b-f145-4026-9233-d6bb265dfa87 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:55.928868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3799b-f145-4026-9233-d6bb265dfa87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:55.930429 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3799b-f145-4026-9233-d6bb265dfa87 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:55.938316 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 570/1148] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:04:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:55.943786 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256cbd2-1133-4faf-b8ee-046828ea3ebd admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:55.953679 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256cbd2-1133-4faf-b8ee-046828ea3ebd admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:55.958820 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da28e48-687b-41f2-966a-689fd3d88281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:55.959638 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da28e48-687b-41f2-966a-689fd3d88281 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:55.959963 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da28e48-687b-41f2-966a-689fd3d88281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:55.960234 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da28e48-687b-41f2-966a-689fd3d88281 admin admin] PATH_INFO: `/v3/users/c97a41d5ed194354932126e0ed9bfe9a` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:55.962401 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da28e48-687b-41f2-966a-689fd3d88281 admin admin] RBAC: Authorizing `identity:get_user(user_id=c97a41d5ed194354932126e0ed9bfe9a)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:55.964773 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da28e48-687b-41f2-966a-689fd3d88281 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:55.966315 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 579/1149] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:04:55 2022] GET /identity/v3/users/c97a41d5ed194354932126e0ed9bfe9a => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:55.971321 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3799b-f145-4026-9233-d6bb265dfa87 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:55.981432 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3799b-f145-4026-9233-d6bb265dfa87 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:55.985837 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30571df-0808-473d-9cbc-91e6079c1b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:55.986899 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30571df-0808-473d-9cbc-91e6079c1b88 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:55.987179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30571df-0808-473d-9cbc-91e6079c1b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:55.987452 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30571df-0808-473d-9cbc-91e6079c1b88 admin admin] PATH_INFO: `/v3/projects/3e03878891a242d1a7c3d434b59fd7c8` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:55.988827 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30571df-0808-473d-9cbc-91e6079c1b88 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e03878891a242d1a7c3d434b59fd7c8)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:55.990807 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30571df-0808-473d-9cbc-91e6079c1b88 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:55.992416 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 571/1150] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:04:55 2022] GET /identity/v3/projects/3e03878891a242d1a7c3d434b59fd7c8 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:04:55.997548 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da28e48-687b-41f2-966a-689fd3d88281 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:56.006731 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da28e48-687b-41f2-966a-689fd3d88281 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:56.011160 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523d5c2-0374-42f9-a5e7-b67c3406d60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:56.012021 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523d5c2-0374-42f9-a5e7-b67c3406d60d admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:56.012307 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523d5c2-0374-42f9-a5e7-b67c3406d60d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:56.012581 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523d5c2-0374-42f9-a5e7-b67c3406d60d admin admin] PATH_INFO: `/v3/projects/3e03878891a242d1a7c3d434b59fd7c8/users/c97a41d5ed194354932126e0ed9bfe9a/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:56.014521 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523d5c2-0374-42f9-a5e7-b67c3406d60d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e03878891a242d1a7c3d434b59fd7c8, user_id=c97a41d5ed194354932126e0ed9bfe9a, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:56.017142 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523d5c2-0374-42f9-a5e7-b67c3406d60d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:56.030742 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 580/1151] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:04:55 2022] PUT /identity/v3/projects/3e03878891a242d1a7c3d434b59fd7c8/users/c97a41d5ed194354932126e0ed9bfe9a/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:04:58.223898 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032abf46-6e7c-40ab-a119-592030c3d395 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:58.224448 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032abf46-6e7c-40ab-a119-592030c3d395 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:58.224448 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032abf46-6e7c-40ab-a119-592030c3d395 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:58.226195 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 572/1152] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:04:58.231411 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42976191-cb65-4187-a6d8-93ab4fc1d94b None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:58.231848 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42976191-cb65-4187-a6d8-93ab4fc1d94b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:58.232059 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42976191-cb65-4187-a6d8-93ab4fc1d94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:58.249942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-42976191-cb65-4187-a6d8-93ab4fc1d94b None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:04:58.251096 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-42976191-cb65-4187-a6d8-93ab4fc1d94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:04:58.305991 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 581/1153] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:04:58 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:04:58.330517 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032abf46-6e7c-40ab-a119-592030c3d395 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:58.342547 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032abf46-6e7c-40ab-a119-592030c3d395 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:58.346814 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b46414-3a82-456d-9764-d7e8491ebfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:58.347813 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b46414-3a82-456d-9764-d7e8491ebfdc admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:58.348206 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b46414-3a82-456d-9764-d7e8491ebfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:58.348489 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b46414-3a82-456d-9764-d7e8491ebfdc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:58.358369 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b46414-3a82-456d-9764-d7e8491ebfdc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:04:58.366296 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-15b46414-3a82-456d-9764-d7e8491ebfdc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:04:58.367419 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 573/1154] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:04:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:04:58.373064 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42976191-cb65-4187-a6d8-93ab4fc1d94b None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:58.382624 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42976191-cb65-4187-a6d8-93ab4fc1d94b None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:58.388595 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3973ae7-e54b-4547-a830-87ce15948a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:58.389244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3973ae7-e54b-4547-a830-87ce15948a0e admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:58.389524 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3973ae7-e54b-4547-a830-87ce15948a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:58.389794 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3973ae7-e54b-4547-a830-87ce15948a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:58.390547 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3973ae7-e54b-4547-a830-87ce15948a0e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:58.390849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3973ae7-e54b-4547-a830-87ce15948a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:58.392456 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3973ae7-e54b-4547-a830-87ce15948a0e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:58.400597 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 582/1155] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:04:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:58.406074 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b46414-3a82-456d-9764-d7e8491ebfdc admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:58.416262 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b46414-3a82-456d-9764-d7e8491ebfdc admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:58.420693 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15353af1-c078-4fec-ba09-84d818f7d1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:58.421513 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15353af1-c078-4fec-ba09-84d818f7d1fa admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:58.421794 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15353af1-c078-4fec-ba09-84d818f7d1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:58.422067 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15353af1-c078-4fec-ba09-84d818f7d1fa admin admin] PATH_INFO: `/v3/users/c97a41d5ed194354932126e0ed9bfe9a` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:58.423240 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15353af1-c078-4fec-ba09-84d818f7d1fa admin admin] RBAC: Authorizing `identity:get_user(user_id=c97a41d5ed194354932126e0ed9bfe9a)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:58.425357 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15353af1-c078-4fec-ba09-84d818f7d1fa admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:58.427727 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 574/1156] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:04:58 2022] GET /identity/v3/users/c97a41d5ed194354932126e0ed9bfe9a => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:58.432942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3973ae7-e54b-4547-a830-87ce15948a0e admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:58.442551 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3973ae7-e54b-4547-a830-87ce15948a0e admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:58.446882 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ffa67-f78e-4a7f-bf51-786a3377669f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:58.447509 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ffa67-f78e-4a7f-bf51-786a3377669f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:58.447786 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ffa67-f78e-4a7f-bf51-786a3377669f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:58.448081 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ffa67-f78e-4a7f-bf51-786a3377669f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:58.455440 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ffa67-f78e-4a7f-bf51-786a3377669f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:58.457220 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ffa67-f78e-4a7f-bf51-786a3377669f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:58.465681 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 583/1157] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:04:58 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:04:58.470937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15353af1-c078-4fec-ba09-84d818f7d1fa admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:58.480234 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15353af1-c078-4fec-ba09-84d818f7d1fa admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:58.484617 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf69f29-9032-438b-92de-62b04ed4ca51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:58.485404 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf69f29-9032-438b-92de-62b04ed4ca51 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:58.485688 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf69f29-9032-438b-92de-62b04ed4ca51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:58.485956 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf69f29-9032-438b-92de-62b04ed4ca51 admin admin] PATH_INFO: `/v3/projects/3e03878891a242d1a7c3d434b59fd7c8` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:58.487361 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf69f29-9032-438b-92de-62b04ed4ca51 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e03878891a242d1a7c3d434b59fd7c8)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:58.490060 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf69f29-9032-438b-92de-62b04ed4ca51 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:58.491618 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 575/1158] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:04:58 2022] GET /identity/v3/projects/3e03878891a242d1a7c3d434b59fd7c8 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:04:58.497087 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ffa67-f78e-4a7f-bf51-786a3377669f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:04:58.505974 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ffa67-f78e-4a7f-bf51-786a3377669f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:04:58.510364 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272b259-add1-41d1-9212-fa0bee80dd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:04:58.510954 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272b259-add1-41d1-9212-fa0bee80dd1c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:04:58.511232 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272b259-add1-41d1-9212-fa0bee80dd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:04:58.511503 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272b259-add1-41d1-9212-fa0bee80dd1c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:04:58.512345 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272b259-add1-41d1-9212-fa0bee80dd1c admin admin] RBAC: Adding query filter params (role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f, scope.project.id=3e03878891a242d1a7c3d434b59fd7c8, user.id=c97a41d5ed194354932126e0ed9bfe9a) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:04:58.512650 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272b259-add1-41d1-9212-fa0bee80dd1c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:04:58.514394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272b259-add1-41d1-9212-fa0bee80dd1c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:04:58.519944 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 584/1159] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:04:58 2022] GET /identity/v3/role_assignments?user.id=c97a41d5ed194354932126e0ed9bfe9a&scope.project.id=3e03878891a242d1a7c3d434b59fd7c8&role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:05:00.749109 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eceee1-155e-4158-a023-ebcbf2d7fe26 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:00.749917 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eceee1-155e-4158-a023-ebcbf2d7fe26 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:00.750072 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eceee1-155e-4158-a023-ebcbf2d7fe26 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:00.751911 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 576/1160] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:05:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:05:00.758005 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92474d-737f-420c-a7a8-9166bfa141b3 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:00.758421 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92474d-737f-420c-a7a8-9166bfa141b3 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:00.758560 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92474d-737f-420c-a7a8-9166bfa141b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:00.776317 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-9e92474d-737f-420c-a7a8-9166bfa141b3 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:05:00.777498 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-9e92474d-737f-420c-a7a8-9166bfa141b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:05:00.785123 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 585/1161] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:05:00 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:05:00.807791 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eceee1-155e-4158-a023-ebcbf2d7fe26 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:00.820487 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eceee1-155e-4158-a023-ebcbf2d7fe26 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:00.824874 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2223f8-ad7f-4a9a-8f5f-c7b2e0385c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:00.825491 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2223f8-ad7f-4a9a-8f5f-c7b2e0385c42 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:00.825768 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2223f8-ad7f-4a9a-8f5f-c7b2e0385c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:00.826039 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2223f8-ad7f-4a9a-8f5f-c7b2e0385c42 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:00.833453 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2223f8-ad7f-4a9a-8f5f-c7b2e0385c42 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:00.835153 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2223f8-ad7f-4a9a-8f5f-c7b2e0385c42 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:00.843627 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 577/1162] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:05:00 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:05:00.849590 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92474d-737f-420c-a7a8-9166bfa141b3 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:00.858081 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92474d-737f-420c-a7a8-9166bfa141b3 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:00.862791 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb825f17-d0be-417e-a264-3080145d1e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:00.864264 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb825f17-d0be-417e-a264-3080145d1e86 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:00.864547 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb825f17-d0be-417e-a264-3080145d1e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:00.864816 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb825f17-d0be-417e-a264-3080145d1e86 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:00.871490 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb825f17-d0be-417e-a264-3080145d1e86 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:00.873321 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb825f17-d0be-417e-a264-3080145d1e86 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:00.886546 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-eb825f17-d0be-417e-a264-3080145d1e86 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 10 23:05:00.887639 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 586/1163] 10.222.0.77 () {56 vars in 1138 bytes} [Thu Feb 10 23:05:00 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:05:00.893230 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2223f8-ad7f-4a9a-8f5f-c7b2e0385c42 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:00.901840 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2223f8-ad7f-4a9a-8f5f-c7b2e0385c42 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:00.906244 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1ccd0-dc7e-4ffc-80db-b47429555bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:00.906861 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1ccd0-dc7e-4ffc-80db-b47429555bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:00.907143 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1ccd0-dc7e-4ffc-80db-b47429555bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:00.907416 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1ccd0-dc7e-4ffc-80db-b47429555bd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:00.908171 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1ccd0-dc7e-4ffc-80db-b47429555bd4 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:05:00.908475 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1ccd0-dc7e-4ffc-80db-b47429555bd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:00.910565 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1ccd0-dc7e-4ffc-80db-b47429555bd4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:00.917531 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 578/1164] 10.222.0.77 () {56 vars in 1136 bytes} [Thu Feb 10 23:05:00 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:05:03.126031 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608e246-9eed-4c65-bc66-8b4dd8fde291 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:03.126523 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608e246-9eed-4c65-bc66-8b4dd8fde291 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:03.126617 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608e246-9eed-4c65-bc66-8b4dd8fde291 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:03.128380 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 587/1165] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:05:03.133894 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95759521-6aff-439f-a44a-1e5f899c708c None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:03.134309 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95759521-6aff-439f-a44a-1e5f899c708c None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:03.134447 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95759521-6aff-439f-a44a-1e5f899c708c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:03.152184 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-95759521-6aff-439f-a44a-1e5f899c708c None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:05:03.153346 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-95759521-6aff-439f-a44a-1e5f899c708c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:05:03.161708 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 579/1166] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:05:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:05:03.185128 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608e246-9eed-4c65-bc66-8b4dd8fde291 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:03.197127 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608e246-9eed-4c65-bc66-8b4dd8fde291 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:03.201467 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38575298-8746-4241-bc81-99296d88795b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:03.202100 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38575298-8746-4241-bc81-99296d88795b admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:03.202386 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38575298-8746-4241-bc81-99296d88795b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:03.202670 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38575298-8746-4241-bc81-99296d88795b admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:03.203428 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38575298-8746-4241-bc81-99296d88795b admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:03.204470 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING py.warnings [None req-38575298-8746-4241-bc81-99296d88795b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:05:03.204470 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: warnings.warn(msg) Feb 10 23:05:03.204470 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: Feb 10 23:05:03.205344 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38575298-8746-4241-bc81-99296d88795b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:03.219339 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 588/1167] 10.222.0.77 () {60 vars in 1159 bytes} [Thu Feb 10 23:05:03 2022] POST /identity/v3/domains => generated 267 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:05:05.411141 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7417f-e1d2-4271-894c-ec18d179c073 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:05.411729 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7417f-e1d2-4271-894c-ec18d179c073 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:05.411729 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7417f-e1d2-4271-894c-ec18d179c073 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:05.413493 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 580/1168] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:05:05.418872 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbb45a-7d27-46a3-8487-ff0e8f227787 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:05.419267 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbb45a-7d27-46a3-8487-ff0e8f227787 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:05.419425 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbb45a-7d27-46a3-8487-ff0e8f227787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:05.437154 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-1dcbb45a-7d27-46a3-8487-ff0e8f227787 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:05:05.438315 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-1dcbb45a-7d27-46a3-8487-ff0e8f227787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:05:05.493224 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 589/1169] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:05:05 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:05:05.516512 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7417f-e1d2-4271-894c-ec18d179c073 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:05.528302 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7417f-e1d2-4271-894c-ec18d179c073 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:05.532589 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9553a-e0c7-425e-95ab-cdb26ca75064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:05.533409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9553a-e0c7-425e-95ab-cdb26ca75064 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:05.533687 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9553a-e0c7-425e-95ab-cdb26ca75064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:05.533960 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9553a-e0c7-425e-95ab-cdb26ca75064 admin admin] PATH_INFO: `/v3/domains/1bd4768baeee40c9b4e061f2d7face0c` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:05.544629 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9553a-e0c7-425e-95ab-cdb26ca75064 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=1bd4768baeee40c9b4e061f2d7face0c)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:05.546548 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9553a-e0c7-425e-95ab-cdb26ca75064 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:05.548113 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 581/1170] 10.222.0.77 () {56 vars in 1204 bytes} [Thu Feb 10 23:05:05 2022] GET /identity/v3/domains/1bd4768baeee40c9b4e061f2d7face0c => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:05:05.554086 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbb45a-7d27-46a3-8487-ff0e8f227787 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:05.562712 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbb45a-7d27-46a3-8487-ff0e8f227787 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:05.567183 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60ce71-e383-40eb-be59-3a38dc7bc5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:05.567838 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60ce71-e383-40eb-be59-3a38dc7bc5f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:05.568128 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60ce71-e383-40eb-be59-3a38dc7bc5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:05.568411 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60ce71-e383-40eb-be59-3a38dc7bc5f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:05.569122 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60ce71-e383-40eb-be59-3a38dc7bc5f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:05.570981 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60ce71-e383-40eb-be59-3a38dc7bc5f6 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:05.596048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 590/1171] 10.222.0.77 () {60 vars in 1162 bytes} [Thu Feb 10 23:05:05 2022] POST /identity/v3/projects => generated 361 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:05:07.830551 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabf267-1eaf-401e-8548-884b3166d93a None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:07.831103 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabf267-1eaf-401e-8548-884b3166d93a None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:07.831103 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabf267-1eaf-401e-8548-884b3166d93a None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:07.833492 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 582/1172] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:05:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:05:07.838799 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db850f-dc63-481a-831f-879386aba5b0 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:07.839200 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db850f-dc63-481a-831f-879386aba5b0 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:07.839338 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db850f-dc63-481a-831f-879386aba5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:07.857226 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-e4db850f-dc63-481a-831f-879386aba5b0 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:05:07.858385 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e4db850f-dc63-481a-831f-879386aba5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:05:07.914525 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 591/1173] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:05:07 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:05:07.940284 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabf267-1eaf-401e-8548-884b3166d93a None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:07.952312 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabf267-1eaf-401e-8548-884b3166d93a None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:07.957136 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc057d-8246-4d9e-a8f8-a239eaa89ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:07.958180 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc057d-8246-4d9e-a8f8-a239eaa89ccb admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:07.958464 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc057d-8246-4d9e-a8f8-a239eaa89ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:07.958740 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc057d-8246-4d9e-a8f8-a239eaa89ccb admin admin] PATH_INFO: `/v3/domains/1bd4768baeee40c9b4e061f2d7face0c` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:07.959931 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc057d-8246-4d9e-a8f8-a239eaa89ccb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=1bd4768baeee40c9b4e061f2d7face0c)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:07.961851 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc057d-8246-4d9e-a8f8-a239eaa89ccb admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:07.963414 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 583/1174] 10.222.0.77 () {56 vars in 1204 bytes} [Thu Feb 10 23:05:07 2022] GET /identity/v3/domains/1bd4768baeee40c9b4e061f2d7face0c => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:05:07.968652 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db850f-dc63-481a-831f-879386aba5b0 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:07.978133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db850f-dc63-481a-831f-879386aba5b0 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:07.982624 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3bc50-5de5-49f2-9cd6-7de9948959c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:07.983269 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3bc50-5de5-49f2-9cd6-7de9948959c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:07.983555 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3bc50-5de5-49f2-9cd6-7de9948959c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:07.983856 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3bc50-5de5-49f2-9cd6-7de9948959c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:07.984579 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3bc50-5de5-49f2-9cd6-7de9948959c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:07.986726 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3bc50-5de5-49f2-9cd6-7de9948959c8 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:08.006622 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 592/1175] 10.222.0.77 () {60 vars in 1153 bytes} [Thu Feb 10 23:05:07 2022] POST /identity/v3/users => generated 311 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:05:10.239051 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789c28c-738c-47f2-92b6-f0b935146f65 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:10.239678 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789c28c-738c-47f2-92b6-f0b935146f65 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:10.239678 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789c28c-738c-47f2-92b6-f0b935146f65 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:10.241528 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 584/1176] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:05:10.246854 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ad501-f421-4116-8a9d-82f87db78b22 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:10.247249 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ad501-f421-4116-8a9d-82f87db78b22 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:10.247410 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ad501-f421-4116-8a9d-82f87db78b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:10.265246 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-9c7ad501-f421-4116-8a9d-82f87db78b22 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:05:10.266420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-9c7ad501-f421-4116-8a9d-82f87db78b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:05:10.274881 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 593/1177] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:05:10 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:05:10.299682 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789c28c-738c-47f2-92b6-f0b935146f65 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:10.311449 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789c28c-738c-47f2-92b6-f0b935146f65 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:10.315760 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae3d48-6cc2-4edd-a837-7ad76ea88249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:10.316710 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae3d48-6cc2-4edd-a837-7ad76ea88249 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:10.316992 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae3d48-6cc2-4edd-a837-7ad76ea88249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:10.317270 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae3d48-6cc2-4edd-a837-7ad76ea88249 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:10.327532 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae3d48-6cc2-4edd-a837-7ad76ea88249 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:05:10.334799 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-daae3d48-6cc2-4edd-a837-7ad76ea88249 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:05:10.335873 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 585/1178] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:05:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:05:10.341416 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ad501-f421-4116-8a9d-82f87db78b22 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:10.350889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ad501-f421-4116-8a9d-82f87db78b22 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:10.355284 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c22d9-8615-412e-9495-164023a1f13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:10.355967 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c22d9-8615-412e-9495-164023a1f13b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:10.356254 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c22d9-8615-412e-9495-164023a1f13b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:10.356532 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c22d9-8615-412e-9495-164023a1f13b admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:10.357290 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c22d9-8615-412e-9495-164023a1f13b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:05:10.357595 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c22d9-8615-412e-9495-164023a1f13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:10.359171 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c22d9-8615-412e-9495-164023a1f13b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:10.368058 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 594/1179] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:05:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:05:10.373396 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae3d48-6cc2-4edd-a837-7ad76ea88249 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:10.383456 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae3d48-6cc2-4edd-a837-7ad76ea88249 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:10.387779 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccab4b-ce16-4347-889a-5eb80e9b95b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:10.388627 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccab4b-ce16-4347-889a-5eb80e9b95b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:10.388917 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccab4b-ce16-4347-889a-5eb80e9b95b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:10.389192 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccab4b-ce16-4347-889a-5eb80e9b95b9 admin admin] PATH_INFO: `/v3/users/18904bf2874c43afaf478687ca009161` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:10.402130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccab4b-ce16-4347-889a-5eb80e9b95b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=18904bf2874c43afaf478687ca009161)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:10.404266 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccab4b-ce16-4347-889a-5eb80e9b95b9 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:10.405814 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 586/1180] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:05:10 2022] GET /identity/v3/users/18904bf2874c43afaf478687ca009161 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:05:10.411267 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c22d9-8615-412e-9495-164023a1f13b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:10.420558 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c22d9-8615-412e-9495-164023a1f13b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:10.424956 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0aded4-0f55-440c-9b52-cc05e42d94fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:10.426100 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aded4-0f55-440c-9b52-cc05e42d94fa admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:10.426383 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aded4-0f55-440c-9b52-cc05e42d94fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:10.426656 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aded4-0f55-440c-9b52-cc05e42d94fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:10.434126 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0aded4-0f55-440c-9b52-cc05e42d94fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:10.435842 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0aded4-0f55-440c-9b52-cc05e42d94fa admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:10.445048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 595/1181] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:05:10 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:05:10.450626 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccab4b-ce16-4347-889a-5eb80e9b95b9 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:10.462132 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccab4b-ce16-4347-889a-5eb80e9b95b9 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:10.466544 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e83aa5-e059-40f5-966d-0e37c934441a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:10.467359 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e83aa5-e059-40f5-966d-0e37c934441a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:10.467645 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e83aa5-e059-40f5-966d-0e37c934441a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:10.467963 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e83aa5-e059-40f5-966d-0e37c934441a admin admin] PATH_INFO: `/v3/projects/b3a4b1a1c2284e618fe06cb55f730be7` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:10.469118 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e83aa5-e059-40f5-966d-0e37c934441a admin admin] RBAC: Authorizing `identity:get_project(project_id=b3a4b1a1c2284e618fe06cb55f730be7)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:10.471111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e83aa5-e059-40f5-966d-0e37c934441a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:10.473032 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 587/1182] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:05:10 2022] GET /identity/v3/projects/b3a4b1a1c2284e618fe06cb55f730be7 => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:05:10.481097 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0aded4-0f55-440c-9b52-cc05e42d94fa admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:10.490514 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0aded4-0f55-440c-9b52-cc05e42d94fa admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:10.495030 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb38747-070a-4608-a976-2847832a9e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:10.495643 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb38747-070a-4608-a976-2847832a9e12 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:10.495964 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb38747-070a-4608-a976-2847832a9e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:10.496239 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb38747-070a-4608-a976-2847832a9e12 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:10.497062 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb38747-070a-4608-a976-2847832a9e12 admin admin] RBAC: Adding query filter params (role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f, scope.project.id=b3a4b1a1c2284e618fe06cb55f730be7, user.id=18904bf2874c43afaf478687ca009161) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:05:10.497367 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb38747-070a-4608-a976-2847832a9e12 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:10.499157 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb38747-070a-4608-a976-2847832a9e12 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:10.505091 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 596/1183] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:05:10 2022] GET /identity/v3/role_assignments?user.id=18904bf2874c43afaf478687ca009161&scope.project.id=b3a4b1a1c2284e618fe06cb55f730be7&role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:05:12.689386 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98929f-fb03-4b66-b3c4-7c2a2ceeb8bf None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:12.689916 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98929f-fb03-4b66-b3c4-7c2a2ceeb8bf None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:12.689916 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98929f-fb03-4b66-b3c4-7c2a2ceeb8bf None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:12.692314 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 588/1184] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:05:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:05:12.697488 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd796cb0-de81-4c4d-bfee-e563e3866e82 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:12.697915 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd796cb0-de81-4c4d-bfee-e563e3866e82 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:12.698047 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd796cb0-de81-4c4d-bfee-e563e3866e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:12.715288 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-bd796cb0-de81-4c4d-bfee-e563e3866e82 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:05:12.716486 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-bd796cb0-de81-4c4d-bfee-e563e3866e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:05:12.724261 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 597/1185] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:05:12 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:05:12.747702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98929f-fb03-4b66-b3c4-7c2a2ceeb8bf None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:12.760018 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98929f-fb03-4b66-b3c4-7c2a2ceeb8bf None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:12.764254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28484956-22a5-4f3f-9fe6-6f9c58ebf76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:12.765007 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28484956-22a5-4f3f-9fe6-6f9c58ebf76e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:12.765288 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28484956-22a5-4f3f-9fe6-6f9c58ebf76e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:12.765561 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28484956-22a5-4f3f-9fe6-6f9c58ebf76e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:12.775805 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28484956-22a5-4f3f-9fe6-6f9c58ebf76e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:05:12.782429 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-28484956-22a5-4f3f-9fe6-6f9c58ebf76e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:05:12.783536 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 589/1186] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:05:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:05:12.789069 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd796cb0-de81-4c4d-bfee-e563e3866e82 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:12.797664 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd796cb0-de81-4c4d-bfee-e563e3866e82 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:12.802722 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d93713-1a4c-4593-896f-8ebdb2dbc360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:12.803355 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d93713-1a4c-4593-896f-8ebdb2dbc360 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:12.803638 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d93713-1a4c-4593-896f-8ebdb2dbc360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:12.803944 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d93713-1a4c-4593-896f-8ebdb2dbc360 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:12.804694 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d93713-1a4c-4593-896f-8ebdb2dbc360 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:05:12.804997 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d93713-1a4c-4593-896f-8ebdb2dbc360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:12.806555 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d93713-1a4c-4593-896f-8ebdb2dbc360 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:12.814512 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 598/1187] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:05:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:05:12.820690 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28484956-22a5-4f3f-9fe6-6f9c58ebf76e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:12.831202 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28484956-22a5-4f3f-9fe6-6f9c58ebf76e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:12.835847 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f46f9d-76d8-499f-baf7-d9f4943ff034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:12.836649 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f46f9d-76d8-499f-baf7-d9f4943ff034 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:12.836924 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f46f9d-76d8-499f-baf7-d9f4943ff034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:12.837193 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f46f9d-76d8-499f-baf7-d9f4943ff034 admin admin] PATH_INFO: `/v3/users/18904bf2874c43afaf478687ca009161` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:12.838345 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f46f9d-76d8-499f-baf7-d9f4943ff034 admin admin] RBAC: Authorizing `identity:get_user(user_id=18904bf2874c43afaf478687ca009161)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:12.840445 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f46f9d-76d8-499f-baf7-d9f4943ff034 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:12.841950 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 590/1188] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:05:12 2022] GET /identity/v3/users/18904bf2874c43afaf478687ca009161 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:05:12.847563 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d93713-1a4c-4593-896f-8ebdb2dbc360 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:12.857062 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d93713-1a4c-4593-896f-8ebdb2dbc360 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:12.861702 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03108e52-c3ef-4ee0-b5d8-ee44e7b4cc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:12.862622 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03108e52-c3ef-4ee0-b5d8-ee44e7b4cc6c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:12.863396 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03108e52-c3ef-4ee0-b5d8-ee44e7b4cc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:12.863744 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03108e52-c3ef-4ee0-b5d8-ee44e7b4cc6c admin admin] PATH_INFO: `/v3/projects/b3a4b1a1c2284e618fe06cb55f730be7` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:12.864964 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03108e52-c3ef-4ee0-b5d8-ee44e7b4cc6c admin admin] RBAC: Authorizing `identity:get_project(project_id=b3a4b1a1c2284e618fe06cb55f730be7)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:12.866953 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03108e52-c3ef-4ee0-b5d8-ee44e7b4cc6c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:12.868586 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 599/1189] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:05:12 2022] GET /identity/v3/projects/b3a4b1a1c2284e618fe06cb55f730be7 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:05:12.873801 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f46f9d-76d8-499f-baf7-d9f4943ff034 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:12.883058 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f46f9d-76d8-499f-baf7-d9f4943ff034 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:12.887391 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d3294-ba29-4cb5-9293-4689924213fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:12.888244 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d3294-ba29-4cb5-9293-4689924213fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:12.888520 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d3294-ba29-4cb5-9293-4689924213fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:12.888784 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d3294-ba29-4cb5-9293-4689924213fd admin admin] PATH_INFO: `/v3/projects/b3a4b1a1c2284e618fe06cb55f730be7/users/18904bf2874c43afaf478687ca009161/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:12.890656 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d3294-ba29-4cb5-9293-4689924213fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a4b1a1c2284e618fe06cb55f730be7, user_id=18904bf2874c43afaf478687ca009161, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:12.893235 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d3294-ba29-4cb5-9293-4689924213fd admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:12.905401 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 591/1190] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:05:12 2022] PUT /identity/v3/projects/b3a4b1a1c2284e618fe06cb55f730be7/users/18904bf2874c43afaf478687ca009161/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:05:15.078918 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce871f3-dfea-4505-9a02-d15a3eae0c6a None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:15.079464 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce871f3-dfea-4505-9a02-d15a3eae0c6a None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:15.079464 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce871f3-dfea-4505-9a02-d15a3eae0c6a None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:15.081303 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 600/1191] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:05:15.086675 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb3547-7dd0-4b9b-9bdf-ff02f3d1052c None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:15.087095 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb3547-7dd0-4b9b-9bdf-ff02f3d1052c None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:15.087227 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb3547-7dd0-4b9b-9bdf-ff02f3d1052c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:15.105032 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-82cb3547-7dd0-4b9b-9bdf-ff02f3d1052c None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:05:15.106187 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-82cb3547-7dd0-4b9b-9bdf-ff02f3d1052c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:05:15.161119 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 592/1192] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:05:15 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:05:15.185471 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce871f3-dfea-4505-9a02-d15a3eae0c6a None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:15.197351 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce871f3-dfea-4505-9a02-d15a3eae0c6a None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:15.201633 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98583cb9-6a01-491f-8a8b-88256cf654e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:15.202392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98583cb9-6a01-491f-8a8b-88256cf654e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:15.202672 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98583cb9-6a01-491f-8a8b-88256cf654e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:15.202944 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98583cb9-6a01-491f-8a8b-88256cf654e8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:15.212936 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98583cb9-6a01-491f-8a8b-88256cf654e8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:05:15.219614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-98583cb9-6a01-491f-8a8b-88256cf654e8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:05:15.220760 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 601/1193] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:05:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:05:15.227066 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb3547-7dd0-4b9b-9bdf-ff02f3d1052c None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:15.235594 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb3547-7dd0-4b9b-9bdf-ff02f3d1052c None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:15.240892 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd21d8-01e3-4f6b-b3f3-abaf45b3d177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:15.241527 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd21d8-01e3-4f6b-b3f3-abaf45b3d177 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:15.241808 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd21d8-01e3-4f6b-b3f3-abaf45b3d177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:15.242079 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd21d8-01e3-4f6b-b3f3-abaf45b3d177 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:15.242829 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd21d8-01e3-4f6b-b3f3-abaf45b3d177 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:05:15.243126 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd21d8-01e3-4f6b-b3f3-abaf45b3d177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:15.244714 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd21d8-01e3-4f6b-b3f3-abaf45b3d177 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:15.252613 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 593/1194] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:05:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:05:15.257894 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98583cb9-6a01-491f-8a8b-88256cf654e8 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:15.267712 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98583cb9-6a01-491f-8a8b-88256cf654e8 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:15.272199 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd5860-88de-4ac1-a2b2-de3ec010c1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:15.273017 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd5860-88de-4ac1-a2b2-de3ec010c1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:15.273298 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd5860-88de-4ac1-a2b2-de3ec010c1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:15.273574 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd5860-88de-4ac1-a2b2-de3ec010c1c9 admin admin] PATH_INFO: `/v3/users/18904bf2874c43afaf478687ca009161` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:15.274752 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd5860-88de-4ac1-a2b2-de3ec010c1c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=18904bf2874c43afaf478687ca009161)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:15.276870 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd5860-88de-4ac1-a2b2-de3ec010c1c9 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:15.278589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 602/1195] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Feb 10 23:05:15 2022] GET /identity/v3/users/18904bf2874c43afaf478687ca009161 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:05:15.283440 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd21d8-01e3-4f6b-b3f3-abaf45b3d177 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:15.293242 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd21d8-01e3-4f6b-b3f3-abaf45b3d177 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:15.297584 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b52cb8-89c9-4f15-a8b3-16a1b6959229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:15.298191 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b52cb8-89c9-4f15-a8b3-16a1b6959229 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:15.298471 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b52cb8-89c9-4f15-a8b3-16a1b6959229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:15.298743 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b52cb8-89c9-4f15-a8b3-16a1b6959229 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:15.306915 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b52cb8-89c9-4f15-a8b3-16a1b6959229 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:15.308638 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b52cb8-89c9-4f15-a8b3-16a1b6959229 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:15.317076 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 594/1196] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:05:15 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:05:15.322299 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd5860-88de-4ac1-a2b2-de3ec010c1c9 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:15.331665 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd5860-88de-4ac1-a2b2-de3ec010c1c9 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:15.336107 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa97aa5-3293-4e9a-9d14-deabd919b8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:15.336904 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa97aa5-3293-4e9a-9d14-deabd919b8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:15.337188 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa97aa5-3293-4e9a-9d14-deabd919b8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:15.337466 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa97aa5-3293-4e9a-9d14-deabd919b8d6 admin admin] PATH_INFO: `/v3/projects/b3a4b1a1c2284e618fe06cb55f730be7` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:15.338618 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa97aa5-3293-4e9a-9d14-deabd919b8d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=b3a4b1a1c2284e618fe06cb55f730be7)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:15.340657 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa97aa5-3293-4e9a-9d14-deabd919b8d6 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:15.342254 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 603/1197] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Feb 10 23:05:15 2022] GET /identity/v3/projects/b3a4b1a1c2284e618fe06cb55f730be7 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:05:15.348363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b52cb8-89c9-4f15-a8b3-16a1b6959229 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:05:15.356663 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b52cb8-89c9-4f15-a8b3-16a1b6959229 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:05:15.361074 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c80ae-dd71-4ff9-ad9a-3454f8040f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:05:15.361935 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c80ae-dd71-4ff9-ad9a-3454f8040f09 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:05:15.362217 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c80ae-dd71-4ff9-ad9a-3454f8040f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:05:15.363121 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c80ae-dd71-4ff9-ad9a-3454f8040f09 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:05:15.364300 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c80ae-dd71-4ff9-ad9a-3454f8040f09 admin admin] RBAC: Adding query filter params (role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f, scope.project.id=b3a4b1a1c2284e618fe06cb55f730be7, user.id=18904bf2874c43afaf478687ca009161) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:05:15.364636 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c80ae-dd71-4ff9-ad9a-3454f8040f09 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:05:15.366407 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c80ae-dd71-4ff9-ad9a-3454f8040f09 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:05:15.371925 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 595/1198] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:05:15 2022] GET /identity/v3/role_assignments?user.id=18904bf2874c43afaf478687ca009161&scope.project.id=b3a4b1a1c2284e618fe06cb55f730be7&role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:15.612715 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7bf1d-2469-47c0-a398-8f7353f80980 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:15.613375 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7bf1d-2469-47c0-a398-8f7353f80980 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:15.613375 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7bf1d-2469-47c0-a398-8f7353f80980 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:15.615196 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 604/1199] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:06:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:06:15.621718 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea3c2c-3ad7-4eeb-81c3-b10a32bc344e None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:15.622255 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea3c2c-3ad7-4eeb-81c3-b10a32bc344e None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:15.622428 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea3c2c-3ad7-4eeb-81c3-b10a32bc344e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:15.641205 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-9fea3c2c-3ad7-4eeb-81c3-b10a32bc344e None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:06:15.642526 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-9fea3c2c-3ad7-4eeb-81c3-b10a32bc344e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:06:15.652038 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 596/1200] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:06:15 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:06:15.677761 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7bf1d-2469-47c0-a398-8f7353f80980 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:15.690883 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7bf1d-2469-47c0-a398-8f7353f80980 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:15.695972 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089db1b-6b83-4bba-99e4-21c620acd829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:15.696784 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089db1b-6b83-4bba-99e4-21c620acd829 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:15.697064 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089db1b-6b83-4bba-99e4-21c620acd829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:15.697333 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089db1b-6b83-4bba-99e4-21c620acd829 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:15.708828 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089db1b-6b83-4bba-99e4-21c620acd829 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:15.710761 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089db1b-6b83-4bba-99e4-21c620acd829 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:15.729805 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-0089db1b-6b83-4bba-99e4-21c620acd829 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:06:15.731045 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 605/1201] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:15.738062 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea3c2c-3ad7-4eeb-81c3-b10a32bc344e None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:15.747189 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea3c2c-3ad7-4eeb-81c3-b10a32bc344e None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:15.752344 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357693f6-d3e5-49b5-afa6-72e6bc652ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:15.753221 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357693f6-d3e5-49b5-afa6-72e6bc652ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:15.753514 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357693f6-d3e5-49b5-afa6-72e6bc652ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:15.753971 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357693f6-d3e5-49b5-afa6-72e6bc652ac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:15.754529 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357693f6-d3e5-49b5-afa6-72e6bc652ac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:15.754842 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357693f6-d3e5-49b5-afa6-72e6bc652ac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:15.756486 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357693f6-d3e5-49b5-afa6-72e6bc652ac8 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:15.769636 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 597/1202] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:15.775612 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089db1b-6b83-4bba-99e4-21c620acd829 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:15.785971 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089db1b-6b83-4bba-99e4-21c620acd829 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:15.790625 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec467b2f-e58b-4520-ae37-3498da5a497e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:15.791283 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec467b2f-e58b-4520-ae37-3498da5a497e admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:15.791558 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec467b2f-e58b-4520-ae37-3498da5a497e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:15.791850 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec467b2f-e58b-4520-ae37-3498da5a497e admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:15.792770 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec467b2f-e58b-4520-ae37-3498da5a497e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:15.794741 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec467b2f-e58b-4520-ae37-3498da5a497e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:15.819375 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 606/1203] 10.222.0.77 () {60 vars in 1153 bytes} [Thu Feb 10 23:06:15 2022] POST /identity/v3/users => generated 251 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:06:18.225591 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b1142-07a4-431c-af32-335618939c93 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:18.226132 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b1142-07a4-431c-af32-335618939c93 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:18.226132 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b1142-07a4-431c-af32-335618939c93 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:18.227921 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 598/1204] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:06:18.233372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd7b7f-b585-4d55-be5e-080e57d45715 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:18.233846 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd7b7f-b585-4d55-be5e-080e57d45715 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:18.234066 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd7b7f-b585-4d55-be5e-080e57d45715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:18.253718 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-d0dd7b7f-b585-4d55-be5e-080e57d45715 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:06:18.255319 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d0dd7b7f-b585-4d55-be5e-080e57d45715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:06:18.263180 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 607/1205] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:06:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:06:18.288467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b1142-07a4-431c-af32-335618939c93 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:18.305371 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b1142-07a4-431c-af32-335618939c93 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:18.310681 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbe6dd-5caf-4add-8cff-baf4da3bb459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:18.311495 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbe6dd-5caf-4add-8cff-baf4da3bb459 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:18.311783 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbe6dd-5caf-4add-8cff-baf4da3bb459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:18.312099 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbe6dd-5caf-4add-8cff-baf4da3bb459 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:18.326050 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbe6dd-5caf-4add-8cff-baf4da3bb459 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:06:18.335655 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-1dcbe6dd-5caf-4add-8cff-baf4da3bb459 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:06:18.337181 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 599/1206] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:06:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:18.343356 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd7b7f-b585-4d55-be5e-080e57d45715 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:18.353315 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd7b7f-b585-4d55-be5e-080e57d45715 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:18.358658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50baaf-28b2-49c1-ad4f-c16f6d27063f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:18.359439 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50baaf-28b2-49c1-ad4f-c16f6d27063f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:18.359690 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50baaf-28b2-49c1-ad4f-c16f6d27063f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:18.360136 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50baaf-28b2-49c1-ad4f-c16f6d27063f admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:18.360944 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50baaf-28b2-49c1-ad4f-c16f6d27063f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:18.361246 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50baaf-28b2-49c1-ad4f-c16f6d27063f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:18.364049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50baaf-28b2-49c1-ad4f-c16f6d27063f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:18.373405 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 608/1207] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:06:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:18.379298 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbe6dd-5caf-4add-8cff-baf4da3bb459 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:18.389045 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbe6dd-5caf-4add-8cff-baf4da3bb459 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:18.394311 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea594f-2d7a-44e2-842d-1749e06d2bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:18.395086 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea594f-2d7a-44e2-842d-1749e06d2bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:18.395370 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea594f-2d7a-44e2-842d-1749e06d2bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:18.395641 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea594f-2d7a-44e2-842d-1749e06d2bc3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:18.407089 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea594f-2d7a-44e2-842d-1749e06d2bc3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:18.409972 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea594f-2d7a-44e2-842d-1749e06d2bc3 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:18.427913 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-ddea594f-2d7a-44e2-842d-1749e06d2bc3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:06:18.429223 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 600/1208] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:06:18.435812 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50baaf-28b2-49c1-ad4f-c16f6d27063f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:18.446697 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50baaf-28b2-49c1-ad4f-c16f6d27063f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:18.451340 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c00bce-9c30-40df-acba-e2dd12c0bbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:18.452025 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c00bce-9c30-40df-acba-e2dd12c0bbea admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:18.452310 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c00bce-9c30-40df-acba-e2dd12c0bbea admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:18.452586 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c00bce-9c30-40df-acba-e2dd12c0bbea admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:18.453423 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c00bce-9c30-40df-acba-e2dd12c0bbea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:18.453731 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c00bce-9c30-40df-acba-e2dd12c0bbea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:18.455306 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c00bce-9c30-40df-acba-e2dd12c0bbea admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:18.473362 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 609/1209] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:18.474719 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea594f-2d7a-44e2-842d-1749e06d2bc3 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:18.485469 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea594f-2d7a-44e2-842d-1749e06d2bc3 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:18.491285 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8226f7-b684-4c3c-a22c-fc81e0b7f19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:18.492123 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8226f7-b684-4c3c-a22c-fc81e0b7f19f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:18.492600 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8226f7-b684-4c3c-a22c-fc81e0b7f19f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:18.492943 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8226f7-b684-4c3c-a22c-fc81e0b7f19f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:18.501860 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8226f7-b684-4c3c-a22c-fc81e0b7f19f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:18.503415 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8226f7-b684-4c3c-a22c-fc81e0b7f19f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:18.521579 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-4e8226f7-b684-4c3c-a22c-fc81e0b7f19f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 10 23:06:18.522935 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 601/1210] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:06:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:18.528780 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c00bce-9c30-40df-acba-e2dd12c0bbea admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:18.539162 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c00bce-9c30-40df-acba-e2dd12c0bbea admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:18.543835 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ff742-304a-4a4e-b583-c067fa72e47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:18.544631 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ff742-304a-4a4e-b583-c067fa72e47c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:18.544937 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ff742-304a-4a4e-b583-c067fa72e47c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:18.545283 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ff742-304a-4a4e-b583-c067fa72e47c admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:18.546286 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ff742-304a-4a4e-b583-c067fa72e47c admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:18.546664 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ff742-304a-4a4e-b583-c067fa72e47c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:18.548690 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ff742-304a-4a4e-b583-c067fa72e47c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:18.569296 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 610/1211] 10.222.0.77 () {56 vars in 1164 bytes} [Thu Feb 10 23:06:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:06:18.575096 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8226f7-b684-4c3c-a22c-fc81e0b7f19f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:18.586917 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8226f7-b684-4c3c-a22c-fc81e0b7f19f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:18.591081 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60369b-57c3-4390-bf15-7b7922f8c0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:18.593426 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60369b-57c3-4390-bf15-7b7922f8c0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:18.593426 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60369b-57c3-4390-bf15-7b7922f8c0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:18.593426 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60369b-57c3-4390-bf15-7b7922f8c0f3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:18.601317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60369b-57c3-4390-bf15-7b7922f8c0f3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:18.603353 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60369b-57c3-4390-bf15-7b7922f8c0f3 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:18.614792 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 602/1212] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:06:18 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:06:18.621067 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ff742-304a-4a4e-b583-c067fa72e47c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:18.633548 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ff742-304a-4a4e-b583-c067fa72e47c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:18.638569 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e3025-f494-4a90-8d36-8a22b7f0775f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:18.639508 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e3025-f494-4a90-8d36-8a22b7f0775f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:18.639917 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e3025-f494-4a90-8d36-8a22b7f0775f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:18.640306 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e3025-f494-4a90-8d36-8a22b7f0775f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:18.654789 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e3025-f494-4a90-8d36-8a22b7f0775f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:18.656847 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e3025-f494-4a90-8d36-8a22b7f0775f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:18.676102 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-556e3025-f494-4a90-8d36-8a22b7f0775f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:06:18.677593 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 611/1213] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:06:18.683744 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60369b-57c3-4390-bf15-7b7922f8c0f3 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:18.694297 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60369b-57c3-4390-bf15-7b7922f8c0f3 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:18.700057 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11caf8e-98d0-4706-a4d0-7d9d05f4d8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:18.700811 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11caf8e-98d0-4706-a4d0-7d9d05f4d8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:18.701205 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11caf8e-98d0-4706-a4d0-7d9d05f4d8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:18.701586 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11caf8e-98d0-4706-a4d0-7d9d05f4d8e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:18.702321 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11caf8e-98d0-4706-a4d0-7d9d05f4d8e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:18.702673 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11caf8e-98d0-4706-a4d0-7d9d05f4d8e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:18.704460 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11caf8e-98d0-4706-a4d0-7d9d05f4d8e8 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:18.718674 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 603/1214] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:18.725039 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e3025-f494-4a90-8d36-8a22b7f0775f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:18.735892 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e3025-f494-4a90-8d36-8a22b7f0775f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:18.743761 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8022059-5128-41d6-8c39-93acee503390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:18.744901 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8022059-5128-41d6-8c39-93acee503390 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:18.745248 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8022059-5128-41d6-8c39-93acee503390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:18.745587 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8022059-5128-41d6-8c39-93acee503390 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:18.756768 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8022059-5128-41d6-8c39-93acee503390 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:18.758783 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8022059-5128-41d6-8c39-93acee503390 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:18.771990 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-f8022059-5128-41d6-8c39-93acee503390 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:06:18.773257 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 612/1215] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:06:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:18.779238 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11caf8e-98d0-4706-a4d0-7d9d05f4d8e8 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:18.790094 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11caf8e-98d0-4706-a4d0-7d9d05f4d8e8 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:18.794593 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2308ad-de38-419b-bff4-02cb7e2aa9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:18.795237 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2308ad-de38-419b-bff4-02cb7e2aa9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:18.795515 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2308ad-de38-419b-bff4-02cb7e2aa9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:18.795786 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2308ad-de38-419b-bff4-02cb7e2aa9b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:18.796644 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2308ad-de38-419b-bff4-02cb7e2aa9b8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:18.796949 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2308ad-de38-419b-bff4-02cb7e2aa9b8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:18.798773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2308ad-de38-419b-bff4-02cb7e2aa9b8 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:18.813055 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 604/1216] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:06:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:18.819231 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8022059-5128-41d6-8c39-93acee503390 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:18.830079 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8022059-5128-41d6-8c39-93acee503390 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:18.835588 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592b52a-a089-448d-bdae-6ec99a9ec50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:18.836409 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592b52a-a089-448d-bdae-6ec99a9ec50f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:18.836739 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592b52a-a089-448d-bdae-6ec99a9ec50f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:18.837047 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592b52a-a089-448d-bdae-6ec99a9ec50f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:18.837906 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592b52a-a089-448d-bdae-6ec99a9ec50f admin admin] RBAC: Adding query filter params (role.id=9924d70543a845cdb7643026789244c3, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=0f5243eef2a24a518b30526425c0b2c4) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:18.838193 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592b52a-a089-448d-bdae-6ec99a9ec50f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:18.840136 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592b52a-a089-448d-bdae-6ec99a9ec50f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:18.851323 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 613/1217] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:06:18 2022] GET /identity/v3/role_assignments?user.id=0f5243eef2a24a518b30526425c0b2c4&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=9924d70543a845cdb7643026789244c3 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:06:21.368374 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7eb94-e230-4ab9-a14d-68bea276b4cf None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:21.368949 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7eb94-e230-4ab9-a14d-68bea276b4cf None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:21.368949 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7eb94-e230-4ab9-a14d-68bea276b4cf None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:21.370961 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 605/1218] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:06:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:06:21.376532 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881c6d9-9b2b-4d37-b547-5bb869edd443 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:21.376958 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881c6d9-9b2b-4d37-b547-5bb869edd443 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:21.377083 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881c6d9-9b2b-4d37-b547-5bb869edd443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:21.397342 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-6881c6d9-9b2b-4d37-b547-5bb869edd443 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:06:21.398669 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-6881c6d9-9b2b-4d37-b547-5bb869edd443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:06:21.407352 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 614/1219] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:06:21 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:06:21.433940 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7eb94-e230-4ab9-a14d-68bea276b4cf None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:21.447694 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7eb94-e230-4ab9-a14d-68bea276b4cf None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:21.452611 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d608144-bb8c-48a4-a00d-ebdec9087776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:21.453473 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d608144-bb8c-48a4-a00d-ebdec9087776 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:21.453751 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d608144-bb8c-48a4-a00d-ebdec9087776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:21.454020 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d608144-bb8c-48a4-a00d-ebdec9087776 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:21.466263 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d608144-bb8c-48a4-a00d-ebdec9087776 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:06:21.474958 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-6d608144-bb8c-48a4-a00d-ebdec9087776 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:06:21.476314 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 606/1220] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:06:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:21.483847 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881c6d9-9b2b-4d37-b547-5bb869edd443 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:21.492702 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881c6d9-9b2b-4d37-b547-5bb869edd443 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:21.497721 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59477bb-efcc-4f6f-8a58-93a9f48954cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:21.498488 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59477bb-efcc-4f6f-8a58-93a9f48954cb admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:21.498804 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59477bb-efcc-4f6f-8a58-93a9f48954cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:21.499114 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59477bb-efcc-4f6f-8a58-93a9f48954cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:21.500041 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59477bb-efcc-4f6f-8a58-93a9f48954cb admin admin] RBAC: Adding query filter params (name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:21.500427 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59477bb-efcc-4f6f-8a58-93a9f48954cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:21.502089 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59477bb-efcc-4f6f-8a58-93a9f48954cb admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:21.512564 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 615/1221] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:06:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:06:21.519703 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d608144-bb8c-48a4-a00d-ebdec9087776 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:21.530777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d608144-bb8c-48a4-a00d-ebdec9087776 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:21.537555 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb230a-0273-4706-9273-072f068f74b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:21.538372 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb230a-0273-4706-9273-072f068f74b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:21.538657 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb230a-0273-4706-9273-072f068f74b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:21.538961 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb230a-0273-4706-9273-072f068f74b9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:21.550409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb230a-0273-4706-9273-072f068f74b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:21.552419 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb230a-0273-4706-9273-072f068f74b9 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:21.572632 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-aacb230a-0273-4706-9273-072f068f74b9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:06:21.573899 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 607/1222] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:21.580090 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59477bb-efcc-4f6f-8a58-93a9f48954cb admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:21.592704 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59477bb-efcc-4f6f-8a58-93a9f48954cb admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:21.598271 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36303c67-2afa-40f3-b375-60b699f7f14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:21.598939 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36303c67-2afa-40f3-b375-60b699f7f14a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:21.599224 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36303c67-2afa-40f3-b375-60b699f7f14a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:21.599501 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36303c67-2afa-40f3-b375-60b699f7f14a admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:21.600279 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36303c67-2afa-40f3-b375-60b699f7f14a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:21.600587 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36303c67-2afa-40f3-b375-60b699f7f14a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:21.602181 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36303c67-2afa-40f3-b375-60b699f7f14a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:21.616141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 616/1223] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:21.622472 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb230a-0273-4706-9273-072f068f74b9 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:21.633227 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb230a-0273-4706-9273-072f068f74b9 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:21.639103 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1a118-7c5d-444a-9ac8-93b344c06832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:21.640076 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1a118-7c5d-444a-9ac8-93b344c06832 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:21.640531 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1a118-7c5d-444a-9ac8-93b344c06832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:21.640901 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1a118-7c5d-444a-9ac8-93b344c06832 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:21.651054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1a118-7c5d-444a-9ac8-93b344c06832 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:21.653555 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1a118-7c5d-444a-9ac8-93b344c06832 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:21.671111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-76b1a118-7c5d-444a-9ac8-93b344c06832 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 10 23:06:21.677406 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 608/1224] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:06:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:21.679154 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36303c67-2afa-40f3-b375-60b699f7f14a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:21.689858 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36303c67-2afa-40f3-b375-60b699f7f14a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:21.695306 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280693a-fad7-4a4f-a79e-a11186d7f2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:21.696133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280693a-fad7-4a4f-a79e-a11186d7f2fd admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:21.696516 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280693a-fad7-4a4f-a79e-a11186d7f2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:21.696879 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280693a-fad7-4a4f-a79e-a11186d7f2fd admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:21.697829 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280693a-fad7-4a4f-a79e-a11186d7f2fd admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:21.698235 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280693a-fad7-4a4f-a79e-a11186d7f2fd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:21.700357 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280693a-fad7-4a4f-a79e-a11186d7f2fd admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:21.723326 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 617/1225] 10.222.0.77 () {56 vars in 1164 bytes} [Thu Feb 10 23:06:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:21.728838 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1a118-7c5d-444a-9ac8-93b344c06832 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:21.740288 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1a118-7c5d-444a-9ac8-93b344c06832 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:21.746679 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a6c28-51e1-4f5b-8925-3522afa75150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:21.747611 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a6c28-51e1-4f5b-8925-3522afa75150 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:21.747935 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a6c28-51e1-4f5b-8925-3522afa75150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:21.748247 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a6c28-51e1-4f5b-8925-3522afa75150 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:21.762693 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a6c28-51e1-4f5b-8925-3522afa75150 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:21.764556 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a6c28-51e1-4f5b-8925-3522afa75150 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:21.785812 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-8b4a6c28-51e1-4f5b-8925-3522afa75150 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:06:21.787015 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 609/1226] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:21.792870 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280693a-fad7-4a4f-a79e-a11186d7f2fd admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:21.804502 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280693a-fad7-4a4f-a79e-a11186d7f2fd admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:21.812628 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a343b-f001-46b9-800e-51e9a9009e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:21.813485 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a343b-f001-46b9-800e-51e9a9009e09 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:21.813922 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a343b-f001-46b9-800e-51e9a9009e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:21.815120 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a343b-f001-46b9-800e-51e9a9009e09 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:21.816121 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a343b-f001-46b9-800e-51e9a9009e09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:21.816572 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a343b-f001-46b9-800e-51e9a9009e09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:21.818297 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a343b-f001-46b9-800e-51e9a9009e09 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:21.829807 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 618/1227] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:06:21.836021 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a6c28-51e1-4f5b-8925-3522afa75150 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:21.847187 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a6c28-51e1-4f5b-8925-3522afa75150 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:21.853342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d79af0-a6a1-45b0-aa32-e69968e9c6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:21.854345 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d79af0-a6a1-45b0-aa32-e69968e9c6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:21.854768 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d79af0-a6a1-45b0-aa32-e69968e9c6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:21.855219 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d79af0-a6a1-45b0-aa32-e69968e9c6b1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:21.863704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d79af0-a6a1-45b0-aa32-e69968e9c6b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:21.866033 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d79af0-a6a1-45b0-aa32-e69968e9c6b1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:21.880424 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-83d79af0-a6a1-45b0-aa32-e69968e9c6b1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:06:21.881697 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 610/1228] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:06:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:06:21.887261 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a343b-f001-46b9-800e-51e9a9009e09 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:21.896933 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a343b-f001-46b9-800e-51e9a9009e09 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:21.901648 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2689e-3010-46c1-85cd-c1c8707d4574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:21.902445 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2689e-3010-46c1-85cd-c1c8707d4574 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:21.902834 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2689e-3010-46c1-85cd-c1c8707d4574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:21.903214 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2689e-3010-46c1-85cd-c1c8707d4574 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:21.904215 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2689e-3010-46c1-85cd-c1c8707d4574 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:21.904644 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2689e-3010-46c1-85cd-c1c8707d4574 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:21.906607 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2689e-3010-46c1-85cd-c1c8707d4574 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:21.922124 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 619/1229] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:06:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:21.929529 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d79af0-a6a1-45b0-aa32-e69968e9c6b1 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:21.943094 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d79af0-a6a1-45b0-aa32-e69968e9c6b1 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:21.948353 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d54db-6df9-488b-85ab-e2f80205a58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:21.949445 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d54db-6df9-488b-85ab-e2f80205a58d admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:21.949861 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d54db-6df9-488b-85ab-e2f80205a58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:21.950229 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d54db-6df9-488b-85ab-e2f80205a58d admin admin] PATH_INFO: `/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/0f5243eef2a24a518b30526425c0b2c4/roles/9924d70543a845cdb7643026789244c3` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:21.967855 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d54db-6df9-488b-85ab-e2f80205a58d admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ab195cc240497c9ac12843d738c4b9, user_id=0f5243eef2a24a518b30526425c0b2c4, role_id=9924d70543a845cdb7643026789244c3)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:21.970642 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d54db-6df9-488b-85ab-e2f80205a58d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:21.985894 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 611/1230] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:06:21 2022] PUT /identity/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/0f5243eef2a24a518b30526425c0b2c4/roles/9924d70543a845cdb7643026789244c3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:06:24.378683 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c407d-b601-4cdc-aa0e-64ad5acf29aa None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:24.379234 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c407d-b601-4cdc-aa0e-64ad5acf29aa None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:24.379234 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c407d-b601-4cdc-aa0e-64ad5acf29aa None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:24.381029 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 620/1231] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:06:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:06:24.386348 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e202193-c99d-43b1-9ede-6017c25062ac None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:24.386788 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e202193-c99d-43b1-9ede-6017c25062ac None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:24.386909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e202193-c99d-43b1-9ede-6017c25062ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:24.405445 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-5e202193-c99d-43b1-9ede-6017c25062ac None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:06:24.406710 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-5e202193-c99d-43b1-9ede-6017c25062ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:06:24.467773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 612/1232] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:06:24 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:06:24.496681 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c407d-b601-4cdc-aa0e-64ad5acf29aa None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:24.510835 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c407d-b601-4cdc-aa0e-64ad5acf29aa None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:24.515322 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5372963-f562-4f3a-ac60-8c6d0106ea04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:24.516114 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5372963-f562-4f3a-ac60-8c6d0106ea04 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:24.516429 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5372963-f562-4f3a-ac60-8c6d0106ea04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:24.516713 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5372963-f562-4f3a-ac60-8c6d0106ea04 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:24.527016 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5372963-f562-4f3a-ac60-8c6d0106ea04 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:06:24.533885 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-c5372963-f562-4f3a-ac60-8c6d0106ea04 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 23:06:24.535057 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 621/1233] 10.222.0.77 () {56 vars in 1123 bytes} [Thu Feb 10 23:06:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:24.541213 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e202193-c99d-43b1-9ede-6017c25062ac None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:24.551102 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e202193-c99d-43b1-9ede-6017c25062ac None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:24.555654 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f4a6e-1cf3-4c5d-b4a4-e676a091b922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:24.556338 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f4a6e-1cf3-4c5d-b4a4-e676a091b922 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:24.556625 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f4a6e-1cf3-4c5d-b4a4-e676a091b922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:24.556908 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f4a6e-1cf3-4c5d-b4a4-e676a091b922 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:24.557661 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f4a6e-1cf3-4c5d-b4a4-e676a091b922 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:24.557968 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f4a6e-1cf3-4c5d-b4a4-e676a091b922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:24.559566 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f4a6e-1cf3-4c5d-b4a4-e676a091b922 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:24.568810 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 613/1234] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Feb 10 23:06:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:24.574617 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5372963-f562-4f3a-ac60-8c6d0106ea04 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:24.584453 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5372963-f562-4f3a-ac60-8c6d0106ea04 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:24.589297 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67843ea-07d2-4026-9ab2-bbe7f7b4dde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:24.590082 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67843ea-07d2-4026-9ab2-bbe7f7b4dde1 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:24.590369 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67843ea-07d2-4026-9ab2-bbe7f7b4dde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:24.590643 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67843ea-07d2-4026-9ab2-bbe7f7b4dde1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:24.601829 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67843ea-07d2-4026-9ab2-bbe7f7b4dde1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:24.603629 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67843ea-07d2-4026-9ab2-bbe7f7b4dde1 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:24.620566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-f67843ea-07d2-4026-9ab2-bbe7f7b4dde1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:06:24.621760 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 622/1235] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:24.628462 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f4a6e-1cf3-4c5d-b4a4-e676a091b922 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:24.639869 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f4a6e-1cf3-4c5d-b4a4-e676a091b922 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:24.644814 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d08124-82ce-4d91-8b71-9978cb0e5176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:24.645541 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d08124-82ce-4d91-8b71-9978cb0e5176 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:24.645981 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d08124-82ce-4d91-8b71-9978cb0e5176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:24.646317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d08124-82ce-4d91-8b71-9978cb0e5176 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:24.647292 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d08124-82ce-4d91-8b71-9978cb0e5176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:24.647631 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d08124-82ce-4d91-8b71-9978cb0e5176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:24.649483 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d08124-82ce-4d91-8b71-9978cb0e5176 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:24.662356 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 614/1236] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:24.669225 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67843ea-07d2-4026-9ab2-bbe7f7b4dde1 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:24.679527 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67843ea-07d2-4026-9ab2-bbe7f7b4dde1 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:24.684349 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11641a4b-e449-4c0e-a490-94fea2ce7834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:24.685134 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641a4b-e449-4c0e-a490-94fea2ce7834 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:24.685414 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641a4b-e449-4c0e-a490-94fea2ce7834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:24.685686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641a4b-e449-4c0e-a490-94fea2ce7834 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:24.694449 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11641a4b-e449-4c0e-a490-94fea2ce7834 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:24.696539 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11641a4b-e449-4c0e-a490-94fea2ce7834 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:24.710038 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-11641a4b-e449-4c0e-a490-94fea2ce7834 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 10 23:06:24.711201 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 623/1237] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:06:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:24.717670 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d08124-82ce-4d91-8b71-9978cb0e5176 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:24.728702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d08124-82ce-4d91-8b71-9978cb0e5176 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:24.734128 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db730a-0d7d-46f2-9b49-2011a338e7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:24.734806 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db730a-0d7d-46f2-9b49-2011a338e7cb admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:24.735078 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db730a-0d7d-46f2-9b49-2011a338e7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:24.735349 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db730a-0d7d-46f2-9b49-2011a338e7cb admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:24.736298 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db730a-0d7d-46f2-9b49-2011a338e7cb admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:24.736721 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db730a-0d7d-46f2-9b49-2011a338e7cb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:24.739535 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db730a-0d7d-46f2-9b49-2011a338e7cb admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:24.759609 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 615/1238] 10.222.0.77 () {56 vars in 1164 bytes} [Thu Feb 10 23:06:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:24.765531 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11641a4b-e449-4c0e-a490-94fea2ce7834 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:24.776157 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11641a4b-e449-4c0e-a490-94fea2ce7834 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:24.780670 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01376289-9263-4e80-a3af-8a3deded5339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:24.781295 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01376289-9263-4e80-a3af-8a3deded5339 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:24.781579 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01376289-9263-4e80-a3af-8a3deded5339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:24.781853 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01376289-9263-4e80-a3af-8a3deded5339 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:24.789946 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01376289-9263-4e80-a3af-8a3deded5339 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:24.791670 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01376289-9263-4e80-a3af-8a3deded5339 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:24.800914 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 624/1239] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:06:24 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:06:24.806742 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db730a-0d7d-46f2-9b49-2011a338e7cb admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:24.817240 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db730a-0d7d-46f2-9b49-2011a338e7cb admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:24.821847 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302498bd-3e70-4cac-8da4-c10544442415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:24.822617 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302498bd-3e70-4cac-8da4-c10544442415 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:24.822904 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302498bd-3e70-4cac-8da4-c10544442415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:24.823182 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302498bd-3e70-4cac-8da4-c10544442415 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:24.834691 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302498bd-3e70-4cac-8da4-c10544442415 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:24.836548 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302498bd-3e70-4cac-8da4-c10544442415 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:24.854582 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-302498bd-3e70-4cac-8da4-c10544442415 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:06:24.855904 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 616/1240] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:06:24.861649 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01376289-9263-4e80-a3af-8a3deded5339 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:24.870824 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01376289-9263-4e80-a3af-8a3deded5339 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:24.875486 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0e3d0-9dd2-455c-8491-01c05c85ec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:24.876166 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0e3d0-9dd2-455c-8491-01c05c85ec21 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:24.876444 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0e3d0-9dd2-455c-8491-01c05c85ec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:24.876717 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0e3d0-9dd2-455c-8491-01c05c85ec21 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:24.877445 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0e3d0-9dd2-455c-8491-01c05c85ec21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:24.878288 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0e3d0-9dd2-455c-8491-01c05c85ec21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:24.879878 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0e3d0-9dd2-455c-8491-01c05c85ec21 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:24.892911 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 625/1241] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:24.899132 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302498bd-3e70-4cac-8da4-c10544442415 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:24.910182 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302498bd-3e70-4cac-8da4-c10544442415 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:24.914742 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9a119-9698-4b99-90b6-f153c900ef25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:24.915601 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9a119-9698-4b99-90b6-f153c900ef25 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:24.916003 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9a119-9698-4b99-90b6-f153c900ef25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:24.916278 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9a119-9698-4b99-90b6-f153c900ef25 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:24.924504 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9a119-9698-4b99-90b6-f153c900ef25 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:24.926799 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9a119-9698-4b99-90b6-f153c900ef25 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:24.941640 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-e0e9a119-9698-4b99-90b6-f153c900ef25 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:06:24.942895 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 617/1242] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:06:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:24.949516 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0e3d0-9dd2-455c-8491-01c05c85ec21 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:24.961274 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0e3d0-9dd2-455c-8491-01c05c85ec21 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:24.966370 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd72c6-c05f-4a3a-8b05-42692848c3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:24.967114 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd72c6-c05f-4a3a-8b05-42692848c3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:24.967413 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd72c6-c05f-4a3a-8b05-42692848c3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:24.967676 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd72c6-c05f-4a3a-8b05-42692848c3c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:24.968519 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd72c6-c05f-4a3a-8b05-42692848c3c4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:24.969011 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd72c6-c05f-4a3a-8b05-42692848c3c4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:24.971054 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd72c6-c05f-4a3a-8b05-42692848c3c4 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:24.984359 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 626/1243] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:06:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:24.991270 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9a119-9698-4b99-90b6-f153c900ef25 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:25.003986 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9a119-9698-4b99-90b6-f153c900ef25 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:25.008724 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac78a0-3a1e-4b31-afe5-ec1e706f3a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:25.009382 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac78a0-3a1e-4b31-afe5-ec1e706f3a01 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:25.009700 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac78a0-3a1e-4b31-afe5-ec1e706f3a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:25.009981 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac78a0-3a1e-4b31-afe5-ec1e706f3a01 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:25.010814 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac78a0-3a1e-4b31-afe5-ec1e706f3a01 admin admin] RBAC: Adding query filter params (role.id=9924d70543a845cdb7643026789244c3, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=0f5243eef2a24a518b30526425c0b2c4) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:25.011125 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac78a0-3a1e-4b31-afe5-ec1e706f3a01 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:25.013242 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac78a0-3a1e-4b31-afe5-ec1e706f3a01 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:25.020297 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 618/1244] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:06:24 2022] GET /identity/v3/role_assignments?user.id=0f5243eef2a24a518b30526425c0b2c4&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=9924d70543a845cdb7643026789244c3 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:27.316171 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bedd96-687f-4780-a002-47689bf5cf65 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:27.316759 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bedd96-687f-4780-a002-47689bf5cf65 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:27.316881 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bedd96-687f-4780-a002-47689bf5cf65 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:27.319405 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 627/1245] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:06:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:06:27.326728 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24de287-fce7-4927-980e-bd54e9c6e105 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:27.327194 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24de287-fce7-4927-980e-bd54e9c6e105 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:27.327303 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24de287-fce7-4927-980e-bd54e9c6e105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:27.345258 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-b24de287-fce7-4927-980e-bd54e9c6e105 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:06:27.347125 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-b24de287-fce7-4927-980e-bd54e9c6e105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:06:27.356615 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 619/1246] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:06:27 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:06:27.381291 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bedd96-687f-4780-a002-47689bf5cf65 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:27.395974 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bedd96-687f-4780-a002-47689bf5cf65 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:27.400883 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1802ac-866e-4a0c-a49b-022abf7f9ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:27.401676 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1802ac-866e-4a0c-a49b-022abf7f9ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:27.401985 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1802ac-866e-4a0c-a49b-022abf7f9ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:27.402270 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1802ac-866e-4a0c-a49b-022abf7f9ab6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:27.414105 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1802ac-866e-4a0c-a49b-022abf7f9ab6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:06:27.422385 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-9f1802ac-866e-4a0c-a49b-022abf7f9ab6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:06:27.423735 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 628/1247] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:06:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:27.430063 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24de287-fce7-4927-980e-bd54e9c6e105 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:27.438915 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24de287-fce7-4927-980e-bd54e9c6e105 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:27.443597 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089b2ae-af70-4cf0-b2a0-cf41bb7106ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:27.444263 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089b2ae-af70-4cf0-b2a0-cf41bb7106ec admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:27.444547 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089b2ae-af70-4cf0-b2a0-cf41bb7106ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:27.444819 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089b2ae-af70-4cf0-b2a0-cf41bb7106ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:27.445569 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089b2ae-af70-4cf0-b2a0-cf41bb7106ec admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:27.445876 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089b2ae-af70-4cf0-b2a0-cf41bb7106ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:27.447453 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089b2ae-af70-4cf0-b2a0-cf41bb7106ec admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:27.456489 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 620/1248] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:06:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:06:27.462397 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1802ac-866e-4a0c-a49b-022abf7f9ab6 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:27.473303 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1802ac-866e-4a0c-a49b-022abf7f9ab6 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:27.477956 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295afc4b-2a8f-4206-a1c4-68bf8a390d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:27.478721 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295afc4b-2a8f-4206-a1c4-68bf8a390d93 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:27.479007 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295afc4b-2a8f-4206-a1c4-68bf8a390d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:27.479282 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295afc4b-2a8f-4206-a1c4-68bf8a390d93 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:27.490197 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295afc4b-2a8f-4206-a1c4-68bf8a390d93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:27.492050 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295afc4b-2a8f-4206-a1c4-68bf8a390d93 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:27.508837 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-295afc4b-2a8f-4206-a1c4-68bf8a390d93 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:06:27.514710 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 629/1249] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:27.515948 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089b2ae-af70-4cf0-b2a0-cf41bb7106ec admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:27.526319 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089b2ae-af70-4cf0-b2a0-cf41bb7106ec admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:27.531292 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b271c-896c-41c5-b299-dd568aa598ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:27.531982 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b271c-896c-41c5-b299-dd568aa598ef admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:27.532269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b271c-896c-41c5-b299-dd568aa598ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:27.532610 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b271c-896c-41c5-b299-dd568aa598ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:27.533288 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b271c-896c-41c5-b299-dd568aa598ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:27.533592 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b271c-896c-41c5-b299-dd568aa598ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:27.535829 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b271c-896c-41c5-b299-dd568aa598ef admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:27.547832 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 621/1250] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:27.553877 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295afc4b-2a8f-4206-a1c4-68bf8a390d93 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:27.563632 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295afc4b-2a8f-4206-a1c4-68bf8a390d93 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:27.568528 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4dc43-f600-4874-903b-408b967cd33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:27.569310 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4dc43-f600-4874-903b-408b967cd33a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:27.569596 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4dc43-f600-4874-903b-408b967cd33a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:27.569872 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4dc43-f600-4874-903b-408b967cd33a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:27.577303 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4dc43-f600-4874-903b-408b967cd33a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:27.579300 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4dc43-f600-4874-903b-408b967cd33a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:27.594279 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-86c4dc43-f600-4874-903b-408b967cd33a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 10 23:06:27.595546 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 630/1251] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:06:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:27.602175 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b271c-896c-41c5-b299-dd568aa598ef admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:27.613291 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b271c-896c-41c5-b299-dd568aa598ef admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:27.618675 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c9279-1579-4662-861a-a3094b3ebb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:27.619500 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c9279-1579-4662-861a-a3094b3ebb76 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:27.620005 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c9279-1579-4662-861a-a3094b3ebb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:27.620451 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c9279-1579-4662-861a-a3094b3ebb76 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:27.621677 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c9279-1579-4662-861a-a3094b3ebb76 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:27.622130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c9279-1579-4662-861a-a3094b3ebb76 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:27.624273 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c9279-1579-4662-861a-a3094b3ebb76 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:27.644062 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 622/1252] 10.222.0.77 () {56 vars in 1164 bytes} [Thu Feb 10 23:06:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:06:27.649775 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4dc43-f600-4874-903b-408b967cd33a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:27.660266 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4dc43-f600-4874-903b-408b967cd33a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:27.665137 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83b66b-97a5-49f8-89f8-638045d95f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:27.665780 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83b66b-97a5-49f8-89f8-638045d95f66 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:27.666082 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83b66b-97a5-49f8-89f8-638045d95f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:27.666392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83b66b-97a5-49f8-89f8-638045d95f66 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:27.674889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83b66b-97a5-49f8-89f8-638045d95f66 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:27.676646 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83b66b-97a5-49f8-89f8-638045d95f66 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:27.692533 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 631/1253] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:06:27 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:06:27.693764 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c9279-1579-4662-861a-a3094b3ebb76 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:27.704426 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c9279-1579-4662-861a-a3094b3ebb76 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:27.710783 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0258b1-af26-4476-9c28-b96a1a5167a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:27.711621 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0258b1-af26-4476-9c28-b96a1a5167a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:27.711936 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0258b1-af26-4476-9c28-b96a1a5167a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:27.712324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0258b1-af26-4476-9c28-b96a1a5167a2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:27.725237 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0258b1-af26-4476-9c28-b96a1a5167a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:27.727082 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0258b1-af26-4476-9c28-b96a1a5167a2 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:27.745609 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-cf0258b1-af26-4476-9c28-b96a1a5167a2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:06:27.746942 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 623/1254] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:27.752920 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83b66b-97a5-49f8-89f8-638045d95f66 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:27.762253 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83b66b-97a5-49f8-89f8-638045d95f66 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:27.766902 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d95873-2519-4e80-b8b6-b5dafdffc8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:27.767540 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d95873-2519-4e80-b8b6-b5dafdffc8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:27.767835 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d95873-2519-4e80-b8b6-b5dafdffc8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:27.768660 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d95873-2519-4e80-b8b6-b5dafdffc8e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:27.769483 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d95873-2519-4e80-b8b6-b5dafdffc8e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:27.769790 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d95873-2519-4e80-b8b6-b5dafdffc8e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:27.771349 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d95873-2519-4e80-b8b6-b5dafdffc8e7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:27.783335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 632/1255] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:27.789561 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0258b1-af26-4476-9c28-b96a1a5167a2 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:27.799176 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0258b1-af26-4476-9c28-b96a1a5167a2 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:27.804033 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031a816-dce5-45d7-8c44-c914338c65b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:27.804952 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031a816-dce5-45d7-8c44-c914338c65b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:27.805380 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031a816-dce5-45d7-8c44-c914338c65b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:27.805702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031a816-dce5-45d7-8c44-c914338c65b2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:27.813373 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031a816-dce5-45d7-8c44-c914338c65b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:27.816049 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031a816-dce5-45d7-8c44-c914338c65b2 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:27.829098 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-3031a816-dce5-45d7-8c44-c914338c65b2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:06:27.830263 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 624/1256] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:06:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:27.836819 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d95873-2519-4e80-b8b6-b5dafdffc8e7 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:27.847245 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d95873-2519-4e80-b8b6-b5dafdffc8e7 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:27.852364 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ea50a-cee8-4067-85e5-a98865cdded2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:27.853014 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ea50a-cee8-4067-85e5-a98865cdded2 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:27.853321 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ea50a-cee8-4067-85e5-a98865cdded2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:27.853598 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ea50a-cee8-4067-85e5-a98865cdded2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:27.854399 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ea50a-cee8-4067-85e5-a98865cdded2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:27.854710 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ea50a-cee8-4067-85e5-a98865cdded2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:27.857714 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ea50a-cee8-4067-85e5-a98865cdded2 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:27.869778 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 633/1257] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:06:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:27.875838 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031a816-dce5-45d7-8c44-c914338c65b2 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:27.886873 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031a816-dce5-45d7-8c44-c914338c65b2 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:27.891746 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71200f-60bf-4e1a-98ae-499376b0073d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:27.892434 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71200f-60bf-4e1a-98ae-499376b0073d admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:27.892735 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71200f-60bf-4e1a-98ae-499376b0073d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:27.893028 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71200f-60bf-4e1a-98ae-499376b0073d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:27.894035 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71200f-60bf-4e1a-98ae-499376b0073d admin admin] RBAC: Adding query filter params (role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=0f5243eef2a24a518b30526425c0b2c4) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:27.894347 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71200f-60bf-4e1a-98ae-499376b0073d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:27.896231 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71200f-60bf-4e1a-98ae-499376b0073d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:27.902258 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 625/1258] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:06:27 2022] GET /identity/v3/role_assignments?user.id=0f5243eef2a24a518b30526425c0b2c4&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:30.106465 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d5684-7c99-41dc-aa52-40b6462e4b16 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:30.107127 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d5684-7c99-41dc-aa52-40b6462e4b16 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:30.107127 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d5684-7c99-41dc-aa52-40b6462e4b16 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:30.108809 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 634/1259] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:06:30.114406 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc2ba0-4608-4eae-8f55-a5f84ca8f333 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:30.114859 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc2ba0-4608-4eae-8f55-a5f84ca8f333 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:30.114973 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc2ba0-4608-4eae-8f55-a5f84ca8f333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:30.132640 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-f7dc2ba0-4608-4eae-8f55-a5f84ca8f333 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:06:30.133853 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-f7dc2ba0-4608-4eae-8f55-a5f84ca8f333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:06:30.141727 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 626/1260] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:06:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:06:30.165718 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d5684-7c99-41dc-aa52-40b6462e4b16 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:30.178293 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d5684-7c99-41dc-aa52-40b6462e4b16 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:30.183283 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adaf09-791b-47f1-bd35-8adf548e4ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:30.184085 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adaf09-791b-47f1-bd35-8adf548e4ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:30.184368 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adaf09-791b-47f1-bd35-8adf548e4ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:30.184643 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adaf09-791b-47f1-bd35-8adf548e4ba6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:30.196133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43adaf09-791b-47f1-bd35-8adf548e4ba6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:06:30.204051 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-43adaf09-791b-47f1-bd35-8adf548e4ba6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:06:30.206312 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 635/1261] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:06:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:30.212191 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc2ba0-4608-4eae-8f55-a5f84ca8f333 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:30.221833 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc2ba0-4608-4eae-8f55-a5f84ca8f333 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:30.226919 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c27f4-cc73-4dbe-a7da-a67df632435b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:30.227644 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c27f4-cc73-4dbe-a7da-a67df632435b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:30.228040 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c27f4-cc73-4dbe-a7da-a67df632435b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:30.228385 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c27f4-cc73-4dbe-a7da-a67df632435b admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:30.229227 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c27f4-cc73-4dbe-a7da-a67df632435b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:30.229540 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c27f4-cc73-4dbe-a7da-a67df632435b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:30.231130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c27f4-cc73-4dbe-a7da-a67df632435b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:30.241577 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 627/1262] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:06:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:30.247534 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adaf09-791b-47f1-bd35-8adf548e4ba6 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:30.258779 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adaf09-791b-47f1-bd35-8adf548e4ba6 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:30.265050 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf1a5d-8a1b-4392-8ea0-0ffe28c3e078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:30.265877 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf1a5d-8a1b-4392-8ea0-0ffe28c3e078 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:30.266161 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf1a5d-8a1b-4392-8ea0-0ffe28c3e078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:30.266433 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf1a5d-8a1b-4392-8ea0-0ffe28c3e078 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:30.278292 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf1a5d-8a1b-4392-8ea0-0ffe28c3e078 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:30.280375 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf1a5d-8a1b-4392-8ea0-0ffe28c3e078 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:30.297980 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-3ebf1a5d-8a1b-4392-8ea0-0ffe28c3e078 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:06:30.299322 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 636/1263] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:06:30.305657 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c27f4-cc73-4dbe-a7da-a67df632435b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:30.319332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c27f4-cc73-4dbe-a7da-a67df632435b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:30.326591 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023a391-7ce9-4e39-a6dc-4dd08bdd002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:30.327735 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023a391-7ce9-4e39-a6dc-4dd08bdd002c admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:30.328286 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023a391-7ce9-4e39-a6dc-4dd08bdd002c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:30.328651 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023a391-7ce9-4e39-a6dc-4dd08bdd002c admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:30.329872 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023a391-7ce9-4e39-a6dc-4dd08bdd002c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:30.330460 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023a391-7ce9-4e39-a6dc-4dd08bdd002c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:30.333952 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023a391-7ce9-4e39-a6dc-4dd08bdd002c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:30.356346 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 628/1264] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:30.357611 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf1a5d-8a1b-4392-8ea0-0ffe28c3e078 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:30.368428 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf1a5d-8a1b-4392-8ea0-0ffe28c3e078 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:30.373078 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f959954-4431-4d4f-a8c9-328ad7969901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:30.373887 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f959954-4431-4d4f-a8c9-328ad7969901 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:30.374171 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f959954-4431-4d4f-a8c9-328ad7969901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:30.374437 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f959954-4431-4d4f-a8c9-328ad7969901 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:30.383242 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f959954-4431-4d4f-a8c9-328ad7969901 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:30.385412 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f959954-4431-4d4f-a8c9-328ad7969901 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:30.400870 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-9f959954-4431-4d4f-a8c9-328ad7969901 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 10 23:06:30.402215 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 637/1265] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:06:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:30.408956 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023a391-7ce9-4e39-a6dc-4dd08bdd002c admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:30.420637 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023a391-7ce9-4e39-a6dc-4dd08bdd002c admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:30.425797 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83615dd-db7e-4a35-982f-62f7b2bce6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:30.426446 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83615dd-db7e-4a35-982f-62f7b2bce6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:30.426725 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83615dd-db7e-4a35-982f-62f7b2bce6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:30.427059 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83615dd-db7e-4a35-982f-62f7b2bce6f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:30.428122 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83615dd-db7e-4a35-982f-62f7b2bce6f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:30.428482 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83615dd-db7e-4a35-982f-62f7b2bce6f7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:30.430691 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83615dd-db7e-4a35-982f-62f7b2bce6f7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:30.451047 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 629/1266] 10.222.0.77 () {56 vars in 1164 bytes} [Thu Feb 10 23:06:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:30.457205 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f959954-4431-4d4f-a8c9-328ad7969901 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:30.467029 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f959954-4431-4d4f-a8c9-328ad7969901 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:30.472151 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9d381-4859-41d0-b50a-b9647854f70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:30.472954 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9d381-4859-41d0-b50a-b9647854f70a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:30.473244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9d381-4859-41d0-b50a-b9647854f70a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:30.473511 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9d381-4859-41d0-b50a-b9647854f70a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:30.484447 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9d381-4859-41d0-b50a-b9647854f70a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:30.486259 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9d381-4859-41d0-b50a-b9647854f70a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:30.505627 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-b0a9d381-4859-41d0-b50a-b9647854f70a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:06:30.506800 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 638/1267] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:30.512804 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83615dd-db7e-4a35-982f-62f7b2bce6f7 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:30.523078 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83615dd-db7e-4a35-982f-62f7b2bce6f7 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:30.527932 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7293cb-6350-430c-8da7-7a5be0878426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:30.528577 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7293cb-6350-430c-8da7-7a5be0878426 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:30.528857 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7293cb-6350-430c-8da7-7a5be0878426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:30.529128 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7293cb-6350-430c-8da7-7a5be0878426 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:30.529859 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7293cb-6350-430c-8da7-7a5be0878426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:30.530153 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7293cb-6350-430c-8da7-7a5be0878426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:30.531717 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7293cb-6350-430c-8da7-7a5be0878426 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:30.543783 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 630/1268] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:30.550724 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9d381-4859-41d0-b50a-b9647854f70a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:30.561679 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9d381-4859-41d0-b50a-b9647854f70a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:30.567205 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e66165-b6b5-4643-80e8-1512bade3d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:30.568076 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e66165-b6b5-4643-80e8-1512bade3d60 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:30.568414 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e66165-b6b5-4643-80e8-1512bade3d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:30.568707 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e66165-b6b5-4643-80e8-1512bade3d60 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:30.575998 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e66165-b6b5-4643-80e8-1512bade3d60 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:30.578168 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e66165-b6b5-4643-80e8-1512bade3d60 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:30.591632 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-13e66165-b6b5-4643-80e8-1512bade3d60 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:06:30.593123 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 639/1269] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:06:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:30.598965 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7293cb-6350-430c-8da7-7a5be0878426 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:30.610093 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7293cb-6350-430c-8da7-7a5be0878426 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:30.616562 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872cc31-ac8d-47da-81bc-08eda73051c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:30.617307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872cc31-ac8d-47da-81bc-08eda73051c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:30.617640 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872cc31-ac8d-47da-81bc-08eda73051c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:30.617987 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872cc31-ac8d-47da-81bc-08eda73051c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:30.618927 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872cc31-ac8d-47da-81bc-08eda73051c1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:30.619312 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872cc31-ac8d-47da-81bc-08eda73051c1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:30.621187 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872cc31-ac8d-47da-81bc-08eda73051c1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:30.635712 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 631/1270] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:06:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:30.641889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e66165-b6b5-4643-80e8-1512bade3d60 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:30.654784 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e66165-b6b5-4643-80e8-1512bade3d60 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:30.659903 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3944dd-7e40-4ac5-ae93-d1c23f9938ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:30.660825 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3944dd-7e40-4ac5-ae93-d1c23f9938ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:30.661123 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3944dd-7e40-4ac5-ae93-d1c23f9938ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:30.661440 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3944dd-7e40-4ac5-ae93-d1c23f9938ea admin admin] PATH_INFO: `/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/0f5243eef2a24a518b30526425c0b2c4/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:30.663600 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3944dd-7e40-4ac5-ae93-d1c23f9938ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ab195cc240497c9ac12843d738c4b9, user_id=0f5243eef2a24a518b30526425c0b2c4, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:30.666449 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3944dd-7e40-4ac5-ae93-d1c23f9938ea admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:30.680337 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 640/1271] 10.222.0.77 () {58 vars in 1460 bytes} [Thu Feb 10 23:06:30 2022] PUT /identity/v3/projects/29ab195cc240497c9ac12843d738c4b9/users/0f5243eef2a24a518b30526425c0b2c4/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:06:32.932422 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2052f-7bcc-430a-8389-09cdbe2d1f59 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:32.933016 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2052f-7bcc-430a-8389-09cdbe2d1f59 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:32.933016 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2052f-7bcc-430a-8389-09cdbe2d1f59 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:32.934946 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 632/1272] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:06:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:06:32.940603 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2974b-e899-4169-ab9b-c464d9b273db None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:32.941247 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2974b-e899-4169-ab9b-c464d9b273db None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:32.941247 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2974b-e899-4169-ab9b-c464d9b273db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:32.959204 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-32b2974b-e899-4169-ab9b-c464d9b273db None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:06:32.960420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-32b2974b-e899-4169-ab9b-c464d9b273db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:06:33.021542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 641/1273] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:06:32 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:06:33.046251 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2052f-7bcc-430a-8389-09cdbe2d1f59 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:33.058468 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2052f-7bcc-430a-8389-09cdbe2d1f59 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:33.062998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51793a8f-aab4-4e4d-9dc4-3f5114af0f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:33.063776 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51793a8f-aab4-4e4d-9dc4-3f5114af0f7f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:33.064090 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51793a8f-aab4-4e4d-9dc4-3f5114af0f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:33.064365 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51793a8f-aab4-4e4d-9dc4-3f5114af0f7f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:33.076521 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51793a8f-aab4-4e4d-9dc4-3f5114af0f7f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 23:06:33.083541 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-51793a8f-aab4-4e4d-9dc4-3f5114af0f7f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 23:06:33.084972 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 633/1274] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Feb 10 23:06:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 23:06:33.090746 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2974b-e899-4169-ab9b-c464d9b273db None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:33.100844 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2974b-e899-4169-ab9b-c464d9b273db None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:33.105465 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abed2f6-6919-410c-944d-90d97dd86bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:33.106119 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abed2f6-6919-410c-944d-90d97dd86bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:33.106404 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abed2f6-6919-410c-944d-90d97dd86bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:33.106678 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abed2f6-6919-410c-944d-90d97dd86bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:33.107459 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abed2f6-6919-410c-944d-90d97dd86bf0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:33.107769 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abed2f6-6919-410c-944d-90d97dd86bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:33.109611 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abed2f6-6919-410c-944d-90d97dd86bf0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:33.119983 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 642/1275] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Feb 10 23:06:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:33.125893 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51793a8f-aab4-4e4d-9dc4-3f5114af0f7f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:33.136277 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51793a8f-aab4-4e4d-9dc4-3f5114af0f7f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:33.140947 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe753e0-88de-4cd5-964b-24e0ae74f793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:33.141748 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe753e0-88de-4cd5-964b-24e0ae74f793 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:33.142033 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe753e0-88de-4cd5-964b-24e0ae74f793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:33.142311 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe753e0-88de-4cd5-964b-24e0ae74f793 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:33.154484 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe753e0-88de-4cd5-964b-24e0ae74f793 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:33.156395 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe753e0-88de-4cd5-964b-24e0ae74f793 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:33.175065 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-efe753e0-88de-4cd5-964b-24e0ae74f793 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:06:33.176352 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 634/1276] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:33.182393 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abed2f6-6919-410c-944d-90d97dd86bf0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:33.192787 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abed2f6-6919-410c-944d-90d97dd86bf0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:33.197356 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb4861-ad7e-4f0a-b959-4980c7f8956f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:33.198028 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb4861-ad7e-4f0a-b959-4980c7f8956f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:33.198312 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb4861-ad7e-4f0a-b959-4980c7f8956f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:33.198587 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb4861-ad7e-4f0a-b959-4980c7f8956f admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:33.199338 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb4861-ad7e-4f0a-b959-4980c7f8956f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:33.199642 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb4861-ad7e-4f0a-b959-4980c7f8956f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:33.201269 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb4861-ad7e-4f0a-b959-4980c7f8956f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:33.213748 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 643/1277] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:33.219612 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe753e0-88de-4cd5-964b-24e0ae74f793 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:33.230285 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe753e0-88de-4cd5-964b-24e0ae74f793 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:33.234988 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11c068-7fff-4eb9-949f-04f492b5ac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:33.235810 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11c068-7fff-4eb9-949f-04f492b5ac08 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:33.236123 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11c068-7fff-4eb9-949f-04f492b5ac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:33.236397 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11c068-7fff-4eb9-949f-04f492b5ac08 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:33.246272 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11c068-7fff-4eb9-949f-04f492b5ac08 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:33.248363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11c068-7fff-4eb9-949f-04f492b5ac08 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:33.263600 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-ab11c068-7fff-4eb9-949f-04f492b5ac08 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 10 23:06:33.264883 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 635/1278] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:06:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:33.271453 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb4861-ad7e-4f0a-b959-4980c7f8956f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:33.281596 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb4861-ad7e-4f0a-b959-4980c7f8956f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:33.286494 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c3645-8ee7-408a-aedd-feaed94a3134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:33.287161 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c3645-8ee7-408a-aedd-feaed94a3134 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:33.287443 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c3645-8ee7-408a-aedd-feaed94a3134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:33.287718 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c3645-8ee7-408a-aedd-feaed94a3134 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:33.288614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c3645-8ee7-408a-aedd-feaed94a3134 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:33.288923 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c3645-8ee7-408a-aedd-feaed94a3134 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:33.290783 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c3645-8ee7-408a-aedd-feaed94a3134 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:33.312006 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 644/1279] 10.222.0.77 () {56 vars in 1164 bytes} [Thu Feb 10 23:06:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:33.318848 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11c068-7fff-4eb9-949f-04f492b5ac08 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:33.330203 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11c068-7fff-4eb9-949f-04f492b5ac08 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:33.336288 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a7043-d855-4c6f-90ea-968fbd9f6046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:33.337105 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a7043-d855-4c6f-90ea-968fbd9f6046 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:33.337418 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a7043-d855-4c6f-90ea-968fbd9f6046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:33.337732 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a7043-d855-4c6f-90ea-968fbd9f6046 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:33.347435 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a7043-d855-4c6f-90ea-968fbd9f6046 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:33.349431 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a7043-d855-4c6f-90ea-968fbd9f6046 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:33.359382 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 636/1280] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Feb 10 23:06:33 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:06:33.365570 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c3645-8ee7-408a-aedd-feaed94a3134 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:33.375532 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c3645-8ee7-408a-aedd-feaed94a3134 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:33.380799 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6517433-d6cf-4e2e-af87-913b20a98cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:33.381586 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6517433-d6cf-4e2e-af87-913b20a98cde admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:33.381869 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6517433-d6cf-4e2e-af87-913b20a98cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:33.382141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6517433-d6cf-4e2e-af87-913b20a98cde admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:33.393174 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6517433-d6cf-4e2e-af87-913b20a98cde admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:33.395016 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6517433-d6cf-4e2e-af87-913b20a98cde admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:33.412472 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-e6517433-d6cf-4e2e-af87-913b20a98cde admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 23:06:33.413719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 645/1281] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Feb 10 23:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:33.419668 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a7043-d855-4c6f-90ea-968fbd9f6046 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:33.429348 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a7043-d855-4c6f-90ea-968fbd9f6046 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:33.434073 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8146dc6-f9cc-404c-bbcf-05c333526271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:33.434741 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8146dc6-f9cc-404c-bbcf-05c333526271 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:33.435020 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8146dc6-f9cc-404c-bbcf-05c333526271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:33.435307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8146dc6-f9cc-404c-bbcf-05c333526271 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:33.436062 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8146dc6-f9cc-404c-bbcf-05c333526271 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:33.436363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8146dc6-f9cc-404c-bbcf-05c333526271 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:33.437961 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8146dc6-f9cc-404c-bbcf-05c333526271 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:33.451434 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 637/1282] 10.222.0.77 () {56 vars in 1130 bytes} [Thu Feb 10 23:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:33.457204 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6517433-d6cf-4e2e-af87-913b20a98cde admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:33.467198 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6517433-d6cf-4e2e-af87-913b20a98cde admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:33.472030 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2769d-9c5e-4754-8eb5-9db86e586010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:33.472819 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2769d-9c5e-4754-8eb5-9db86e586010 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:33.473100 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2769d-9c5e-4754-8eb5-9db86e586010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:33.473369 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2769d-9c5e-4754-8eb5-9db86e586010 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:33.480586 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2769d-9c5e-4754-8eb5-9db86e586010 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:33.482515 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2769d-9c5e-4754-8eb5-9db86e586010 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:33.496482 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING keystone.server.flask.application [None req-8ef2769d-9c5e-4754-8eb5-9db86e586010 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 23:06:33.497667 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 646/1283] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Feb 10 23:06:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:33.504348 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8146dc6-f9cc-404c-bbcf-05c333526271 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:33.513894 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8146dc6-f9cc-404c-bbcf-05c333526271 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:33.518457 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586edc58-1fb7-4be7-8727-2aa640d3ef93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:33.519094 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586edc58-1fb7-4be7-8727-2aa640d3ef93 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:33.519373 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586edc58-1fb7-4be7-8727-2aa640d3ef93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:33.519649 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586edc58-1fb7-4be7-8727-2aa640d3ef93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:33.520461 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586edc58-1fb7-4be7-8727-2aa640d3ef93 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:33.520766 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586edc58-1fb7-4be7-8727-2aa640d3ef93 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:33.522586 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586edc58-1fb7-4be7-8727-2aa640d3ef93 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:33.534225 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 638/1284] 10.222.0.77 () {56 vars in 1169 bytes} [Thu Feb 10 23:06:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:33.540317 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2769d-9c5e-4754-8eb5-9db86e586010 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:33.552632 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2769d-9c5e-4754-8eb5-9db86e586010 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:33.557127 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefe9a9-8848-4584-b0e4-65c12ee73766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:33.557756 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefe9a9-8848-4584-b0e4-65c12ee73766 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:33.558034 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefe9a9-8848-4584-b0e4-65c12ee73766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:33.558302 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefe9a9-8848-4584-b0e4-65c12ee73766 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:33.559133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefe9a9-8848-4584-b0e4-65c12ee73766 admin admin] RBAC: Adding query filter params (role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f, scope.project.id=29ab195cc240497c9ac12843d738c4b9, user.id=0f5243eef2a24a518b30526425c0b2c4) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:33.559436 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefe9a9-8848-4584-b0e4-65c12ee73766 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:33.561329 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefe9a9-8848-4584-b0e4-65c12ee73766 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:33.567396 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 647/1285] 10.222.0.77 () {56 vars in 1395 bytes} [Thu Feb 10 23:06:33 2022] GET /identity/v3/role_assignments?user.id=0f5243eef2a24a518b30526425c0b2c4&scope.project.id=29ab195cc240497c9ac12843d738c4b9&role.id=c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:35.875099 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a1cc3-e888-4ac8-ad24-7c72b292bef8 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:35.875657 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a1cc3-e888-4ac8-ad24-7c72b292bef8 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:35.875657 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a1cc3-e888-4ac8-ad24-7c72b292bef8 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:35.877456 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 639/1286] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:06:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:06:35.883498 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbd531-2383-4cf6-85f0-2f264e50bf3f None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:35.883969 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbd531-2383-4cf6-85f0-2f264e50bf3f None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:35.884063 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbd531-2383-4cf6-85f0-2f264e50bf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:35.901355 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-0adbd531-2383-4cf6-85f0-2f264e50bf3f None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:06:35.902520 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-0adbd531-2383-4cf6-85f0-2f264e50bf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:06:35.909997 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 648/1287] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:06:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:06:35.932894 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a1cc3-e888-4ac8-ad24-7c72b292bef8 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:35.945465 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a1cc3-e888-4ac8-ad24-7c72b292bef8 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:35.949715 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373b061-d261-432d-a85d-0e9fd42b30a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:35.950474 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373b061-d261-432d-a85d-0e9fd42b30a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:35.950754 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373b061-d261-432d-a85d-0e9fd42b30a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:35.951022 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373b061-d261-432d-a85d-0e9fd42b30a8 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:35.951671 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373b061-d261-432d-a85d-0e9fd42b30a8 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:35.953277 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373b061-d261-432d-a85d-0e9fd42b30a8 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:35.964060 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-c373b061-d261-432d-a85d-0e9fd42b30a8 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 10 23:06:35.965188 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 640/1288] 10.222.0.77 () {56 vars in 1138 bytes} [Thu Feb 10 23:06:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:35.970766 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbd531-2383-4cf6-85f0-2f264e50bf3f None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:35.979660 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbd531-2383-4cf6-85f0-2f264e50bf3f None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:35.984153 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3a92f-c761-456b-99ce-69809605cb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:35.984789 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3a92f-c761-456b-99ce-69809605cb45 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:35.985075 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3a92f-c761-456b-99ce-69809605cb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:35.985352 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3a92f-c761-456b-99ce-69809605cb45 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:35.986066 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3a92f-c761-456b-99ce-69809605cb45 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:35.986374 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3a92f-c761-456b-99ce-69809605cb45 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:35.989095 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3a92f-c761-456b-99ce-69809605cb45 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:35.993802 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 649/1289] 10.222.0.77 () {56 vars in 1137 bytes} [Thu Feb 10 23:06:35 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:35.998919 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373b061-d261-432d-a85d-0e9fd42b30a8 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:36.008671 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373b061-d261-432d-a85d-0e9fd42b30a8 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:36.013080 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03f271-29c0-4f8c-a17d-f5f49cfae6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:36.013693 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03f271-29c0-4f8c-a17d-f5f49cfae6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:36.013974 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03f271-29c0-4f8c-a17d-f5f49cfae6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:36.014249 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03f271-29c0-4f8c-a17d-f5f49cfae6b1 admin admin] PATH_INFO: `/v3/services` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:36.014940 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03f271-29c0-4f8c-a17d-f5f49cfae6b1 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:36.015241 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03f271-29c0-4f8c-a17d-f5f49cfae6b1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:36.016806 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03f271-29c0-4f8c-a17d-f5f49cfae6b1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:36.020985 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 641/1290] 10.222.0.77 () {56 vars in 1137 bytes} [Thu Feb 10 23:06:35 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:38.234364 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82f58c-3b5f-438d-acb3-33af9cfa07ab None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:38.234882 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82f58c-3b5f-438d-acb3-33af9cfa07ab None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:38.234882 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82f58c-3b5f-438d-acb3-33af9cfa07ab None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:38.236739 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 650/1291] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:06:38.242374 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d6fee-5586-4e0e-80fd-993e1d8b153d None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:38.242779 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d6fee-5586-4e0e-80fd-993e1d8b153d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:38.242930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d6fee-5586-4e0e-80fd-993e1d8b153d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:38.260265 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-4e3d6fee-5586-4e0e-80fd-993e1d8b153d None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:06:38.261437 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-4e3d6fee-5586-4e0e-80fd-993e1d8b153d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:06:38.269615 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 642/1292] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:06:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:06:38.292743 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82f58c-3b5f-438d-acb3-33af9cfa07ab None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:38.305565 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82f58c-3b5f-438d-acb3-33af9cfa07ab None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:38.310071 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b86a62-e51f-4b44-8ee4-1f051872bf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:38.310708 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b86a62-e51f-4b44-8ee4-1f051872bf4a admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:38.310993 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b86a62-e51f-4b44-8ee4-1f051872bf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:38.311274 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b86a62-e51f-4b44-8ee4-1f051872bf4a admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:38.312049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b86a62-e51f-4b44-8ee4-1f051872bf4a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:38.313636 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b86a62-e51f-4b44-8ee4-1f051872bf4a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:38.329822 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 651/1293] 10.222.0.77 () {60 vars in 1162 bytes} [Thu Feb 10 23:06:38 2022] POST /identity/v3/services => generated 246 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:06:40.538293 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d8891-376c-411e-bdb0-c616e555dac2 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:40.538824 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d8891-376c-411e-bdb0-c616e555dac2 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:40.538824 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d8891-376c-411e-bdb0-c616e555dac2 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:40.540643 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 643/1294] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:06:40.545837 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8337ce1-4e0d-44a3-84fd-74d2a0eb02ef None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:40.546277 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8337ce1-4e0d-44a3-84fd-74d2a0eb02ef None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:40.546369 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8337ce1-4e0d-44a3-84fd-74d2a0eb02ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:40.564637 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-e8337ce1-4e0d-44a3-84fd-74d2a0eb02ef None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:06:40.565879 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e8337ce1-4e0d-44a3-84fd-74d2a0eb02ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:06:40.581894 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 652/1295] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:06:40 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:06:40.604894 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d8891-376c-411e-bdb0-c616e555dac2 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:40.617123 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d8891-376c-411e-bdb0-c616e555dac2 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:40.621422 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b5e8c-a47e-4521-8efb-f96060645808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:40.622185 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b5e8c-a47e-4521-8efb-f96060645808 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:40.622465 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b5e8c-a47e-4521-8efb-f96060645808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:40.622738 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b5e8c-a47e-4521-8efb-f96060645808 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:40.623394 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b5e8c-a47e-4521-8efb-f96060645808 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:40.624999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b5e8c-a47e-4521-8efb-f96060645808 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:40.636295 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-f94b5e8c-a47e-4521-8efb-f96060645808 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 10 23:06:40.637380 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 644/1296] 10.222.0.77 () {56 vars in 1138 bytes} [Thu Feb 10 23:06:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:40.643658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8337ce1-4e0d-44a3-84fd-74d2a0eb02ef None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:40.652158 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8337ce1-4e0d-44a3-84fd-74d2a0eb02ef None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:40.656537 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629df82-a4cc-4914-af78-d1663cb7c74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:40.657165 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629df82-a4cc-4914-af78-d1663cb7c74c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:40.657443 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629df82-a4cc-4914-af78-d1663cb7c74c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:40.657713 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629df82-a4cc-4914-af78-d1663cb7c74c admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:40.658469 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629df82-a4cc-4914-af78-d1663cb7c74c admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:40.658766 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629df82-a4cc-4914-af78-d1663cb7c74c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:40.660351 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629df82-a4cc-4914-af78-d1663cb7c74c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:40.665206 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 653/1297] 10.222.0.77 () {56 vars in 1137 bytes} [Thu Feb 10 23:06:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:06:40.670506 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b5e8c-a47e-4521-8efb-f96060645808 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:40.679622 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b5e8c-a47e-4521-8efb-f96060645808 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:40.684028 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145540a-91fa-4232-8716-d4c886262f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:40.684640 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145540a-91fa-4232-8716-d4c886262f64 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:40.684918 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145540a-91fa-4232-8716-d4c886262f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:40.685191 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145540a-91fa-4232-8716-d4c886262f64 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:40.685966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145540a-91fa-4232-8716-d4c886262f64 admin admin] RBAC: Adding query filter params (interface=public, service_id=8750d362295c4603a1e37267d1ebbc04, region_id=RegionOne) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:40.686272 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145540a-91fa-4232-8716-d4c886262f64 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:40.687807 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145540a-91fa-4232-8716-d4c886262f64 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:40.693243 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 645/1298] 10.222.0.77 () {56 vars in 1272 bytes} [Thu Feb 10 23:06:40 2022] GET /identity/v3/endpoints?service_id=8750d362295c4603a1e37267d1ebbc04&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:40.698206 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629df82-a4cc-4914-af78-d1663cb7c74c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:40.707785 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629df82-a4cc-4914-af78-d1663cb7c74c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:40.712178 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d111f-a8cf-4955-a2a0-12f8366319a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:40.712790 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d111f-a8cf-4955-a2a0-12f8366319a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:40.713070 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d111f-a8cf-4955-a2a0-12f8366319a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:40.713337 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d111f-a8cf-4955-a2a0-12f8366319a7 admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:40.714003 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d111f-a8cf-4955-a2a0-12f8366319a7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:40.715515 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d111f-a8cf-4955-a2a0-12f8366319a7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:40.722163 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 654/1299] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Feb 10 23:06:40 2022] GET /identity/v3/services => generated 2191 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:06:42.936827 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20409d94-8ba6-48fc-916a-e27f3146ecd5 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:42.937429 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20409d94-8ba6-48fc-916a-e27f3146ecd5 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:42.937429 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20409d94-8ba6-48fc-916a-e27f3146ecd5 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:42.939137 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 646/1300] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:06:42.944373 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed2320-0df0-4647-8c19-e84817bb3c7e None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:42.944770 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed2320-0df0-4647-8c19-e84817bb3c7e None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:42.944913 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed2320-0df0-4647-8c19-e84817bb3c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:42.962284 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-eeed2320-0df0-4647-8c19-e84817bb3c7e None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:06:42.963440 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-eeed2320-0df0-4647-8c19-e84817bb3c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:06:42.971350 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 655/1301] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:06:42 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:06:42.994825 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20409d94-8ba6-48fc-916a-e27f3146ecd5 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:43.006744 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20409d94-8ba6-48fc-916a-e27f3146ecd5 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:43.011060 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31662457-2f44-428e-9914-0754ca84edca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:43.011828 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31662457-2f44-428e-9914-0754ca84edca admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:43.012131 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31662457-2f44-428e-9914-0754ca84edca admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:43.012404 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31662457-2f44-428e-9914-0754ca84edca admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:43.013053 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31662457-2f44-428e-9914-0754ca84edca admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:43.014613 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31662457-2f44-428e-9914-0754ca84edca admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:43.025235 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING keystone.server.flask.application [None req-31662457-2f44-428e-9914-0754ca84edca admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 10 23:06:43.026324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 647/1302] 10.222.0.77 () {56 vars in 1138 bytes} [Thu Feb 10 23:06:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 23:06:43.031912 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed2320-0df0-4647-8c19-e84817bb3c7e None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:43.041091 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed2320-0df0-4647-8c19-e84817bb3c7e None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:43.045659 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ef37c-2741-47da-9f12-2f696626ef5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:43.046302 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ef37c-2741-47da-9f12-2f696626ef5c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:43.046580 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ef37c-2741-47da-9f12-2f696626ef5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:43.046850 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ef37c-2741-47da-9f12-2f696626ef5c admin admin] PATH_INFO: `/v3/services` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:43.047559 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ef37c-2741-47da-9f12-2f696626ef5c admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:06:43.047895 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ef37c-2741-47da-9f12-2f696626ef5c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:43.050079 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ef37c-2741-47da-9f12-2f696626ef5c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:43.055078 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 656/1303] 10.222.0.77 () {56 vars in 1137 bytes} [Thu Feb 10 23:06:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:06:43.060129 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31662457-2f44-428e-9914-0754ca84edca admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:06:43.069944 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31662457-2f44-428e-9914-0754ca84edca admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:06:43.074468 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be0e71-ba8b-4614-91bf-bc6286248b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:06:43.075084 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be0e71-ba8b-4614-91bf-bc6286248b7b admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:06:43.075365 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be0e71-ba8b-4614-91bf-bc6286248b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:06:43.075640 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be0e71-ba8b-4614-91bf-bc6286248b7b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:06:43.076420 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be0e71-ba8b-4614-91bf-bc6286248b7b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:06:43.077981 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be0e71-ba8b-4614-91bf-bc6286248b7b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:06:43.096422 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 648/1304] 10.222.0.77 () {60 vars in 1165 bytes} [Thu Feb 10 23:06:43 2022] POST /identity/v3/endpoints => generated 331 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:07:45.786351 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d1faa-893a-461d-af75-cbae7fe6832b None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:07:45.786818 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d1faa-893a-461d-af75-cbae7fe6832b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:07:45.786818 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d1faa-893a-461d-af75-cbae7fe6832b None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:07:45.789115 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 657/1305] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:07:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:07:45.794701 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb391d2-4097-4593-bef2-707aeea6db98 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:07:45.795106 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb391d2-4097-4593-bef2-707aeea6db98 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:07:45.795330 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb391d2-4097-4593-bef2-707aeea6db98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:07:45.884728 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-cdb391d2-4097-4593-bef2-707aeea6db98 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:07:45.885950 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-cdb391d2-4097-4593-bef2-707aeea6db98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:07:45.984177 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 649/1306] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:07:46.007668 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d1faa-893a-461d-af75-cbae7fe6832b None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:07:46.009544 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-cc9d1faa-893a-461d-af75-cbae7fe6832b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:07:46.137325 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d1faa-893a-461d-af75-cbae7fe6832b None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:07:46.234029 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8a5b2-2767-46df-8a5d-48e3a2bb6e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:07:46.235283 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8a5b2-2767-46df-8a5d-48e3a2bb6e19 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:07:46.235564 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8a5b2-2767-46df-8a5d-48e3a2bb6e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:07:46.235847 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8a5b2-2767-46df-8a5d-48e3a2bb6e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:07:46.236585 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8a5b2-2767-46df-8a5d-48e3a2bb6e19 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:07:46.238654 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8a5b2-2767-46df-8a5d-48e3a2bb6e19 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:07:46.257250 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 658/1307] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Feb 10 23:07:46 2022] GET /identity/v3/projects => generated 2553 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:07:48.531054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b800e91-31fe-425d-bec5-7c9151a8097d None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:07:48.531603 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b800e91-31fe-425d-bec5-7c9151a8097d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:07:48.531603 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b800e91-31fe-425d-bec5-7c9151a8097d None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:07:48.533825 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 650/1308] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:07:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:07:48.538900 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a07f41-6de6-4f0f-864d-5023a31b60b4 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:07:48.539324 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a07f41-6de6-4f0f-864d-5023a31b60b4 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:07:48.539605 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a07f41-6de6-4f0f-864d-5023a31b60b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:07:48.618900 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-22a07f41-6de6-4f0f-864d-5023a31b60b4 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:07:48.620123 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-22a07f41-6de6-4f0f-864d-5023a31b60b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:07:48.713069 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 659/1309] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:07:48.763188 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d7e32-5568-42ae-beea-d7ba17a307f3 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:07:48.763470 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d7e32-5568-42ae-beea-d7ba17a307f3 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:07:48.763745 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d7e32-5568-42ae-beea-d7ba17a307f3 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:07:48.765673 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 651/1310] 10.222.0.77 () {54 vars in 964 bytes} [Thu Feb 10 23:07:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:07:48.771782 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8654f8c-8eea-4123-86b6-482ff26dd68c None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:07:48.772107 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8654f8c-8eea-4123-86b6-482ff26dd68c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:07:48.772384 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8654f8c-8eea-4123-86b6-482ff26dd68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:07:48.847586 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-e8654f8c-8eea-4123-86b6-482ff26dd68c None None] MFA Rules not processed for user `0d2af52f48dc435ca9a48cc0a32c31e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:07:48.848808 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e8654f8c-8eea-4123-86b6-482ff26dd68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:07:48.928213 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 660/1311] 10.222.0.77 () {58 vars in 1061 bytes} [Thu Feb 10 23:07:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:07:48.937164 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d7e32-5568-42ae-beea-d7ba17a307f3 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:07:48.939317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-489d7e32-5568-42ae-beea-d7ba17a307f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:07:49.040132 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d7e32-5568-42ae-beea-d7ba17a307f3 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:07:49.114213 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe848e-b8bf-4ac4-bc1d-f6220bf61bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:07:49.114859 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe848e-b8bf-4ac4-bc1d-f6220bf61bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:07:49.115140 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe848e-b8bf-4ac4-bc1d-f6220bf61bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:07:49.115412 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe848e-b8bf-4ac4-bc1d-f6220bf61bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:07:49.117075 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-47fe848e-b8bf-4ac4-bc1d-f6220bf61bb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:07:49.220758 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe848e-b8bf-4ac4-bc1d-f6220bf61bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:07:49.222174 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe848e-b8bf-4ac4-bc1d-f6220bf61bb6 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:07:49.240208 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 652/1312] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:07:51.850321 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eea827-6f84-4270-8eea-766863c4f0ab None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:07:51.850832 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eea827-6f84-4270-8eea-766863c4f0ab None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:07:51.850911 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eea827-6f84-4270-8eea-766863c4f0ab None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:07:51.852684 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 661/1313] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:07:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:07:51.858085 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3474a-85b8-49fd-a11c-ab469eac1a54 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:07:51.858488 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3474a-85b8-49fd-a11c-ab469eac1a54 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:07:51.858643 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3474a-85b8-49fd-a11c-ab469eac1a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:07:51.928433 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-13e3474a-85b8-49fd-a11c-ab469eac1a54 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:07:51.929879 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-13e3474a-85b8-49fd-a11c-ab469eac1a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:07:52.026869 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 653/1314] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:07:52.064528 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eea827-6f84-4270-8eea-766863c4f0ab None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:07:52.066048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-f4eea827-6f84-4270-8eea-766863c4f0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:07:52.185779 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eea827-6f84-4270-8eea-766863c4f0ab None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:07:52.263131 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262f2b1-148d-4c44-b898-bc69df803f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:07:52.263784 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262f2b1-148d-4c44-b898-bc69df803f21 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:07:52.264101 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262f2b1-148d-4c44-b898-bc69df803f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:07:52.264371 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262f2b1-148d-4c44-b898-bc69df803f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:07:52.266287 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-f262f2b1-148d-4c44-b898-bc69df803f21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:07:52.376511 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262f2b1-148d-4c44-b898-bc69df803f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:07:52.377876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262f2b1-148d-4c44-b898-bc69df803f21 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:07:52.395640 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 662/1315] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:07:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:07:54.921899 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725aff6-b8fb-4759-a0fa-e576a30dc40b None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:07:54.922459 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725aff6-b8fb-4759-a0fa-e576a30dc40b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:07:54.922459 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725aff6-b8fb-4759-a0fa-e576a30dc40b None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:07:54.924257 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 654/1316] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:07:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:07:54.929564 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c50ac-2caf-418f-a44c-f111efbb824f None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:07:54.929971 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c50ac-2caf-418f-a44c-f111efbb824f None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:07:54.930111 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c50ac-2caf-418f-a44c-f111efbb824f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:07:54.993498 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-5f4c50ac-2caf-418f-a44c-f111efbb824f None None] MFA Rules not processed for user `e90634c2f9fb4792963d0551248329a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:07:54.994682 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-5f4c50ac-2caf-418f-a44c-f111efbb824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:07:55.088166 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 663/1317] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:07:54 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:07:55.128025 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725aff6-b8fb-4759-a0fa-e576a30dc40b None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:07:55.129511 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-8725aff6-b8fb-4759-a0fa-e576a30dc40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:07:55.228410 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725aff6-b8fb-4759-a0fa-e576a30dc40b None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:07:55.299319 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b1e9d-4efe-4710-9533-1e90b8df9244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:07:55.299982 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b1e9d-4efe-4710-9533-1e90b8df9244 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:07:55.300263 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b1e9d-4efe-4710-9533-1e90b8df9244 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:07:55.300535 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b1e9d-4efe-4710-9533-1e90b8df9244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:07:55.302333 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-ee8b1e9d-4efe-4710-9533-1e90b8df9244 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:07:55.411494 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b1e9d-4efe-4710-9533-1e90b8df9244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:07:55.412950 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b1e9d-4efe-4710-9533-1e90b8df9244 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:07:55.430296 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 655/1318] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:07:55 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:07:58.224845 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443454-e51d-48fa-aba3-62cdb91887da None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:07:58.225367 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443454-e51d-48fa-aba3-62cdb91887da None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:07:58.225367 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443454-e51d-48fa-aba3-62cdb91887da None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:07:58.227145 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 664/1319] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:07:58.232367 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d97689-5642-4f8e-8846-20b1e6c4216b None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:07:58.232772 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d97689-5642-4f8e-8846-20b1e6c4216b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:07:58.232930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d97689-5642-4f8e-8846-20b1e6c4216b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:07:58.298199 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-63d97689-5642-4f8e-8846-20b1e6c4216b None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:07:58.299402 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-63d97689-5642-4f8e-8846-20b1e6c4216b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:07:58.397238 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 656/1320] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:07:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:07:58.435976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85443454-e51d-48fa-aba3-62cdb91887da None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:07:58.438078 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-85443454-e51d-48fa-aba3-62cdb91887da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:07:58.536500 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85443454-e51d-48fa-aba3-62cdb91887da None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:07:58.605146 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127661ae-8a1f-4870-a0ba-4360ce18875c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:07:58.605783 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127661ae-8a1f-4870-a0ba-4360ce18875c service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:07:58.606066 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127661ae-8a1f-4870-a0ba-4360ce18875c service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:07:58.606342 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127661ae-8a1f-4870-a0ba-4360ce18875c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:07:58.607995 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-127661ae-8a1f-4870-a0ba-4360ce18875c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:07:58.710585 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127661ae-8a1f-4870-a0ba-4360ce18875c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:07:58.711956 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127661ae-8a1f-4870-a0ba-4360ce18875c service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:07:58.729430 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 665/1321] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:07:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:08:01.585622 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08136861-6bd1-486e-8911-6c693541445a None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:01.586150 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08136861-6bd1-486e-8911-6c693541445a None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:01.586229 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08136861-6bd1-486e-8911-6c693541445a None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:01.588034 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 657/1322] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:08:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:01.593272 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc4be5-8f70-4011-a23a-1e57b05d4a99 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:01.593829 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc4be5-8f70-4011-a23a-1e57b05d4a99 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:01.594274 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc4be5-8f70-4011-a23a-1e57b05d4a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:01.657587 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-c7dc4be5-8f70-4011-a23a-1e57b05d4a99 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:01.658747 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-c7dc4be5-8f70-4011-a23a-1e57b05d4a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:01.752437 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 666/1323] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:01.788787 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08136861-6bd1-486e-8911-6c693541445a None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:08:01.790301 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-08136861-6bd1-486e-8911-6c693541445a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:01.892914 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08136861-6bd1-486e-8911-6c693541445a None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:08:01.964369 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee86ce-e67f-4e95-8165-7a03dd4a81b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:08:01.965050 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee86ce-e67f-4e95-8165-7a03dd4a81b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:01.965331 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee86ce-e67f-4e95-8165-7a03dd4a81b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:01.965612 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee86ce-e67f-4e95-8165-7a03dd4a81b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:01.967232 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-fcee86ce-e67f-4e95-8165-7a03dd4a81b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:02.072808 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee86ce-e67f-4e95-8165-7a03dd4a81b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:08:02.074229 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee86ce-e67f-4e95-8165-7a03dd4a81b3 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:08:02.092904 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 658/1324] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:08:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:08:04.358592 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c844b17-4e6e-483c-859c-5377aa61a3d1 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:04.359743 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c844b17-4e6e-483c-859c-5377aa61a3d1 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:04.359743 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c844b17-4e6e-483c-859c-5377aa61a3d1 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:04.361471 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 667/1325] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:08:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:04.367021 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c37af-860b-49fe-b1d9-5d721d755ee7 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:04.367434 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c37af-860b-49fe-b1d9-5d721d755ee7 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:04.367568 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c37af-860b-49fe-b1d9-5d721d755ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:04.443665 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-772c37af-860b-49fe-b1d9-5d721d755ee7 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:04.444884 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-772c37af-860b-49fe-b1d9-5d721d755ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:04.539668 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 659/1326] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:04.576086 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c844b17-4e6e-483c-859c-5377aa61a3d1 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:08:04.577809 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2c844b17-4e6e-483c-859c-5377aa61a3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:04.677765 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c844b17-4e6e-483c-859c-5377aa61a3d1 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:08:04.747383 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95839cde-fb5c-44e7-b114-dcbbe81ee626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:08:04.748052 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95839cde-fb5c-44e7-b114-dcbbe81ee626 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:04.748335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95839cde-fb5c-44e7-b114-dcbbe81ee626 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:04.748607 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95839cde-fb5c-44e7-b114-dcbbe81ee626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:04.752113 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-95839cde-fb5c-44e7-b114-dcbbe81ee626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:04.857244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95839cde-fb5c-44e7-b114-dcbbe81ee626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:08:04.858670 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95839cde-fb5c-44e7-b114-dcbbe81ee626 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:08:04.877276 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 668/1327] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:08:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:08:07.233517 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee05732-4838-4186-8ba3-6e05e0693f3e None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:07.234079 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee05732-4838-4186-8ba3-6e05e0693f3e None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:07.234079 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee05732-4838-4186-8ba3-6e05e0693f3e None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:07.235973 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 660/1328] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:07.241580 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3c6c9-6576-4618-853e-b1a1cd8d5fd6 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:07.242004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3c6c9-6576-4618-853e-b1a1cd8d5fd6 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:07.242132 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3c6c9-6576-4618-853e-b1a1cd8d5fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:07.306423 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-fee3c6c9-6576-4618-853e-b1a1cd8d5fd6 None None] MFA Rules not processed for user `e90634c2f9fb4792963d0551248329a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:07.307599 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-fee3c6c9-6576-4618-853e-b1a1cd8d5fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:07.400507 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 669/1329] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:08:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:07.438118 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee05732-4838-4186-8ba3-6e05e0693f3e None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:08:07.439607 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-aee05732-4838-4186-8ba3-6e05e0693f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:07.540696 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee05732-4838-4186-8ba3-6e05e0693f3e None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:08:07.610902 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4ca12-8bfe-437c-b572-61a16c9644de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:08:07.611548 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4ca12-8bfe-437c-b572-61a16c9644de service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:07.611863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4ca12-8bfe-437c-b572-61a16c9644de service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:07.612148 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4ca12-8bfe-437c-b572-61a16c9644de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:07.614023 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-f1d4ca12-8bfe-437c-b572-61a16c9644de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:07.719231 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4ca12-8bfe-437c-b572-61a16c9644de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:08:07.720846 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4ca12-8bfe-437c-b572-61a16c9644de service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:08:07.739261 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 661/1330] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:08:07 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:08:10.227026 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266aa2a5-5423-4399-9a2a-04da59fc13c3 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:10.227535 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266aa2a5-5423-4399-9a2a-04da59fc13c3 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:10.227768 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266aa2a5-5423-4399-9a2a-04da59fc13c3 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:10.229655 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 670/1331] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:10.235766 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6e456-a12a-4fb6-b87e-abf561790534 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:10.236189 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6e456-a12a-4fb6-b87e-abf561790534 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:10.236358 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6e456-a12a-4fb6-b87e-abf561790534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:10.303582 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-65a6e456-a12a-4fb6-b87e-abf561790534 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:10.305132 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-65a6e456-a12a-4fb6-b87e-abf561790534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:10.402822 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 662/1332] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:10.439854 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266aa2a5-5423-4399-9a2a-04da59fc13c3 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:08:10.441544 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-266aa2a5-5423-4399-9a2a-04da59fc13c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:10.557944 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266aa2a5-5423-4399-9a2a-04da59fc13c3 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:08:10.633797 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320f97d-1020-4ea4-aee9-3c29f1d9d744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:08:10.634370 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320f97d-1020-4ea4-aee9-3c29f1d9d744 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:10.634653 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320f97d-1020-4ea4-aee9-3c29f1d9d744 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:10.635067 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320f97d-1020-4ea4-aee9-3c29f1d9d744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:10.636747 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-4320f97d-1020-4ea4-aee9-3c29f1d9d744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:10.743162 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320f97d-1020-4ea4-aee9-3c29f1d9d744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:08:10.744619 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320f97d-1020-4ea4-aee9-3c29f1d9d744 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:08:10.761727 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 671/1333] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:08:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:08:13.035566 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d8b6f-53f8-4802-b994-9531f9681aa6 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:13.036157 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d8b6f-53f8-4802-b994-9531f9681aa6 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:13.036157 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d8b6f-53f8-4802-b994-9531f9681aa6 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:13.038097 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 663/1334] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:08:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:13.045636 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582b31e-137b-436c-b10f-a602a8a2167d None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:13.046038 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582b31e-137b-436c-b10f-a602a8a2167d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:13.046188 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582b31e-137b-436c-b10f-a602a8a2167d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:13.110746 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-c582b31e-137b-436c-b10f-a602a8a2167d None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:13.111964 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-c582b31e-137b-436c-b10f-a602a8a2167d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:13.202145 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 672/1335] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:13.243470 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d8b6f-53f8-4802-b994-9531f9681aa6 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:08:13.245013 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-5c8d8b6f-53f8-4802-b994-9531f9681aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:13.345398 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d8b6f-53f8-4802-b994-9531f9681aa6 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:08:13.415553 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123b3d7-43b6-456d-a96e-a24ab0183f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:08:13.416153 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123b3d7-43b6-456d-a96e-a24ab0183f53 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:13.416440 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123b3d7-43b6-456d-a96e-a24ab0183f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:13.416714 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123b3d7-43b6-456d-a96e-a24ab0183f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:13.418368 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-6123b3d7-43b6-456d-a96e-a24ab0183f53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:13.522314 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123b3d7-43b6-456d-a96e-a24ab0183f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:08:13.523733 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123b3d7-43b6-456d-a96e-a24ab0183f53 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:08:13.542804 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 664/1336] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:08:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:08:16.077970 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e39c0-cb54-436f-8b93-eed1361f818f None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:16.078542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e39c0-cb54-436f-8b93-eed1361f818f None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:16.078641 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e39c0-cb54-436f-8b93-eed1361f818f None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:16.080453 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 673/1337] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:08:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:16.085760 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b94d6-bee1-4d44-9b61-8b186c2fb6f7 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:16.086216 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b94d6-bee1-4d44-9b61-8b186c2fb6f7 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:16.086315 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b94d6-bee1-4d44-9b61-8b186c2fb6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:16.155123 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-250b94d6-bee1-4d44-9b61-8b186c2fb6f7 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:16.157234 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-250b94d6-bee1-4d44-9b61-8b186c2fb6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:16.259131 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 665/1338] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:08:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:16.295484 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e39c0-cb54-436f-8b93-eed1361f818f None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:08:16.297594 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d63e39c0-cb54-436f-8b93-eed1361f818f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:16.389151 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e39c0-cb54-436f-8b93-eed1361f818f None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:08:16.392754 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66893cd8-8075-4ab1-b726-4d5b7364d204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:08:16.393387 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66893cd8-8075-4ab1-b726-4d5b7364d204 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:16.393670 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66893cd8-8075-4ab1-b726-4d5b7364d204 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:16.393945 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66893cd8-8075-4ab1-b726-4d5b7364d204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:16.402567 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66893cd8-8075-4ab1-b726-4d5b7364d204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:08:16.404007 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66893cd8-8075-4ab1-b726-4d5b7364d204 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:08:16.413612 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 674/1339] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:08:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:08:20.571037 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251549f8-b830-4a67-ac5d-89336aa20a9d None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:20.571570 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251549f8-b830-4a67-ac5d-89336aa20a9d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:20.571570 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251549f8-b830-4a67-ac5d-89336aa20a9d None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:20.573303 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 666/1340] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:08:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:20.579604 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c915a2-5375-42a3-8c22-a37a3570aa39 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:20.580055 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c915a2-5375-42a3-8c22-a37a3570aa39 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:20.580200 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c915a2-5375-42a3-8c22-a37a3570aa39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:20.608627 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-54c915a2-5375-42a3-8c22-a37a3570aa39 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:20.609800 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-54c915a2-5375-42a3-8c22-a37a3570aa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:20.683113 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 675/1341] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:08:20.738693 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e851c-f0cb-4bf0-b08b-a9e52ebefd8d None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:20.738971 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e851c-f0cb-4bf0-b08b-a9e52ebefd8d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:20.739238 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e851c-f0cb-4bf0-b08b-a9e52ebefd8d None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:20.741039 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 667/1342] 10.222.0.77 () {54 vars in 964 bytes} [Thu Feb 10 23:08:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:20.747062 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf74a58-d79b-4017-986b-8e6acb6f9623 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:20.747431 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf74a58-d79b-4017-986b-8e6acb6f9623 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:20.747781 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf74a58-d79b-4017-986b-8e6acb6f9623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:20.805221 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-bbf74a58-d79b-4017-986b-8e6acb6f9623 None None] MFA Rules not processed for user `0d2af52f48dc435ca9a48cc0a32c31e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:20.806407 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-bbf74a58-d79b-4017-986b-8e6acb6f9623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:20.813636 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 676/1343] 10.222.0.77 () {58 vars in 1061 bytes} [Thu Feb 10 23:08:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:20.822787 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e851c-f0cb-4bf0-b08b-a9e52ebefd8d None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:08:20.833874 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e851c-f0cb-4bf0-b08b-a9e52ebefd8d None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:08:20.837380 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ab916-b6ba-4010-9f8d-eba7c7d02656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:08:20.838010 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ab916-b6ba-4010-9f8d-eba7c7d02656 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:20.838316 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ab916-b6ba-4010-9f8d-eba7c7d02656 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:20.838573 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ab916-b6ba-4010-9f8d-eba7c7d02656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:20.848185 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ab916-b6ba-4010-9f8d-eba7c7d02656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:08:20.849615 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ab916-b6ba-4010-9f8d-eba7c7d02656 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:08:20.859302 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 668/1344] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:08:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:08:24.325344 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0746bb-2009-4758-bd19-c2ceaf5b9004 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:24.326045 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0746bb-2009-4758-bd19-c2ceaf5b9004 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:24.326045 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0746bb-2009-4758-bd19-c2ceaf5b9004 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:24.328957 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 677/1345] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:08:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:08:24.335545 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07418f-564f-4e66-ade4-ca2976788f17 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:24.336090 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07418f-564f-4e66-ade4-ca2976788f17 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:24.336090 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07418f-564f-4e66-ade4-ca2976788f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:24.354227 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-5e07418f-564f-4e66-ade4-ca2976788f17 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:24.355396 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-5e07418f-564f-4e66-ade4-ca2976788f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:24.363451 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 669/1346] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:08:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:24.401019 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0746bb-2009-4758-bd19-c2ceaf5b9004 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:08:24.412218 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0746bb-2009-4758-bd19-c2ceaf5b9004 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:08:24.415738 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a76b5-e73f-422c-9cd5-15b01fc48a36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:08:24.416388 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a76b5-e73f-422c-9cd5-15b01fc48a36 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:24.416671 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a76b5-e73f-422c-9cd5-15b01fc48a36 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:24.416945 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a76b5-e73f-422c-9cd5-15b01fc48a36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:24.425548 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a76b5-e73f-422c-9cd5-15b01fc48a36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:08:24.426962 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a76b5-e73f-422c-9cd5-15b01fc48a36 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:08:24.436131 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 678/1347] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:08:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:08:28.957282 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2f45a-f29f-4bec-a027-8c733898c272 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:28.957850 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2f45a-f29f-4bec-a027-8c733898c272 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:28.957850 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2f45a-f29f-4bec-a027-8c733898c272 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:28.959598 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 670/1348] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:28.965161 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe58cf-7fcc-45a3-87dc-5bd5b6159234 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:28.965566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe58cf-7fcc-45a3-87dc-5bd5b6159234 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:28.965714 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe58cf-7fcc-45a3-87dc-5bd5b6159234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:28.983336 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-8bbe58cf-7fcc-45a3-87dc-5bd5b6159234 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:28.984740 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-8bbe58cf-7fcc-45a3-87dc-5bd5b6159234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:28.993013 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 679/1349] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:29.031955 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2f45a-f29f-4bec-a027-8c733898c272 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:08:29.042319 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2f45a-f29f-4bec-a027-8c733898c272 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:08:29.045718 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f246a57-c6c6-4e9b-a7fb-142b45babe7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:08:29.046482 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f246a57-c6c6-4e9b-a7fb-142b45babe7c service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:29.046948 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f246a57-c6c6-4e9b-a7fb-142b45babe7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:29.047680 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f246a57-c6c6-4e9b-a7fb-142b45babe7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:29.056074 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f246a57-c6c6-4e9b-a7fb-142b45babe7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:08:29.057487 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f246a57-c6c6-4e9b-a7fb-142b45babe7c service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:08:29.067259 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 671/1350] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:08:34.341974 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa18efc-c882-4b56-bfea-b29a9293fb76 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:34.343067 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa18efc-c882-4b56-bfea-b29a9293fb76 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:34.343244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa18efc-c882-4b56-bfea-b29a9293fb76 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:34.345210 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 680/1351] 10.222.0.77 () {54 vars in 921 bytes} [Thu Feb 10 23:08:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:34.354604 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda3b9e-c364-4a33-bf24-bddcea627a69 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:34.355435 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda3b9e-c364-4a33-bf24-bddcea627a69 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:34.355930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda3b9e-c364-4a33-bf24-bddcea627a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:34.458984 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-2dda3b9e-c364-4a33-bf24-bddcea627a69 None None] MFA Rules not processed for user `0f5243eef2a24a518b30526425c0b2c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:34.460480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-2dda3b9e-c364-4a33-bf24-bddcea627a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:34.607834 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 672/1352] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Feb 10 23:08:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:38.718285 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233c93f-52e6-4a7f-90d9-7ea68e435a9c None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:38.718817 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233c93f-52e6-4a7f-90d9-7ea68e435a9c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:38.718817 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233c93f-52e6-4a7f-90d9-7ea68e435a9c None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:38.720894 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 681/1353] 10.222.0.77 () {54 vars in 921 bytes} [Thu Feb 10 23:08:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:38.726238 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598211aa-4b01-4da0-a208-51dbf44e88a9 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:38.726708 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598211aa-4b01-4da0-a208-51dbf44e88a9 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:38.726813 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598211aa-4b01-4da0-a208-51dbf44e88a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:38.746027 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-598211aa-4b01-4da0-a208-51dbf44e88a9 None None] MFA Rules not processed for user `0f5243eef2a24a518b30526425c0b2c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:38.747211 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-598211aa-4b01-4da0-a208-51dbf44e88a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:38.757879 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 673/1354] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Feb 10 23:08:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:08:40.040966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a3030-fb94-4ed4-a835-72987736abd9 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:40.041517 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a3030-fb94-4ed4-a835-72987736abd9 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:40.041517 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a3030-fb94-4ed4-a835-72987736abd9 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:40.043320 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 682/1355] 10.222.0.77 () {54 vars in 921 bytes} [Thu Feb 10 23:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:40.048701 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ea39d-b1a1-4ee0-a8ad-249ed8ede61d None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:40.049113 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ea39d-b1a1-4ee0-a8ad-249ed8ede61d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:40.049258 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ea39d-b1a1-4ee0-a8ad-249ed8ede61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:40.069348 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-153ea39d-b1a1-4ee0-a8ad-249ed8ede61d None None] MFA Rules not processed for user `0f5243eef2a24a518b30526425c0b2c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:40.070769 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-153ea39d-b1a1-4ee0-a8ad-249ed8ede61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:40.092062 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 674/1356] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Feb 10 23:08:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:43.930752 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbffaa-e2aa-4509-ab57-e35762b639bc None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:43.931266 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbffaa-e2aa-4509-ab57-e35762b639bc None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:43.931266 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbffaa-e2aa-4509-ab57-e35762b639bc None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:43.933148 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 683/1357] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:43.938470 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424693a-738e-4624-b6f9-c6239fcab097 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:43.938883 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424693a-738e-4624-b6f9-c6239fcab097 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:43.939024 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424693a-738e-4624-b6f9-c6239fcab097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:43.956979 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-9424693a-738e-4624-b6f9-c6239fcab097 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:43.958144 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-9424693a-738e-4624-b6f9-c6239fcab097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:43.966402 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 675/1358] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:44.016278 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bd818-0d92-4d6d-9ab3-44b1ddcef375 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:44.016888 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bd818-0d92-4d6d-9ab3-44b1ddcef375 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:44.017168 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bd818-0d92-4d6d-9ab3-44b1ddcef375 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:44.019078 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 684/1359] 10.222.0.77 () {54 vars in 961 bytes} [Thu Feb 10 23:08:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:44.024354 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1c796-c107-4eda-ae06-9ef4396bb4e8 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:44.024880 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1c796-c107-4eda-ae06-9ef4396bb4e8 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:44.025220 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1c796-c107-4eda-ae06-9ef4396bb4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:44.073946 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-95d1c796-c107-4eda-ae06-9ef4396bb4e8 None None] MFA Rules not processed for user `551da2c9fab74cb8b14287a5634adb25`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:44.075110 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-95d1c796-c107-4eda-ae06-9ef4396bb4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:44.163021 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 676/1360] 10.222.0.77 () {58 vars in 1058 bytes} [Thu Feb 10 23:08:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:44.171446 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bd818-0d92-4d6d-9ab3-44b1ddcef375 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:08:44.186007 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bd818-0d92-4d6d-9ab3-44b1ddcef375 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:08:44.191901 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33810430-a6bd-4b38-a297-69e598b06cd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:08:44.192722 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33810430-a6bd-4b38-a297-69e598b06cd3 service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:44.193007 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33810430-a6bd-4b38-a297-69e598b06cd3 service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:44.193282 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33810430-a6bd-4b38-a297-69e598b06cd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:44.201235 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33810430-a6bd-4b38-a297-69e598b06cd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:08:44.203228 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33810430-a6bd-4b38-a297-69e598b06cd3 service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:08:44.212591 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 685/1361] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:08:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:08:46.747384 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996df045-5df5-4e56-addc-7feb72e913e2 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:46.747997 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996df045-5df5-4e56-addc-7feb72e913e2 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:46.747997 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996df045-5df5-4e56-addc-7feb72e913e2 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:46.750288 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 677/1362] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:08:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:46.755598 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a20020-8dd6-4f83-8f11-086a6da53551 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:46.756085 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a20020-8dd6-4f83-8f11-086a6da53551 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:46.756186 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a20020-8dd6-4f83-8f11-086a6da53551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:46.775076 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-16a20020-8dd6-4f83-8f11-086a6da53551 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:46.776576 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-16a20020-8dd6-4f83-8f11-086a6da53551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:46.784655 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 686/1363] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:46.829519 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996df045-5df5-4e56-addc-7feb72e913e2 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:08:46.849374 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996df045-5df5-4e56-addc-7feb72e913e2 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:08:46.854965 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b514b7-923e-4c19-80f7-febc37c82a34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:08:46.855733 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b514b7-923e-4c19-80f7-febc37c82a34 service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:46.856052 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b514b7-923e-4c19-80f7-febc37c82a34 service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:46.856327 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b514b7-923e-4c19-80f7-febc37c82a34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:46.865984 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b514b7-923e-4c19-80f7-febc37c82a34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:08:46.868549 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b514b7-923e-4c19-80f7-febc37c82a34 service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:08:46.883883 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 678/1364] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:08:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:08:49.425384 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235e507-e80d-45bf-84b0-47da4818db6b None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:49.425921 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235e507-e80d-45bf-84b0-47da4818db6b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:49.425921 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235e507-e80d-45bf-84b0-47da4818db6b None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:49.427644 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 687/1365] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:08:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:49.433121 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a557a5a-0b1b-4b64-91be-d388e38b6a29 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:49.433544 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a557a5a-0b1b-4b64-91be-d388e38b6a29 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:49.433798 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a557a5a-0b1b-4b64-91be-d388e38b6a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:49.453267 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-5a557a5a-0b1b-4b64-91be-d388e38b6a29 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:49.454540 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-5a557a5a-0b1b-4b64-91be-d388e38b6a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:49.462632 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 679/1366] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:49.510756 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f62ba-37a6-4ac7-aabd-d12d0c3fda55 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:49.511419 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f62ba-37a6-4ac7-aabd-d12d0c3fda55 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:49.512051 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f62ba-37a6-4ac7-aabd-d12d0c3fda55 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:49.515536 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 688/1367] 10.222.0.77 () {54 vars in 961 bytes} [Thu Feb 10 23:08:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:49.522934 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ccbbb-ecaf-48e3-9621-aa5f77117901 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:49.523303 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ccbbb-ecaf-48e3-9621-aa5f77117901 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:49.523585 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ccbbb-ecaf-48e3-9621-aa5f77117901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:49.549363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-039ccbbb-ecaf-48e3-9621-aa5f77117901 None None] MFA Rules not processed for user `551da2c9fab74cb8b14287a5634adb25`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:49.550600 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-039ccbbb-ecaf-48e3-9621-aa5f77117901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:49.561788 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 680/1368] 10.222.0.77 () {58 vars in 1058 bytes} [Thu Feb 10 23:08:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:49.572531 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f62ba-37a6-4ac7-aabd-d12d0c3fda55 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:08:49.589248 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f62ba-37a6-4ac7-aabd-d12d0c3fda55 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:08:49.595498 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f2391-dcf0-44e6-afe8-511b4ff05918 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:08:49.596173 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f2391-dcf0-44e6-afe8-511b4ff05918 service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:49.596457 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f2391-dcf0-44e6-afe8-511b4ff05918 service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:49.597697 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f2391-dcf0-44e6-afe8-511b4ff05918 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:49.609176 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f2391-dcf0-44e6-afe8-511b4ff05918 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:08:49.610819 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f2391-dcf0-44e6-afe8-511b4ff05918 service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:08:49.621130 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 689/1369] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:08:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:08:51.954067 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5f4e9-e549-452e-915f-ca993030d65c None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:51.954942 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5f4e9-e549-452e-915f-ca993030d65c None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:51.955218 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5f4e9-e549-452e-915f-ca993030d65c None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:51.957029 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 681/1370] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:08:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:51.962784 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d37e22-0ae0-4702-b8c5-66eac634015a None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:51.963196 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d37e22-0ae0-4702-b8c5-66eac634015a None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:51.963328 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d37e22-0ae0-4702-b8c5-66eac634015a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:51.981659 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-57d37e22-0ae0-4702-b8c5-66eac634015a None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:51.983478 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-57d37e22-0ae0-4702-b8c5-66eac634015a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:51.991682 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 690/1371] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:52.036277 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5f4e9-e549-452e-915f-ca993030d65c None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:08:52.051549 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5f4e9-e549-452e-915f-ca993030d65c None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:08:52.057164 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c36cd-6a62-4671-b3e3-a0aeaff69fb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:08:52.057812 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c36cd-6a62-4671-b3e3-a0aeaff69fb5 service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:52.058097 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c36cd-6a62-4671-b3e3-a0aeaff69fb5 service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:52.058374 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c36cd-6a62-4671-b3e3-a0aeaff69fb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:52.067835 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c36cd-6a62-4671-b3e3-a0aeaff69fb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:08:52.069419 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c36cd-6a62-4671-b3e3-a0aeaff69fb5 service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:08:52.083162 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 682/1372] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:08:52.190937 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703217c-ac3a-4d88-92f6-a2b4924106b9 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:52.191589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703217c-ac3a-4d88-92f6-a2b4924106b9 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:52.192141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703217c-ac3a-4d88-92f6-a2b4924106b9 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:52.194542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 691/1373] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:08:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:52.202562 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466af6f0-a0f6-40be-8cb3-9eb6002afdfe None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:52.202930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466af6f0-a0f6-40be-8cb3-9eb6002afdfe None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:52.203111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466af6f0-a0f6-40be-8cb3-9eb6002afdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:52.223756 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-466af6f0-a0f6-40be-8cb3-9eb6002afdfe None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:52.224901 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-466af6f0-a0f6-40be-8cb3-9eb6002afdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:52.234287 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 683/1374] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:08:52.505799 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dca8b-ac60-421f-bfc7-39490448f749 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:52.506000 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dca8b-ac60-421f-bfc7-39490448f749 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:52.506444 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dca8b-ac60-421f-bfc7-39490448f749 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:52.508256 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 692/1375] 10.222.0.77 () {54 vars in 963 bytes} [Thu Feb 10 23:08:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:52.515097 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695ad98-5de0-44e9-9639-fd86e1a06ff7 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:52.515607 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695ad98-5de0-44e9-9639-fd86e1a06ff7 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:52.515921 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695ad98-5de0-44e9-9639-fd86e1a06ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:52.566121 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-1695ad98-5de0-44e9-9639-fd86e1a06ff7 None None] MFA Rules not processed for user `d4899bdd65bb4cccae615cc5e8192388`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:52.567312 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-1695ad98-5de0-44e9-9639-fd86e1a06ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:52.626949 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 684/1376] 10.222.0.77 () {58 vars in 1060 bytes} [Thu Feb 10 23:08:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:52.634345 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dca8b-ac60-421f-bfc7-39490448f749 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:08:52.645459 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dca8b-ac60-421f-bfc7-39490448f749 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:08:52.648947 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d4010-6cbe-40c5-81e0-f50b4adbca2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:08:52.649582 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d4010-6cbe-40c5-81e0-f50b4adbca2d service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:52.649862 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d4010-6cbe-40c5-81e0-f50b4adbca2d service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:52.650313 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d4010-6cbe-40c5-81e0-f50b4adbca2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:52.660036 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d4010-6cbe-40c5-81e0-f50b4adbca2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:08:52.661639 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d4010-6cbe-40c5-81e0-f50b4adbca2d service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:08:52.675949 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 693/1377] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:08:54.392934 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e454a-b148-46aa-949b-22ab0d04f299 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:54.393464 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e454a-b148-46aa-949b-22ab0d04f299 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:54.393560 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e454a-b148-46aa-949b-22ab0d04f299 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:54.395301 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 685/1378] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:08:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:54.401060 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2e2bc-4904-4af1-a1c1-642b3cbb5ccf None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:54.401491 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2e2bc-4904-4af1-a1c1-642b3cbb5ccf None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:54.401719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2e2bc-4904-4af1-a1c1-642b3cbb5ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:54.420196 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-cda2e2bc-4904-4af1-a1c1-642b3cbb5ccf None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:54.421585 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-cda2e2bc-4904-4af1-a1c1-642b3cbb5ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:54.429972 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 694/1379] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:54.475009 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e454a-b148-46aa-949b-22ab0d04f299 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:08:54.489747 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e454a-b148-46aa-949b-22ab0d04f299 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:08:54.495949 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73feb568-f220-4f34-a0ca-3245efddeb5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:08:54.496591 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feb568-f220-4f34-a0ca-3245efddeb5d service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:54.496875 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feb568-f220-4f34-a0ca-3245efddeb5d service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:54.497150 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feb568-f220-4f34-a0ca-3245efddeb5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:54.506545 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73feb568-f220-4f34-a0ca-3245efddeb5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:08:54.508174 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73feb568-f220-4f34-a0ca-3245efddeb5d service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:08:54.519165 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 686/1380] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:08:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:08:56.792442 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961666b6-073b-4132-a39b-6fdecee13a50 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:56.792978 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961666b6-073b-4132-a39b-6fdecee13a50 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:56.792978 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961666b6-073b-4132-a39b-6fdecee13a50 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:56.794745 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 695/1381] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:56.800100 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a7315-5235-4a07-b27c-52ce504004d4 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:56.800516 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a7315-5235-4a07-b27c-52ce504004d4 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:56.800653 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a7315-5235-4a07-b27c-52ce504004d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:56.819329 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-dd7a7315-5235-4a07-b27c-52ce504004d4 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:56.820742 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-dd7a7315-5235-4a07-b27c-52ce504004d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:56.829335 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 687/1382] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:56.873872 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961666b6-073b-4132-a39b-6fdecee13a50 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:08:56.889824 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961666b6-073b-4132-a39b-6fdecee13a50 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:08:56.896019 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65987eb2-de9c-4ad1-98e6-988146e2a923 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:08:56.896880 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65987eb2-de9c-4ad1-98e6-988146e2a923 service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:56.897356 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65987eb2-de9c-4ad1-98e6-988146e2a923 service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:56.897819 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65987eb2-de9c-4ad1-98e6-988146e2a923 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:56.907501 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65987eb2-de9c-4ad1-98e6-988146e2a923 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:08:56.909336 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65987eb2-de9c-4ad1-98e6-988146e2a923 service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:08:56.920331 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 696/1383] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:08:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:08:59.200957 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f8470-0e05-4451-b57c-fefcdaa82ea5 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:59.202175 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f8470-0e05-4451-b57c-fefcdaa82ea5 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:59.202409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f8470-0e05-4451-b57c-fefcdaa82ea5 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:59.204043 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 688/1384] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:08:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:08:59.209291 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b9ab8-080a-4d59-830b-2ed37922f3b9 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:59.209677 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b9ab8-080a-4d59-830b-2ed37922f3b9 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:59.209839 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b9ab8-080a-4d59-830b-2ed37922f3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:59.227990 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-722b9ab8-080a-4d59-830b-2ed37922f3b9 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:08:59.229146 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-722b9ab8-080a-4d59-830b-2ed37922f3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:08:59.237041 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 697/1385] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:08:59.278871 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f8470-0e05-4451-b57c-fefcdaa82ea5 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:08:59.295608 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f8470-0e05-4451-b57c-fefcdaa82ea5 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:08:59.301424 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b29ae1-1d35-40a4-8b6e-1aa58b4799df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:08:59.302070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b29ae1-1d35-40a4-8b6e-1aa58b4799df service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:08:59.302352 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b29ae1-1d35-40a4-8b6e-1aa58b4799df service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:08:59.302629 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b29ae1-1d35-40a4-8b6e-1aa58b4799df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:08:59.312468 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b29ae1-1d35-40a4-8b6e-1aa58b4799df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:08:59.314039 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b29ae1-1d35-40a4-8b6e-1aa58b4799df service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:08:59.324614 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 689/1386] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:08:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:09:01.789088 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c27a0e-7c47-4860-8b8a-8db8a118eb7a None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:01.789655 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c27a0e-7c47-4860-8b8a-8db8a118eb7a None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:01.789751 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c27a0e-7c47-4860-8b8a-8db8a118eb7a None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:01.791523 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 698/1387] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:09:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:01.799217 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521101b-18f4-44ca-bf13-d7f9cb5ce8f8 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:01.799667 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521101b-18f4-44ca-bf13-d7f9cb5ce8f8 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:01.799979 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521101b-18f4-44ca-bf13-d7f9cb5ce8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:01.822973 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-9521101b-18f4-44ca-bf13-d7f9cb5ce8f8 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:01.824485 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-9521101b-18f4-44ca-bf13-d7f9cb5ce8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:01.834930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 690/1388] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:01.881989 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c27a0e-7c47-4860-8b8a-8db8a118eb7a None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:01.898063 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c27a0e-7c47-4860-8b8a-8db8a118eb7a None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:01.905433 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee4f75-0948-47ab-b850-02bf278dc2e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:01.906219 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee4f75-0948-47ab-b850-02bf278dc2e9 service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:01.906847 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee4f75-0948-47ab-b850-02bf278dc2e9 service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:01.907186 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee4f75-0948-47ab-b850-02bf278dc2e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:01.918332 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee4f75-0948-47ab-b850-02bf278dc2e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:01.920680 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee4f75-0948-47ab-b850-02bf278dc2e9 service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:01.930436 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 699/1389] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:09:04.899408 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cf679-cfa2-4349-b752-159a5bb068a4 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:04.899969 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cf679-cfa2-4349-b752-159a5bb068a4 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:04.900214 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cf679-cfa2-4349-b752-159a5bb068a4 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:04.902517 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 691/1390] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:09:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:04.910335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4484c-0ab5-4dd7-9903-32011f2cfa13 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:04.910795 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4484c-0ab5-4dd7-9903-32011f2cfa13 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:04.911039 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4484c-0ab5-4dd7-9903-32011f2cfa13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:04.934316 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-c3b4484c-0ab5-4dd7-9903-32011f2cfa13 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:04.936301 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-c3b4484c-0ab5-4dd7-9903-32011f2cfa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:04.946258 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 700/1391] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:05.002091 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cf679-cfa2-4349-b752-159a5bb068a4 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:05.016304 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cf679-cfa2-4349-b752-159a5bb068a4 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:05.022061 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce8e38-db05-40b8-8b07-9b5d9542dd59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:05.022694 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce8e38-db05-40b8-8b07-9b5d9542dd59 service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:05.022989 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce8e38-db05-40b8-8b07-9b5d9542dd59 service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:05.023270 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce8e38-db05-40b8-8b07-9b5d9542dd59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:05.032118 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce8e38-db05-40b8-8b07-9b5d9542dd59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:05.033695 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce8e38-db05-40b8-8b07-9b5d9542dd59 service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:05.043942 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 692/1392] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:09:07.290553 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759a0dd-83d8-4820-b8b7-f3e632c02bc0 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:07.291082 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759a0dd-83d8-4820-b8b7-f3e632c02bc0 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:07.291082 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759a0dd-83d8-4820-b8b7-f3e632c02bc0 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:07.292902 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 701/1393] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:07.298199 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fedc8-371a-43b4-b481-9fee66fbf096 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:07.298635 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fedc8-371a-43b4-b481-9fee66fbf096 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:07.298745 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fedc8-371a-43b4-b481-9fee66fbf096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:07.317036 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-ae1fedc8-371a-43b4-b481-9fee66fbf096 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:07.318209 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-ae1fedc8-371a-43b4-b481-9fee66fbf096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:07.326634 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 693/1394] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:07.369671 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759a0dd-83d8-4820-b8b7-f3e632c02bc0 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:07.392705 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759a0dd-83d8-4820-b8b7-f3e632c02bc0 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:07.398351 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189d309-f963-426b-beb5-6bd2b418387f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:07.398997 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189d309-f963-426b-beb5-6bd2b418387f service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:07.399283 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189d309-f963-426b-beb5-6bd2b418387f service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:07.399560 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189d309-f963-426b-beb5-6bd2b418387f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:07.408321 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189d309-f963-426b-beb5-6bd2b418387f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:07.409893 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189d309-f963-426b-beb5-6bd2b418387f service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:07.419133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 702/1395] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:09:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:09:07.737662 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864114b8-932b-441a-8c0b-106a0d095c64 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:07.737873 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864114b8-932b-441a-8c0b-106a0d095c64 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:07.738125 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864114b8-932b-441a-8c0b-106a0d095c64 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:07.740188 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 694/1396] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:09:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:07.745398 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895d9ba-b152-415a-8af0-cfef4a9546f3 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:07.745686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895d9ba-b152-415a-8af0-cfef4a9546f3 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:07.745961 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895d9ba-b152-415a-8af0-cfef4a9546f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:07.764286 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-8895d9ba-b152-415a-8af0-cfef4a9546f3 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:07.765446 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-8895d9ba-b152-415a-8af0-cfef4a9546f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:07.773168 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 703/1397] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:09:07.828596 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d79a3-09c7-4273-9498-f764ee37c641 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:07.828888 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d79a3-09c7-4273-9498-f764ee37c641 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:07.829169 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d79a3-09c7-4273-9498-f764ee37c641 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:07.830933 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 695/1398] 10.222.0.77 () {54 vars in 962 bytes} [Thu Feb 10 23:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:07.836235 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b06931-dcc5-44ad-9f05-c162fa1e9c8b None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:07.836524 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b06931-dcc5-44ad-9f05-c162fa1e9c8b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:07.836799 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b06931-dcc5-44ad-9f05-c162fa1e9c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:07.884424 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-78b06931-dcc5-44ad-9f05-c162fa1e9c8b None None] MFA Rules not processed for user `d367d4b48c634351a427f2f1b468d4ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:07.885582 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-78b06931-dcc5-44ad-9f05-c162fa1e9c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:07.942086 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 704/1399] 10.222.0.77 () {58 vars in 1059 bytes} [Thu Feb 10 23:09:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:07.949338 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d79a3-09c7-4273-9498-f764ee37c641 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:07.959576 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d79a3-09c7-4273-9498-f764ee37c641 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:07.963038 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80dd5c-2abb-4e3c-930a-be033bda73c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd367d4b48c634351a427f2f1b468d4ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:07.963654 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80dd5c-2abb-4e3c-930a-be033bda73c3 service glance] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:07.964911 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80dd5c-2abb-4e3c-930a-be033bda73c3 service glance] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:07.966031 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80dd5c-2abb-4e3c-930a-be033bda73c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:07.975279 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80dd5c-2abb-4e3c-930a-be033bda73c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:07.976723 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80dd5c-2abb-4e3c-930a-be033bda73c3 service glance] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:07.986518 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 696/1400] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:09:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:09:08.412679 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8839-7914-4d4c-b6e5-93c0ec85c203 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:08.413207 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8839-7914-4d4c-b6e5-93c0ec85c203 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:08.413207 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8839-7914-4d4c-b6e5-93c0ec85c203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:08.460574 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-569f8839-7914-4d4c-b6e5-93c0ec85c203 None None] MFA Rules not processed for user `9dca4ea4f2c8490e823a73dca6c303ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:08.461753 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-569f8839-7914-4d4c-b6e5-93c0ec85c203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:08.522633 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 705/1401] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Feb 10 23:09:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:08.563955 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5350c-70cc-4f21-bc68-28747bdeea96 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:08.564447 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5350c-70cc-4f21-bc68-28747bdeea96 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:08.564669 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5350c-70cc-4f21-bc68-28747bdeea96 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:08.566558 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 697/1402] 10.222.0.77 () {54 vars in 942 bytes} [Thu Feb 10 23:09:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:08.572910 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098ffb2-aa78-45ee-a3a4-bbafcb6ca0a0 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:08.573227 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098ffb2-aa78-45ee-a3a4-bbafcb6ca0a0 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:08.573507 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098ffb2-aa78-45ee-a3a4-bbafcb6ca0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:08.624550 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-3098ffb2-aa78-45ee-a3a4-bbafcb6ca0a0 None None] MFA Rules not processed for user `ce55b64dc528447993e32b00ae4d3a2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:08.625728 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-3098ffb2-aa78-45ee-a3a4-bbafcb6ca0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:08.694149 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 706/1403] 10.222.0.77 () {58 vars in 1039 bytes} [Thu Feb 10 23:09:08 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:08.704127 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5350c-70cc-4f21-bc68-28747bdeea96 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:08.716802 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5350c-70cc-4f21-bc68-28747bdeea96 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:08.721549 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e262f7c-8ba4-43fa-b56f-c7e181ee3b96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce55b64dc528447993e32b00ae4d3a2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:08.722167 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e262f7c-8ba4-43fa-b56f-c7e181ee3b96 service swift] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:08.722446 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e262f7c-8ba4-43fa-b56f-c7e181ee3b96 service swift] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:08.722718 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e262f7c-8ba4-43fa-b56f-c7e181ee3b96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:08.730356 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e262f7c-8ba4-43fa-b56f-c7e181ee3b96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:08.731938 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e262f7c-8ba4-43fa-b56f-c7e181ee3b96 service swift] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:08.739967 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 698/1404] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Feb 10 23:09:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:09:09.710777 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56217d-b039-4dea-9bf5-ff296f49d7c2 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:09.711668 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56217d-b039-4dea-9bf5-ff296f49d7c2 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:09.711976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56217d-b039-4dea-9bf5-ff296f49d7c2 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:09.713780 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 707/1405] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:09.720097 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a4e98-deb7-4458-a38a-7627e2f1be2d None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:09.720879 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a4e98-deb7-4458-a38a-7627e2f1be2d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:09.721315 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a4e98-deb7-4458-a38a-7627e2f1be2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:09.740414 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-a32a4e98-deb7-4458-a38a-7627e2f1be2d None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:09.741832 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a32a4e98-deb7-4458-a38a-7627e2f1be2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:09.750672 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 699/1406] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:09.794489 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56217d-b039-4dea-9bf5-ff296f49d7c2 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:09.808958 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56217d-b039-4dea-9bf5-ff296f49d7c2 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:09.815033 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09c1cc-0a7a-4aea-9f8f-1226857062bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:09.815952 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09c1cc-0a7a-4aea-9f8f-1226857062bd service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:09.816422 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09c1cc-0a7a-4aea-9f8f-1226857062bd service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:09.816697 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09c1cc-0a7a-4aea-9f8f-1226857062bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:09.825338 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09c1cc-0a7a-4aea-9f8f-1226857062bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:09.827876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09c1cc-0a7a-4aea-9f8f-1226857062bd service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:09.841272 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 708/1407] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:09:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:09:12.167963 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b4a77-0753-44d1-8ee0-b7d8121373f9 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:12.168864 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b4a77-0753-44d1-8ee0-b7d8121373f9 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:12.169150 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b4a77-0753-44d1-8ee0-b7d8121373f9 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:12.172801 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 700/1408] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:09:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:12.177666 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc40794-b65e-44ed-8c79-96e3a015a3eb None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:12.178136 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc40794-b65e-44ed-8c79-96e3a015a3eb None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:12.178220 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc40794-b65e-44ed-8c79-96e3a015a3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:12.197742 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-ffc40794-b65e-44ed-8c79-96e3a015a3eb None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:12.198943 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-ffc40794-b65e-44ed-8c79-96e3a015a3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:12.207564 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 709/1409] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:12.253989 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b4a77-0753-44d1-8ee0-b7d8121373f9 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:12.269504 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b4a77-0753-44d1-8ee0-b7d8121373f9 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:12.275629 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560a764-c3c8-42ed-91e8-ff24a1b60d11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:12.276303 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560a764-c3c8-42ed-91e8-ff24a1b60d11 service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:12.276589 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560a764-c3c8-42ed-91e8-ff24a1b60d11 service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:12.276869 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560a764-c3c8-42ed-91e8-ff24a1b60d11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:12.285808 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560a764-c3c8-42ed-91e8-ff24a1b60d11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:12.287388 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560a764-c3c8-42ed-91e8-ff24a1b60d11 service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:12.298892 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 701/1410] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:09:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:09:31.328975 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78680ff8-efc0-4a98-a1e6-6c0d692f8e5b None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:31.329539 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78680ff8-efc0-4a98-a1e6-6c0d692f8e5b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:31.329539 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78680ff8-efc0-4a98-a1e6-6c0d692f8e5b None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:31.331330 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 710/1411] 10.222.0.77 () {54 vars in 918 bytes} [Thu Feb 10 23:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:31.336511 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d622c18-3d9b-4078-ac88-4295bbabc99b None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:31.336898 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d622c18-3d9b-4078-ac88-4295bbabc99b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:31.337064 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d622c18-3d9b-4078-ac88-4295bbabc99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:31.354567 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-5d622c18-3d9b-4078-ac88-4295bbabc99b None None] MFA Rules not processed for user `0f5243eef2a24a518b30526425c0b2c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:31.355741 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-5d622c18-3d9b-4078-ac88-4295bbabc99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:31.364486 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 702/1412] 10.222.0.77 () {58 vars in 1015 bytes} [Thu Feb 10 23:09:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:31.379300 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dfeec-30a7-47eb-87f2-08d9d7bbc10f None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:31.379612 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dfeec-30a7-47eb-87f2-08d9d7bbc10f None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:31.379911 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dfeec-30a7-47eb-87f2-08d9d7bbc10f None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:31.381689 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 711/1413] 10.222.0.77 () {54 vars in 918 bytes} [Thu Feb 10 23:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:31.386130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec0249-3b66-47b0-863f-bf6cf40e4129 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:31.386427 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec0249-3b66-47b0-863f-bf6cf40e4129 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:31.386714 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec0249-3b66-47b0-863f-bf6cf40e4129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:31.404927 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-e2ec0249-3b66-47b0-863f-bf6cf40e4129 None None] MFA Rules not processed for user `551da2c9fab74cb8b14287a5634adb25`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:31.406096 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e2ec0249-3b66-47b0-863f-bf6cf40e4129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:31.415004 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 703/1414] 10.222.0.77 () {58 vars in 1015 bytes} [Thu Feb 10 23:09:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:34.050476 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c3166-8722-4985-89ba-706efe9e0ac1 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:34.051091 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c3166-8722-4985-89ba-706efe9e0ac1 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:34.051091 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c3166-8722-4985-89ba-706efe9e0ac1 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:34.052850 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 712/1415] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 23:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:34.058133 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd27c2b-0036-4552-9007-787c9455fe80 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:34.058579 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd27c2b-0036-4552-9007-787c9455fe80 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:34.058688 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd27c2b-0036-4552-9007-787c9455fe80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:34.077310 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-2fd27c2b-0036-4552-9007-787c9455fe80 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:34.078492 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-2fd27c2b-0036-4552-9007-787c9455fe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:34.086300 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 704/1416] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 23:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:34.129047 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c3166-8722-4985-89ba-706efe9e0ac1 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:34.143355 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c3166-8722-4985-89ba-706efe9e0ac1 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:34.148592 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d5c57-55c1-4f6b-ab26-a86316d8548b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:34.149212 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d5c57-55c1-4f6b-ab26-a86316d8548b service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:34.149492 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d5c57-55c1-4f6b-ab26-a86316d8548b service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:34.149763 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d5c57-55c1-4f6b-ab26-a86316d8548b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:34.158150 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d5c57-55c1-4f6b-ab26-a86316d8548b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:34.159699 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d5c57-55c1-4f6b-ab26-a86316d8548b service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:34.168669 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 713/1417] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:09:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:09:35.512247 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e7b18-dffa-4a59-9181-a31accc5ee74 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:35.513544 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e7b18-dffa-4a59-9181-a31accc5ee74 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:35.513544 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e7b18-dffa-4a59-9181-a31accc5ee74 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:35.515061 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 705/1418] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 23:09:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:35.520281 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34036360-19ab-4e38-b07c-10b4e394a6c2 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:35.520720 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34036360-19ab-4e38-b07c-10b4e394a6c2 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:35.520858 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34036360-19ab-4e38-b07c-10b4e394a6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:35.539392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-34036360-19ab-4e38-b07c-10b4e394a6c2 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:35.540593 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-34036360-19ab-4e38-b07c-10b4e394a6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:35.548745 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 714/1419] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 23:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:09:35.705397 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e7b18-dffa-4a59-9181-a31accc5ee74 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:35.719571 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e7b18-dffa-4a59-9181-a31accc5ee74 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:35.724905 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1200a-7704-4cfa-b3ab-511954ad899d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:35.725531 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1200a-7704-4cfa-b3ab-511954ad899d service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:35.725814 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1200a-7704-4cfa-b3ab-511954ad899d service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:35.726092 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1200a-7704-4cfa-b3ab-511954ad899d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:35.734270 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1200a-7704-4cfa-b3ab-511954ad899d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:35.735842 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1200a-7704-4cfa-b3ab-511954ad899d service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:35.745133 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 706/1420] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:09:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:09:37.066715 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2e615-4452-4cd5-9f14-4cb46e49a9af None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:37.067295 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2e615-4452-4cd5-9f14-4cb46e49a9af None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:37.067295 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2e615-4452-4cd5-9f14-4cb46e49a9af None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:37.069086 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 715/1421] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 23:09:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:37.073939 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc7185-80c3-455e-81fd-58ae57b1f917 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:37.074369 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc7185-80c3-455e-81fd-58ae57b1f917 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:37.074500 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc7185-80c3-455e-81fd-58ae57b1f917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:37.094109 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-0dcc7185-80c3-455e-81fd-58ae57b1f917 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:37.095284 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-0dcc7185-80c3-455e-81fd-58ae57b1f917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:37.102922 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 707/1422] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 23:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:37.259126 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2e615-4452-4cd5-9f14-4cb46e49a9af None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:37.273014 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2e615-4452-4cd5-9f14-4cb46e49a9af None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:37.278842 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37ce4c-9521-4c1e-93d3-ee582931d851 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:37.279465 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37ce4c-9521-4c1e-93d3-ee582931d851 service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:37.279743 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37ce4c-9521-4c1e-93d3-ee582931d851 service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:37.280043 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37ce4c-9521-4c1e-93d3-ee582931d851 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:37.287921 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37ce4c-9521-4c1e-93d3-ee582931d851 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:37.289469 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37ce4c-9521-4c1e-93d3-ee582931d851 service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:37.299216 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 716/1423] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:09:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:09:38.606179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec256a4-57a0-4e73-b102-a15f9ada259f None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:38.606745 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec256a4-57a0-4e73-b102-a15f9ada259f None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:38.606943 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec256a4-57a0-4e73-b102-a15f9ada259f None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:38.608750 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 708/1424] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 23:09:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:38.613685 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc3d51-9f34-4fc1-b7c7-3d6eeb9a50b9 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:38.614349 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc3d51-9f34-4fc1-b7c7-3d6eeb9a50b9 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:38.614512 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc3d51-9f34-4fc1-b7c7-3d6eeb9a50b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:38.632587 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-36cc3d51-9f34-4fc1-b7c7-3d6eeb9a50b9 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:38.633765 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-36cc3d51-9f34-4fc1-b7c7-3d6eeb9a50b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:38.641881 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 717/1425] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 23:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:38.791977 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec256a4-57a0-4e73-b102-a15f9ada259f None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:38.805870 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec256a4-57a0-4e73-b102-a15f9ada259f None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:38.811639 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9dc9a-e180-4ef4-91f8-6d35b0ec87b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:38.812300 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9dc9a-e180-4ef4-91f8-6d35b0ec87b1 service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:38.812584 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9dc9a-e180-4ef4-91f8-6d35b0ec87b1 service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:38.812858 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9dc9a-e180-4ef4-91f8-6d35b0ec87b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:38.820689 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9dc9a-e180-4ef4-91f8-6d35b0ec87b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:38.822236 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9dc9a-e180-4ef4-91f8-6d35b0ec87b1 service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:38.832345 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 709/1426] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:09:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:09:40.147926 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fe5ed-a116-4b51-97ea-b329723d62fe None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:40.148500 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fe5ed-a116-4b51-97ea-b329723d62fe None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:40.148500 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fe5ed-a116-4b51-97ea-b329723d62fe None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:40.150292 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 718/1427] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 23:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:40.155944 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad887c5-056d-49c6-8cd7-4dcee5f1607f None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:40.156388 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad887c5-056d-49c6-8cd7-4dcee5f1607f None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:40.156513 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad887c5-056d-49c6-8cd7-4dcee5f1607f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:40.174539 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-9ad887c5-056d-49c6-8cd7-4dcee5f1607f None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:40.175708 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-9ad887c5-056d-49c6-8cd7-4dcee5f1607f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:40.183579 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 710/1428] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 23:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:40.336199 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fe5ed-a116-4b51-97ea-b329723d62fe None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:40.350409 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fe5ed-a116-4b51-97ea-b329723d62fe None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:40.355714 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf4f71-03e6-41d7-8415-adb5e286b3be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:40.356952 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf4f71-03e6-41d7-8415-adb5e286b3be service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:40.357248 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf4f71-03e6-41d7-8415-adb5e286b3be service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:40.357513 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf4f71-03e6-41d7-8415-adb5e286b3be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:40.365660 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf4f71-03e6-41d7-8415-adb5e286b3be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:40.367252 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf4f71-03e6-41d7-8415-adb5e286b3be service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:40.376512 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 719/1429] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:09:41.641659 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4b62a-1d6b-4e6c-bd41-f455ff8385bf None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:41.642231 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4b62a-1d6b-4e6c-bd41-f455ff8385bf None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:41.642231 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4b62a-1d6b-4e6c-bd41-f455ff8385bf None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:41.644019 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 711/1430] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 23:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:41.649045 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247ab6d-dfde-4957-ab70-21b8c5fb5849 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:41.649483 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247ab6d-dfde-4957-ab70-21b8c5fb5849 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:41.649585 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247ab6d-dfde-4957-ab70-21b8c5fb5849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:41.667393 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-a247ab6d-dfde-4957-ab70-21b8c5fb5849 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:41.668587 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a247ab6d-dfde-4957-ab70-21b8c5fb5849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:41.676793 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 720/1431] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 23:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:41.825903 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4b62a-1d6b-4e6c-bd41-f455ff8385bf None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:41.839436 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4b62a-1d6b-4e6c-bd41-f455ff8385bf None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:41.845294 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe1394-0e83-44d3-b6e6-19482fbec485 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:41.845908 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe1394-0e83-44d3-b6e6-19482fbec485 service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:41.846186 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe1394-0e83-44d3-b6e6-19482fbec485 service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:41.846455 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe1394-0e83-44d3-b6e6-19482fbec485 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:41.854174 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe1394-0e83-44d3-b6e6-19482fbec485 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:41.855724 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe1394-0e83-44d3-b6e6-19482fbec485 service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:41.865857 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 712/1432] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:09:43.123177 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b9a97-4b4a-465a-9a01-d073b975f1a8 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:43.123737 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b9a97-4b4a-465a-9a01-d073b975f1a8 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:43.123737 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b9a97-4b4a-465a-9a01-d073b975f1a8 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:43.125595 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 721/1433] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 23:09:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:43.130879 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87fd20-ee7a-44d5-b82a-8f23270d87c4 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:43.131323 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87fd20-ee7a-44d5-b82a-8f23270d87c4 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:43.131425 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87fd20-ee7a-44d5-b82a-8f23270d87c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:43.149532 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-4f87fd20-ee7a-44d5-b82a-8f23270d87c4 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:43.150710 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-4f87fd20-ee7a-44d5-b82a-8f23270d87c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:43.159545 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 713/1434] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 23:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:43.309517 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b9a97-4b4a-465a-9a01-d073b975f1a8 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:43.324610 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b9a97-4b4a-465a-9a01-d073b975f1a8 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:43.330773 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b2fc8-e197-4691-ba58-73d5cdb9ead0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:43.331451 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b2fc8-e197-4691-ba58-73d5cdb9ead0 service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:43.331686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b2fc8-e197-4691-ba58-73d5cdb9ead0 service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:43.332001 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b2fc8-e197-4691-ba58-73d5cdb9ead0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:43.339987 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b2fc8-e197-4691-ba58-73d5cdb9ead0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:43.341680 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b2fc8-e197-4691-ba58-73d5cdb9ead0 service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:43.350747 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 722/1435] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:09:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:09:44.635382 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b731bf-faa5-491d-bf6e-cff99782c4a9 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:44.635938 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b731bf-faa5-491d-bf6e-cff99782c4a9 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:44.635938 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b731bf-faa5-491d-bf6e-cff99782c4a9 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:44.637912 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 714/1436] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 23:09:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:44.643045 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa211a-1a44-462f-9ea1-0a5fd5aa02d9 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:44.643480 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa211a-1a44-462f-9ea1-0a5fd5aa02d9 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:44.643629 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa211a-1a44-462f-9ea1-0a5fd5aa02d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:44.662152 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-09aa211a-1a44-462f-9ea1-0a5fd5aa02d9 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:44.663321 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-09aa211a-1a44-462f-9ea1-0a5fd5aa02d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:44.671593 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 723/1437] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 23:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:44.822406 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b731bf-faa5-491d-bf6e-cff99782c4a9 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:44.836516 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b731bf-faa5-491d-bf6e-cff99782c4a9 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:44.842573 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20fc24-25e7-4b6d-a1f5-30d94772bb6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:44.843195 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20fc24-25e7-4b6d-a1f5-30d94772bb6b service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:44.843477 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20fc24-25e7-4b6d-a1f5-30d94772bb6b service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:44.843751 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20fc24-25e7-4b6d-a1f5-30d94772bb6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:44.851559 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20fc24-25e7-4b6d-a1f5-30d94772bb6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:44.853154 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20fc24-25e7-4b6d-a1f5-30d94772bb6b service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:44.863095 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 715/1438] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:09:46.129653 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac32a4-4af9-450d-b820-a94a09b19439 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:46.130158 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac32a4-4af9-450d-b820-a94a09b19439 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:46.130158 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac32a4-4af9-450d-b820-a94a09b19439 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:46.131914 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 724/1439] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 23:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 23:09:46.136972 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0201eed-3dc0-4289-bfe0-24d7fa9310cc None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:46.137512 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0201eed-3dc0-4289-bfe0-24d7fa9310cc None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:46.137637 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0201eed-3dc0-4289-bfe0-24d7fa9310cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:46.155495 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-e0201eed-3dc0-4289-bfe0-24d7fa9310cc None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:46.156718 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e0201eed-3dc0-4289-bfe0-24d7fa9310cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:46.164221 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 716/1440] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 23:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:46.314549 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac32a4-4af9-450d-b820-a94a09b19439 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:46.328972 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac32a4-4af9-450d-b820-a94a09b19439 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:46.334261 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254b946-a8f1-4c28-98c8-ae37117a058f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:46.334879 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254b946-a8f1-4c28-98c8-ae37117a058f service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:46.335157 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254b946-a8f1-4c28-98c8-ae37117a058f service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:46.335427 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254b946-a8f1-4c28-98c8-ae37117a058f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:46.343806 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254b946-a8f1-4c28-98c8-ae37117a058f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:46.345386 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254b946-a8f1-4c28-98c8-ae37117a058f service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:46.354302 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 725/1441] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:09:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:09:48.469696 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7546c0f-7923-4b30-ab42-81228e4dbfdc None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:48.470238 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7546c0f-7923-4b30-ab42-81228e4dbfdc None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:48.470238 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7546c0f-7923-4b30-ab42-81228e4dbfdc None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:48.472078 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 717/1442] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 23:09:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:48.477327 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c7906-3d65-4fdf-bd64-a8d7aa714381 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:48.477791 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c7906-3d65-4fdf-bd64-a8d7aa714381 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:48.477899 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c7906-3d65-4fdf-bd64-a8d7aa714381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:48.495812 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-7a6c7906-3d65-4fdf-bd64-a8d7aa714381 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:48.497572 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-7a6c7906-3d65-4fdf-bd64-a8d7aa714381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:48.505050 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 726/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 23:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:48.543511 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7546c0f-7923-4b30-ab42-81228e4dbfdc None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:48.553988 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7546c0f-7923-4b30-ab42-81228e4dbfdc None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:48.557486 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca731b-11fa-4d17-8d17-18f6af1e73a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:48.558160 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca731b-11fa-4d17-8d17-18f6af1e73a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:48.558437 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca731b-11fa-4d17-8d17-18f6af1e73a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:48.558706 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca731b-11fa-4d17-8d17-18f6af1e73a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:48.568232 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca731b-11fa-4d17-8d17-18f6af1e73a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:48.569628 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca731b-11fa-4d17-8d17-18f6af1e73a5 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:48.579319 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 718/1444] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:09:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:09:50.984523 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350086a-c3c9-47c8-a2f3-1c528cc0a88c None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:50.985133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350086a-c3c9-47c8-a2f3-1c528cc0a88c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:50.985133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350086a-c3c9-47c8-a2f3-1c528cc0a88c None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:50.987080 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 727/1445] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 23:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:50.993057 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6db6d-a742-4234-abff-afb3f47c1b99 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:50.993504 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6db6d-a742-4234-abff-afb3f47c1b99 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:50.993625 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6db6d-a742-4234-abff-afb3f47c1b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:51.012280 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-e3b6db6d-a742-4234-abff-afb3f47c1b99 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:51.014437 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e3b6db6d-a742-4234-abff-afb3f47c1b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:51.022373 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 719/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 23:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:51.062158 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350086a-c3c9-47c8-a2f3-1c528cc0a88c None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:51.072487 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350086a-c3c9-47c8-a2f3-1c528cc0a88c None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:51.076497 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1619c76-d712-4664-a0f8-e4b0336069de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:51.077129 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1619c76-d712-4664-a0f8-e4b0336069de service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:51.077408 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1619c76-d712-4664-a0f8-e4b0336069de service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:51.077677 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1619c76-d712-4664-a0f8-e4b0336069de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:51.087408 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1619c76-d712-4664-a0f8-e4b0336069de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:51.088888 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1619c76-d712-4664-a0f8-e4b0336069de service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:51.098650 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 728/1447] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:09:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:09:53.658596 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d1e8e-880f-4058-bcf9-c4a0fbe4e48e None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:53.659168 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d1e8e-880f-4058-bcf9-c4a0fbe4e48e None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:53.659168 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d1e8e-880f-4058-bcf9-c4a0fbe4e48e None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:53.661054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 720/1448] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 23:09:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:53.666917 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67747678-6db2-4117-93da-0209f5582062 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:53.667329 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67747678-6db2-4117-93da-0209f5582062 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:53.667578 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67747678-6db2-4117-93da-0209f5582062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:53.686713 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-67747678-6db2-4117-93da-0209f5582062 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:53.687933 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-67747678-6db2-4117-93da-0209f5582062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:53.695599 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 729/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 23:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:53.735305 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d1e8e-880f-4058-bcf9-c4a0fbe4e48e None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:53.746003 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d1e8e-880f-4058-bcf9-c4a0fbe4e48e None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:53.749717 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834b040-1427-4f51-b80f-e866e4ccf7ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:53.750338 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834b040-1427-4f51-b80f-e866e4ccf7ba service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:53.750623 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834b040-1427-4f51-b80f-e866e4ccf7ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:53.750897 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834b040-1427-4f51-b80f-e866e4ccf7ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:53.759518 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834b040-1427-4f51-b80f-e866e4ccf7ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:53.760972 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834b040-1427-4f51-b80f-e866e4ccf7ba service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:53.770054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 721/1450] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:09:56.171453 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e9339-5dc9-415b-b016-a9c201e420ef None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:56.172061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e9339-5dc9-415b-b016-a9c201e420ef None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:56.172061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e9339-5dc9-415b-b016-a9c201e420ef None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:56.173814 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 730/1451] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 23:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:56.179095 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba40a9-9d61-4e57-ae70-42b1315e6da2 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:56.179482 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba40a9-9d61-4e57-ae70-42b1315e6da2 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:56.179651 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba40a9-9d61-4e57-ae70-42b1315e6da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:56.197298 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-35ba40a9-9d61-4e57-ae70-42b1315e6da2 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:56.198471 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-35ba40a9-9d61-4e57-ae70-42b1315e6da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:56.206546 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 722/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 23:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:56.245855 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e9339-5dc9-415b-b016-a9c201e420ef None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:56.256463 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e9339-5dc9-415b-b016-a9c201e420ef None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:56.259966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e90e2-dc8a-4aab-87ad-40cf18056fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:56.260592 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e90e2-dc8a-4aab-87ad-40cf18056fac service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:56.260877 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e90e2-dc8a-4aab-87ad-40cf18056fac service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:56.261153 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e90e2-dc8a-4aab-87ad-40cf18056fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:56.269936 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e90e2-dc8a-4aab-87ad-40cf18056fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:56.271347 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e90e2-dc8a-4aab-87ad-40cf18056fac service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:56.281013 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 731/1453] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:09:58.678472 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd14ccd-4923-45b4-9e86-e755265e036d None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:58.679049 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd14ccd-4923-45b4-9e86-e755265e036d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:58.679049 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd14ccd-4923-45b4-9e86-e755265e036d None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:58.680844 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 723/1454] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 23:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:09:58.686359 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc15693-5fcd-4125-b400-a7be065f0b4c None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:58.686852 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc15693-5fcd-4125-b400-a7be065f0b4c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:58.686980 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc15693-5fcd-4125-b400-a7be065f0b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:58.704901 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-5bc15693-5fcd-4125-b400-a7be065f0b4c None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:09:58.706064 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-5bc15693-5fcd-4125-b400-a7be065f0b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:09:58.713602 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 732/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 23:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:09:58.751773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd14ccd-4923-45b4-9e86-e755265e036d None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:09:58.762784 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd14ccd-4923-45b4-9e86-e755265e036d None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:09:58.766371 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5b904-869c-449a-931c-cd265cb88d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:09:58.766994 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5b904-869c-449a-931c-cd265cb88d42 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:09:58.767279 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5b904-869c-449a-931c-cd265cb88d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:09:58.767562 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5b904-869c-449a-931c-cd265cb88d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:09:58.776317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5b904-869c-449a-931c-cd265cb88d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:09:58.778347 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5b904-869c-449a-931c-cd265cb88d42 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:09:58.787407 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 724/1456] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:10:01.079911 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77431b66-5995-401b-9f17-844ea96b5443 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:01.080463 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77431b66-5995-401b-9f17-844ea96b5443 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:01.080463 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77431b66-5995-401b-9f17-844ea96b5443 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:01.082297 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 733/1457] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 23:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:10:01.087764 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48e9c0-8c3c-4d2e-bc35-899f7ebf4fe0 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:01.088210 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48e9c0-8c3c-4d2e-bc35-899f7ebf4fe0 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:01.088363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48e9c0-8c3c-4d2e-bc35-899f7ebf4fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:01.107130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-0f48e9c0-8c3c-4d2e-bc35-899f7ebf4fe0 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:10:01.108335 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-0f48e9c0-8c3c-4d2e-bc35-899f7ebf4fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:10:01.116322 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 725/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 23:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:10:01.154920 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77431b66-5995-401b-9f17-844ea96b5443 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:10:01.165510 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77431b66-5995-401b-9f17-844ea96b5443 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:10:01.169236 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed4fed-eab7-42ad-849b-120887f34d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:10:01.169866 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed4fed-eab7-42ad-849b-120887f34d33 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:01.170147 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed4fed-eab7-42ad-849b-120887f34d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:01.170423 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed4fed-eab7-42ad-849b-120887f34d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:01.179229 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed4fed-eab7-42ad-849b-120887f34d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:10:01.180676 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed4fed-eab7-42ad-849b-120887f34d33 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:10:01.190456 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 734/1459] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:10:03.422875 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c20eb0-14e2-4f5f-b3a2-708aba3bedf5 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:03.423481 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c20eb0-14e2-4f5f-b3a2-708aba3bedf5 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:03.423481 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c20eb0-14e2-4f5f-b3a2-708aba3bedf5 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:03.425217 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 726/1460] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 23:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:10:03.430572 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac2043-6081-4f92-8eac-2fbecee53dbc None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:03.431016 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac2043-6081-4f92-8eac-2fbecee53dbc None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:03.431114 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac2043-6081-4f92-8eac-2fbecee53dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:03.448951 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-5aac2043-6081-4f92-8eac-2fbecee53dbc None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:10:03.450400 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-5aac2043-6081-4f92-8eac-2fbecee53dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:10:03.457939 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 735/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 23:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:10:03.495454 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c20eb0-14e2-4f5f-b3a2-708aba3bedf5 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:10:03.505731 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c20eb0-14e2-4f5f-b3a2-708aba3bedf5 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:10:03.509145 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663849c9-759f-4b76-ada4-ff90480b9279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:10:03.509758 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663849c9-759f-4b76-ada4-ff90480b9279 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:03.510040 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663849c9-759f-4b76-ada4-ff90480b9279 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:03.510312 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663849c9-759f-4b76-ada4-ff90480b9279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:03.518925 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663849c9-759f-4b76-ada4-ff90480b9279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:10:03.520369 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663849c9-759f-4b76-ada4-ff90480b9279 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:10:03.529746 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 727/1462] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:10:05.777444 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63026d-b264-4d28-9ef7-6872400e0fe9 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:05.778045 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63026d-b264-4d28-9ef7-6872400e0fe9 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:05.778180 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63026d-b264-4d28-9ef7-6872400e0fe9 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:05.779970 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 736/1463] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 23:10:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:10:05.785481 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479942d7-5c91-470a-839c-3aa820ffae3d None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:05.785912 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479942d7-5c91-470a-839c-3aa820ffae3d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:05.786071 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479942d7-5c91-470a-839c-3aa820ffae3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:05.803415 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-479942d7-5c91-470a-839c-3aa820ffae3d None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:10:05.804616 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-479942d7-5c91-470a-839c-3aa820ffae3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:10:05.813015 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 728/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 23:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:10:05.850164 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63026d-b264-4d28-9ef7-6872400e0fe9 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:10:05.860786 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63026d-b264-4d28-9ef7-6872400e0fe9 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:10:05.864607 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de3345-fd5f-4d0d-a214-77e396048f91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:10:05.865263 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de3345-fd5f-4d0d-a214-77e396048f91 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:05.865547 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de3345-fd5f-4d0d-a214-77e396048f91 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:05.865822 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de3345-fd5f-4d0d-a214-77e396048f91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:05.875023 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de3345-fd5f-4d0d-a214-77e396048f91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:10:05.876484 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de3345-fd5f-4d0d-a214-77e396048f91 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:10:05.885501 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 737/1465] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:10:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:10:08.093392 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384394ac-ce71-4c8e-90b6-e1e54ce8f103 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:08.093902 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384394ac-ce71-4c8e-90b6-e1e54ce8f103 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:08.094040 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384394ac-ce71-4c8e-90b6-e1e54ce8f103 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:08.095704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 729/1466] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 23:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:10:08.101019 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3064121-e799-4e3c-a2b1-39a9e932f758 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:08.101468 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3064121-e799-4e3c-a2b1-39a9e932f758 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:08.101586 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3064121-e799-4e3c-a2b1-39a9e932f758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:08.119936 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-c3064121-e799-4e3c-a2b1-39a9e932f758 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:10:08.121218 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-c3064121-e799-4e3c-a2b1-39a9e932f758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:10:08.128942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 738/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 23:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:10:08.166326 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384394ac-ce71-4c8e-90b6-e1e54ce8f103 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:10:08.177279 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384394ac-ce71-4c8e-90b6-e1e54ce8f103 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:10:08.180823 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb918ba-fedf-41f6-82a0-0b010293a23e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:10:08.181389 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb918ba-fedf-41f6-82a0-0b010293a23e service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:08.181674 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb918ba-fedf-41f6-82a0-0b010293a23e service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:08.181953 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb918ba-fedf-41f6-82a0-0b010293a23e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:08.190868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb918ba-fedf-41f6-82a0-0b010293a23e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:10:08.192326 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb918ba-fedf-41f6-82a0-0b010293a23e service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:10:08.201890 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 730/1468] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:10:10.416067 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebb94e-0bcd-49f9-9002-908980bef268 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:10.416685 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebb94e-0bcd-49f9-9002-908980bef268 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:10.416685 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebb94e-0bcd-49f9-9002-908980bef268 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:10.418649 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 739/1469] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 23:10:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:10:10.424055 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd424419-a187-49a3-8708-6c66041e8941 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:10.424483 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd424419-a187-49a3-8708-6c66041e8941 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:10.424589 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd424419-a187-49a3-8708-6c66041e8941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:10.442664 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-fd424419-a187-49a3-8708-6c66041e8941 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:10:10.443847 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-fd424419-a187-49a3-8708-6c66041e8941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:10:10.451926 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 731/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 23:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:10:10.487895 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebb94e-0bcd-49f9-9002-908980bef268 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:10:10.499169 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebb94e-0bcd-49f9-9002-908980bef268 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:10:10.502589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925da599-fa68-440c-a41a-b6897b7bf8ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:10:10.503209 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925da599-fa68-440c-a41a-b6897b7bf8ab service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:10.503488 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925da599-fa68-440c-a41a-b6897b7bf8ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:10.503760 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925da599-fa68-440c-a41a-b6897b7bf8ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:10.512864 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925da599-fa68-440c-a41a-b6897b7bf8ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:10:10.514268 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925da599-fa68-440c-a41a-b6897b7bf8ab service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:10:10.523200 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 740/1471] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:10:26.759514 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a99d5-049d-45df-a4fe-3784de690d4c None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:26.760145 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a99d5-049d-45df-a4fe-3784de690d4c None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:26.760145 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a99d5-049d-45df-a4fe-3784de690d4c None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:26.762510 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 732/1472] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:10:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:10:26.767786 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96522a6-01fd-4e1d-bceb-57d094d2b6f0 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:26.768252 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96522a6-01fd-4e1d-bceb-57d094d2b6f0 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:26.768350 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96522a6-01fd-4e1d-bceb-57d094d2b6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:26.785782 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-d96522a6-01fd-4e1d-bceb-57d094d2b6f0 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:10:26.786941 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d96522a6-01fd-4e1d-bceb-57d094d2b6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:10:26.794768 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 741/1473] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:10:26.841219 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922b2f0-34d8-4820-a8eb-d901211a5c22 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:26.841513 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922b2f0-34d8-4820-a8eb-d901211a5c22 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:26.841823 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922b2f0-34d8-4820-a8eb-d901211a5c22 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:26.843564 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 733/1474] 10.222.0.77 () {54 vars in 962 bytes} [Thu Feb 10 23:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:10:26.848157 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07efd62-d2b2-45df-a52b-cc82f1a66f2a None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:26.848447 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07efd62-d2b2-45df-a52b-cc82f1a66f2a None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:26.848721 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07efd62-d2b2-45df-a52b-cc82f1a66f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:26.866341 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-c07efd62-d2b2-45df-a52b-cc82f1a66f2a None None] MFA Rules not processed for user `d367d4b48c634351a427f2f1b468d4ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:10:26.867484 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-c07efd62-d2b2-45df-a52b-cc82f1a66f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:10:26.874521 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 742/1475] 10.222.0.77 () {58 vars in 1059 bytes} [Thu Feb 10 23:10:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:10:26.881417 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922b2f0-34d8-4820-a8eb-d901211a5c22 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:10:26.892822 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922b2f0-34d8-4820-a8eb-d901211a5c22 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:10:26.896317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06f08c-6439-4ac2-af68-cad81ff0e4af service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd367d4b48c634351a427f2f1b468d4ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:10:26.896938 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06f08c-6439-4ac2-af68-cad81ff0e4af service glance] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:26.897215 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06f08c-6439-4ac2-af68-cad81ff0e4af service glance] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:26.897493 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06f08c-6439-4ac2-af68-cad81ff0e4af service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:26.906032 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06f08c-6439-4ac2-af68-cad81ff0e4af service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:10:26.907429 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06f08c-6439-4ac2-af68-cad81ff0e4af service glance] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:10:26.916354 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 734/1476] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:10:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:10:29.234270 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e74293-a125-4d09-b635-3ba452eb7209 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:29.234824 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e74293-a125-4d09-b635-3ba452eb7209 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:29.234824 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e74293-a125-4d09-b635-3ba452eb7209 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:29.236659 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 743/1477] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:10:29.242426 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7344a4-d603-4832-bb9b-676c648722ad None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:29.242853 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7344a4-d603-4832-bb9b-676c648722ad None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:29.242959 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7344a4-d603-4832-bb9b-676c648722ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:29.260604 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-cf7344a4-d603-4832-bb9b-676c648722ad None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:10:29.261934 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-cf7344a4-d603-4832-bb9b-676c648722ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:10:29.269557 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 735/1478] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:10:29.293803 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e74293-a125-4d09-b635-3ba452eb7209 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:10:29.305756 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e74293-a125-4d09-b635-3ba452eb7209 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:10:29.310427 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0219b-8174-4c0e-82b2-916a5df72bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:10:29.311059 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0219b-8174-4c0e-82b2-916a5df72bcb admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:29.311341 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0219b-8174-4c0e-82b2-916a5df72bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:29.311614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0219b-8174-4c0e-82b2-916a5df72bcb admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:29.312396 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0219b-8174-4c0e-82b2-916a5df72bcb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:10:29.314201 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0219b-8174-4c0e-82b2-916a5df72bcb admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:10:29.330826 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 744/1479] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Feb 10 23:10:29 2022] GET /identity/v3/projects => generated 2553 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:10:31.553978 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5ad4e-ce2a-4e55-bd9c-cac050e5a57d None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:31.554551 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5ad4e-ce2a-4e55-bd9c-cac050e5a57d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:31.554551 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5ad4e-ce2a-4e55-bd9c-cac050e5a57d None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:31.556403 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 736/1480] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:10:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:10:31.562408 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b355e9-bcf9-4190-9cff-7d84243e43cf None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:31.562849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b355e9-bcf9-4190-9cff-7d84243e43cf None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:31.562956 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b355e9-bcf9-4190-9cff-7d84243e43cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:31.580271 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-96b355e9-bcf9-4190-9cff-7d84243e43cf None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:10:31.581435 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-96b355e9-bcf9-4190-9cff-7d84243e43cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:10:31.588878 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 745/1481] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:10:31.630744 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5ad4e-ce2a-4e55-bd9c-cac050e5a57d None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:10:31.644791 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5ad4e-ce2a-4e55-bd9c-cac050e5a57d None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:10:31.650080 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b41b6-769b-4f59-997b-b97c9c2deed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:10:31.650703 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b41b6-769b-4f59-997b-b97c9c2deed5 service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:31.650987 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b41b6-769b-4f59-997b-b97c9c2deed5 service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:31.651266 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b41b6-769b-4f59-997b-b97c9c2deed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:31.659085 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b41b6-769b-4f59-997b-b97c9c2deed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:10:31.660697 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b41b6-769b-4f59-997b-b97c9c2deed5 service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:10:31.670208 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 737/1482] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:10:34.074752 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dff33-b7fb-41e7-8f52-17521f4f109d None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:34.075334 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dff33-b7fb-41e7-8f52-17521f4f109d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:34.075334 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dff33-b7fb-41e7-8f52-17521f4f109d None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:34.077178 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 746/1483] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:10:34.082782 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dfec5-1009-4be8-ac1b-b85d879b2ca2 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:34.083268 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dfec5-1009-4be8-ac1b-b85d879b2ca2 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:34.083374 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dfec5-1009-4be8-ac1b-b85d879b2ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:34.101621 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-144dfec5-1009-4be8-ac1b-b85d879b2ca2 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:10:34.102800 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-144dfec5-1009-4be8-ac1b-b85d879b2ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:10:34.110732 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 738/1484] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:10:34.147476 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dff33-b7fb-41e7-8f52-17521f4f109d None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:10:34.158328 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dff33-b7fb-41e7-8f52-17521f4f109d None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:10:34.161774 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b815f28-c66f-4823-9340-cc332d27f0ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:10:34.162391 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b815f28-c66f-4823-9340-cc332d27f0ee service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:34.162669 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b815f28-c66f-4823-9340-cc332d27f0ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:34.162940 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b815f28-c66f-4823-9340-cc332d27f0ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:34.171679 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b815f28-c66f-4823-9340-cc332d27f0ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:10:34.173141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b815f28-c66f-4823-9340-cc332d27f0ee service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:10:34.182065 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 747/1485] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:10:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:10:36.423560 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af29b87-fedb-406f-96f2-93cdb7b4c436 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:36.424171 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af29b87-fedb-406f-96f2-93cdb7b4c436 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:36.424171 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af29b87-fedb-406f-96f2-93cdb7b4c436 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:36.425957 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 739/1486] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:10:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:10:36.431146 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43e8d0-70bf-4a72-9eb8-1d66213dfd0d None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:36.431574 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43e8d0-70bf-4a72-9eb8-1d66213dfd0d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:36.431707 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43e8d0-70bf-4a72-9eb8-1d66213dfd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:36.449990 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-1c43e8d0-70bf-4a72-9eb8-1d66213dfd0d None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:10:36.451172 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-1c43e8d0-70bf-4a72-9eb8-1d66213dfd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:10:36.458800 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 748/1487] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:10:36.497425 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af29b87-fedb-406f-96f2-93cdb7b4c436 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:10:36.507762 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af29b87-fedb-406f-96f2-93cdb7b4c436 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:10:36.511761 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d5db2-c23b-49f4-b45a-20ea88c3efd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:10:36.512417 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d5db2-c23b-49f4-b45a-20ea88c3efd1 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:36.512698 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d5db2-c23b-49f4-b45a-20ea88c3efd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:36.512970 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d5db2-c23b-49f4-b45a-20ea88c3efd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:36.521608 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d5db2-c23b-49f4-b45a-20ea88c3efd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:10:36.523022 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d5db2-c23b-49f4-b45a-20ea88c3efd1 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:10:36.532780 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 740/1488] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:10:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:10:38.925094 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6358441-19f7-4120-9ea8-7389ca2a0d8d None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:38.925665 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6358441-19f7-4120-9ea8-7389ca2a0d8d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:38.925665 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6358441-19f7-4120-9ea8-7389ca2a0d8d None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:38.927414 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 749/1489] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:10:38.933435 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f8aae-e875-4cff-bbbe-05479134293a None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:38.933852 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f8aae-e875-4cff-bbbe-05479134293a None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:38.934083 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f8aae-e875-4cff-bbbe-05479134293a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:38.951244 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-b74f8aae-e875-4cff-bbbe-05479134293a None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:10:38.952437 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-b74f8aae-e875-4cff-bbbe-05479134293a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:10:38.959933 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 741/1490] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:10:39.000894 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6358441-19f7-4120-9ea8-7389ca2a0d8d None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:10:39.011640 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6358441-19f7-4120-9ea8-7389ca2a0d8d None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:10:39.015125 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f48a30-4d3f-4c7a-844f-95e62217525e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:10:39.015743 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f48a30-4d3f-4c7a-844f-95e62217525e service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:39.016051 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f48a30-4d3f-4c7a-844f-95e62217525e service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:39.016321 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f48a30-4d3f-4c7a-844f-95e62217525e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:39.024980 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f48a30-4d3f-4c7a-844f-95e62217525e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:10:39.026372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f48a30-4d3f-4c7a-844f-95e62217525e service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:10:39.035651 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 750/1491] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:10:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:10:41.403146 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28746d0f-6870-45ec-a25d-a616da95fbc9 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:41.403729 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28746d0f-6870-45ec-a25d-a616da95fbc9 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:41.403729 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28746d0f-6870-45ec-a25d-a616da95fbc9 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:41.405491 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 742/1492] 10.222.0.77 () {54 vars in 926 bytes} [Thu Feb 10 23:10:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:10:41.410791 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481db7e-717f-4a76-83a1-85e64eeca0cf None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:41.411179 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481db7e-717f-4a76-83a1-85e64eeca0cf None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:41.411338 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481db7e-717f-4a76-83a1-85e64eeca0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:41.429144 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-5481db7e-717f-4a76-83a1-85e64eeca0cf None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:10:41.430303 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-5481db7e-717f-4a76-83a1-85e64eeca0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:10:41.437936 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 751/1493] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Feb 10 23:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:10:41.476760 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28746d0f-6870-45ec-a25d-a616da95fbc9 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:10:41.487746 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28746d0f-6870-45ec-a25d-a616da95fbc9 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:10:41.491791 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376eb5f-93e4-43fc-ad1c-1599d63d2915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:10:41.492449 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376eb5f-93e4-43fc-ad1c-1599d63d2915 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:10:41.492736 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376eb5f-93e4-43fc-ad1c-1599d63d2915 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:10:41.493012 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376eb5f-93e4-43fc-ad1c-1599d63d2915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:10:41.501886 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376eb5f-93e4-43fc-ad1c-1599d63d2915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:10:41.503300 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376eb5f-93e4-43fc-ad1c-1599d63d2915 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:10:41.512523 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 743/1494] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:10:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:11:55.049005 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f232d9-0879-441c-aa10-af812c7f8046 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:11:55.049614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f232d9-0879-441c-aa10-af812c7f8046 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:11:55.049614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f232d9-0879-441c-aa10-af812c7f8046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:11:55.067746 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-f8f232d9-0879-441c-aa10-af812c7f8046 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:11:55.068963 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-f8f232d9-0879-441c-aa10-af812c7f8046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:11:55.077699 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 752/1495] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:11:55.085584 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ad916-a638-4f98-8527-456c6e26fce7 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:11:55.086077 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ad916-a638-4f98-8527-456c6e26fce7 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:11:55.086180 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ad916-a638-4f98-8527-456c6e26fce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:11:55.105226 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-859ad916-a638-4f98-8527-456c6e26fce7 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:11:55.106415 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-859ad916-a638-4f98-8527-456c6e26fce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:11:55.114181 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 744/1496] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:11:55.119791 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f232d9-0879-441c-aa10-af812c7f8046 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:11:55.129351 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f232d9-0879-441c-aa10-af812c7f8046 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:11:55.134557 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89e5ab-92b5-4a23-aa9a-fe067f494cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:11:55.135337 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89e5ab-92b5-4a23-aa9a-fe067f494cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:11:55.135619 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89e5ab-92b5-4a23-aa9a-fe067f494cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:11:55.135924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89e5ab-92b5-4a23-aa9a-fe067f494cb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:11:55.136658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89e5ab-92b5-4a23-aa9a-fe067f494cb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:11:55.136967 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89e5ab-92b5-4a23-aa9a-fe067f494cb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:11:55.138538 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89e5ab-92b5-4a23-aa9a-fe067f494cb4 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:11:55.150152 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 753/1497] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:11:55.157966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ad916-a638-4f98-8527-456c6e26fce7 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:11:55.167492 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ad916-a638-4f98-8527-456c6e26fce7 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:11:55.172017 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51ccdc-1ce8-414c-b304-adea1fa91afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:11:55.172657 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51ccdc-1ce8-414c-b304-adea1fa91afb admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:11:55.172953 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51ccdc-1ce8-414c-b304-adea1fa91afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:11:55.173214 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51ccdc-1ce8-414c-b304-adea1fa91afb admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:11:55.173906 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51ccdc-1ce8-414c-b304-adea1fa91afb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:11:55.175788 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51ccdc-1ce8-414c-b304-adea1fa91afb admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:11:55.212157 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 745/1498] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:11:55 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:11:55.216364 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89e5ab-92b5-4a23-aa9a-fe067f494cb4 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:11:55.225893 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89e5ab-92b5-4a23-aa9a-fe067f494cb4 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:11:55.280464 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5ac5d-bf1f-4769-a3f1-96b51c2ee782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:11:55.281239 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5ac5d-bf1f-4769-a3f1-96b51c2ee782 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:11:55.281527 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5ac5d-bf1f-4769-a3f1-96b51c2ee782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:11:55.281868 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5ac5d-bf1f-4769-a3f1-96b51c2ee782 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:11:55.282695 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5ac5d-bf1f-4769-a3f1-96b51c2ee782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:11:55.284700 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5ac5d-bf1f-4769-a3f1-96b51c2ee782 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:11:55.307362 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 754/1499] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:11:55 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:11:55.311533 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51ccdc-1ce8-414c-b304-adea1fa91afb admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:11:55.321532 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51ccdc-1ce8-414c-b304-adea1fa91afb admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:11:55.326102 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96edd3-38ce-40b3-9145-085e627b573f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:11:55.326747 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96edd3-38ce-40b3-9145-085e627b573f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:11:55.327027 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96edd3-38ce-40b3-9145-085e627b573f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:11:55.327298 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96edd3-38ce-40b3-9145-085e627b573f admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:11:55.328063 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96edd3-38ce-40b3-9145-085e627b573f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:11:55.329641 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96edd3-38ce-40b3-9145-085e627b573f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:11:55.342207 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 746/1500] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:11:55.346121 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5ac5d-bf1f-4769-a3f1-96b51c2ee782 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:11:55.356351 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5ac5d-bf1f-4769-a3f1-96b51c2ee782 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:11:55.360961 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311f473-a5ea-45cd-8af5-c7dd063beaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:11:55.361604 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311f473-a5ea-45cd-8af5-c7dd063beaab admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:11:55.361884 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311f473-a5ea-45cd-8af5-c7dd063beaab admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:11:55.362156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311f473-a5ea-45cd-8af5-c7dd063beaab admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:11:55.362882 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311f473-a5ea-45cd-8af5-c7dd063beaab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:11:55.364487 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311f473-a5ea-45cd-8af5-c7dd063beaab admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:11:55.378194 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 755/1501] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:11:55.382175 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96edd3-38ce-40b3-9145-085e627b573f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:11:55.391742 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96edd3-38ce-40b3-9145-085e627b573f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:11:55.396189 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafa9b1-a570-49bd-b937-eab4f99e4246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:11:55.397045 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafa9b1-a570-49bd-b937-eab4f99e4246 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:11:55.397325 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafa9b1-a570-49bd-b937-eab4f99e4246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:11:55.397597 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafa9b1-a570-49bd-b937-eab4f99e4246 admin admin] PATH_INFO: `/v3/projects/fdd77eaacbaf4f3fa66e1041f49965d6/users/5f3f0db053a44cf9a17e600965287689/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:11:55.411682 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafa9b1-a570-49bd-b937-eab4f99e4246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdd77eaacbaf4f3fa66e1041f49965d6, user_id=5f3f0db053a44cf9a17e600965287689, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:11:55.414330 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafa9b1-a570-49bd-b937-eab4f99e4246 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:11:55.427837 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 747/1502] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:11:55 2022] PUT /identity/v3/projects/fdd77eaacbaf4f3fa66e1041f49965d6/users/5f3f0db053a44cf9a17e600965287689/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:11:55.440826 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3674bd-6f2f-4dc2-a2ed-2ca911696dbc None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:11:55.441119 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3674bd-6f2f-4dc2-a2ed-2ca911696dbc None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:11:55.441396 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3674bd-6f2f-4dc2-a2ed-2ca911696dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:11:55.467674 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-fa3674bd-6f2f-4dc2-a2ed-2ca911696dbc None None] MFA Rules not processed for user `5f3f0db053a44cf9a17e600965287689`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:11:55.468908 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-fa3674bd-6f2f-4dc2-a2ed-2ca911696dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:11:55.532065 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 756/1503] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:11:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:11:55.544026 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafa9b1-a570-49bd-b937-eab4f99e4246 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:11:55.612231 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafa9b1-a570-49bd-b937-eab4f99e4246 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:11:55.617899 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b85a25-0151-4169-8b43-227180273ffa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:11:55.618577 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b85a25-0151-4169-8b43-227180273ffa service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:11:55.618863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b85a25-0151-4169-8b43-227180273ffa service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:11:55.619140 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b85a25-0151-4169-8b43-227180273ffa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:11:55.626635 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b85a25-0151-4169-8b43-227180273ffa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:11:55.628250 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b85a25-0151-4169-8b43-227180273ffa service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:11:55.636809 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 748/1504] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:11:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:11:55.704569 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee803a2-7a8c-496e-bbcc-fba17bb26ee3 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:11:55.704858 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee803a2-7a8c-496e-bbcc-fba17bb26ee3 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:11:55.705133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee803a2-7a8c-496e-bbcc-fba17bb26ee3 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:11:55.706805 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 757/1505] 10.222.0.77 () {52 vars in 829 bytes} [Thu Feb 10 23:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:11:55.710281 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b85a25-0151-4169-8b43-227180273ffa service nova] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:11:55.771509 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b85a25-0151-4169-8b43-227180273ffa service nova] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:11:55.776772 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4a65d-d1e9-4340-b244-dc4b294e636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:11:55.777657 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4a65d-d1e9-4340-b244-dc4b294e636c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:11:55.777939 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4a65d-d1e9-4340-b244-dc4b294e636c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:11:55.778213 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4a65d-d1e9-4340-b244-dc4b294e636c admin admin] PATH_INFO: `/v3/users/5f3f0db053a44cf9a17e600965287689` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:11:55.779394 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4a65d-d1e9-4340-b244-dc4b294e636c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f3f0db053a44cf9a17e600965287689)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:11:55.780444 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING py.warnings [None req-26f4a65d-d1e9-4340-b244-dc4b294e636c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:11:55.780444 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: warnings.warn(msg) Feb 10 23:11:55.780444 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: Feb 10 23:11:55.781634 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4a65d-d1e9-4340-b244-dc4b294e636c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:11:55.843745 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-26f4a65d-d1e9-4340-b244-dc4b294e636c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f3f0db053a44cf9a17e600965287689'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:11:55.861767 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-26f4a65d-d1e9-4340-b244-dc4b294e636c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f3f0db053a44cf9a17e600965287689'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:11:55.862468 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-26f4a65d-d1e9-4340-b244-dc4b294e636c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f3f0db053a44cf9a17e600965287689'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:11:55.863130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-26f4a65d-d1e9-4340-b244-dc4b294e636c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f3f0db053a44cf9a17e600965287689'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:11:55.872245 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-26f4a65d-d1e9-4340-b244-dc4b294e636c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f3f0db053a44cf9a17e600965287689'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:11:55.889704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 749/1506] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:11:55 2022] DELETE /identity/v3/users/5f3f0db053a44cf9a17e600965287689 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:11:55.894092 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41e914-572c-450d-925c-3a501d1b90e1 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:11:55.894381 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41e914-572c-450d-925c-3a501d1b90e1 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:11:55.894655 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41e914-572c-450d-925c-3a501d1b90e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:11:55.912298 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-aa41e914-572c-450d-925c-3a501d1b90e1 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:11:55.913469 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-aa41e914-572c-450d-925c-3a501d1b90e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:11:55.969825 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 758/1507] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:11:55.979924 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4a65d-d1e9-4340-b244-dc4b294e636c admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:11:55.981286 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-26f4a65d-d1e9-4340-b244-dc4b294e636c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:11:56.035312 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4a65d-d1e9-4340-b244-dc4b294e636c admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:11:56.038836 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14227f2-8946-420d-b1b8-13ec712d16b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:11:56.039463 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14227f2-8946-420d-b1b8-13ec712d16b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:11:56.039742 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14227f2-8946-420d-b1b8-13ec712d16b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:11:56.040146 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14227f2-8946-420d-b1b8-13ec712d16b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:11:56.048686 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14227f2-8946-420d-b1b8-13ec712d16b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:11:56.050090 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14227f2-8946-420d-b1b8-13ec712d16b3 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:11:56.059231 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 750/1508] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:11:56.396733 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41e914-572c-450d-925c-3a501d1b90e1 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:11:56.398273 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-aa41e914-572c-450d-925c-3a501d1b90e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:11:56.411592 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41e914-572c-450d-925c-3a501d1b90e1 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:11:56.417375 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d21c4-622a-4970-b987-bd55f49fb06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:11:56.418230 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d21c4-622a-4970-b987-bd55f49fb06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:11:56.418523 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d21c4-622a-4970-b987-bd55f49fb06b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:11:56.418781 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d21c4-622a-4970-b987-bd55f49fb06b admin admin] PATH_INFO: `/v3/projects/fdd77eaacbaf4f3fa66e1041f49965d6` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:11:56.420003 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d21c4-622a-4970-b987-bd55f49fb06b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdd77eaacbaf4f3fa66e1041f49965d6)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:11:56.421016 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING py.warnings [None req-996d21c4-622a-4970-b987-bd55f49fb06b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:11:56.421016 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: warnings.warn(msg) Feb 10 23:11:56.421016 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: Feb 10 23:11:56.422263 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d21c4-622a-4970-b987-bd55f49fb06b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:11:56.481204 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-996d21c4-622a-4970-b987-bd55f49fb06b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdd77eaacbaf4f3fa66e1041f49965d6', 'request_id': 'req-996d21c4-622a-4970-b987-bd55f49fb06b'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:11:56.486919 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-996d21c4-622a-4970-b987-bd55f49fb06b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdd77eaacbaf4f3fa66e1041f49965d6', 'request_id': 'req-996d21c4-622a-4970-b987-bd55f49fb06b'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:11:56.500216 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-996d21c4-622a-4970-b987-bd55f49fb06b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdd77eaacbaf4f3fa66e1041f49965d6', 'request_id': 'req-996d21c4-622a-4970-b987-bd55f49fb06b'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:11:56.515078 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-996d21c4-622a-4970-b987-bd55f49fb06b admin admin] The token cache is being invalidate because project fdd77eaacbaf4f3fa66e1041f49965d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:11:56.515364 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-996d21c4-622a-4970-b987-bd55f49fb06b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:11:56.516087 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-996d21c4-622a-4970-b987-bd55f49fb06b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:11:56.517621 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 759/1509] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:11:56 2022] DELETE /identity/v3/projects/fdd77eaacbaf4f3fa66e1041f49965d6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:13:30.420229 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbfa83-8b67-4242-873b-90777c9d8af3 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:30.420824 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbfa83-8b67-4242-873b-90777c9d8af3 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:30.420824 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbfa83-8b67-4242-873b-90777c9d8af3 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:30.422561 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 751/1510] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 23:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:13:30.428308 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84504c-8467-446c-b066-84b159200210 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:30.428749 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84504c-8467-446c-b066-84b159200210 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:30.428900 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84504c-8467-446c-b066-84b159200210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:30.447542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-7e84504c-8467-446c-b066-84b159200210 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:13:30.448785 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-7e84504c-8467-446c-b066-84b159200210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:13:30.505643 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 760/1511] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 23:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:13:30.657996 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbfa83-8b67-4242-873b-90777c9d8af3 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:13:30.659790 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-34dbfa83-8b67-4242-873b-90777c9d8af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:13:30.732731 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbfa83-8b67-4242-873b-90777c9d8af3 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:13:30.737992 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9504ae1-73f6-4993-8637-f7c62a3d9ee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:13:30.738630 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9504ae1-73f6-4993-8637-f7c62a3d9ee6 service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:30.738919 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9504ae1-73f6-4993-8637-f7c62a3d9ee6 service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:30.739193 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9504ae1-73f6-4993-8637-f7c62a3d9ee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:30.747538 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9504ae1-73f6-4993-8637-f7c62a3d9ee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:13:30.749139 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9504ae1-73f6-4993-8637-f7c62a3d9ee6 service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:13:30.758165 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 752/1512] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:13:30.999032 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4668c56-ec3e-4169-995e-3449b50fa199 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:30.999239 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4668c56-ec3e-4169-995e-3449b50fa199 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:30.999504 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4668c56-ec3e-4169-995e-3449b50fa199 None None] PATH_INFO: `/v3` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:31.000874 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 761/1513] 10.222.0.43 () {54 vars in 925 bytes} [Thu Feb 10 23:13:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:13:31.007184 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea580c5-4017-43f2-b10c-5e25fec06d50 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:31.007475 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea580c5-4017-43f2-b10c-5e25fec06d50 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:31.007802 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea580c5-4017-43f2-b10c-5e25fec06d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:31.028783 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-3ea580c5-4017-43f2-b10c-5e25fec06d50 None None] MFA Rules not processed for user `0f5243eef2a24a518b30526425c0b2c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:13:31.029974 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-3ea580c5-4017-43f2-b10c-5e25fec06d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:13:31.091121 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 753/1514] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Feb 10 23:13:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:13:32.036296 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5952bf-e2c0-4b7e-9c54-d0785165fadb None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:32.036873 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5952bf-e2c0-4b7e-9c54-d0785165fadb None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:32.036873 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5952bf-e2c0-4b7e-9c54-d0785165fadb None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:32.038606 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 762/1515] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 23:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:13:32.044344 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446f195-240f-4785-86aa-a42a3ae3b836 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:32.044756 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446f195-240f-4785-86aa-a42a3ae3b836 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:32.044909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446f195-240f-4785-86aa-a42a3ae3b836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:32.063389 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-7446f195-240f-4785-86aa-a42a3ae3b836 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:13:32.064612 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-7446f195-240f-4785-86aa-a42a3ae3b836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:13:32.072645 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 754/1516] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 23:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:13:32.225367 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5952bf-e2c0-4b7e-9c54-d0785165fadb None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:13:32.239134 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5952bf-e2c0-4b7e-9c54-d0785165fadb None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:13:32.245330 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d2f24-86da-478e-a683-e3ed9abf52b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:13:32.245949 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d2f24-86da-478e-a683-e3ed9abf52b5 service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:32.246227 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d2f24-86da-478e-a683-e3ed9abf52b5 service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:32.246494 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d2f24-86da-478e-a683-e3ed9abf52b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:32.254228 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d2f24-86da-478e-a683-e3ed9abf52b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:13:32.255777 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d2f24-86da-478e-a683-e3ed9abf52b5 service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:13:32.265462 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 763/1517] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:13:40.025567 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd7889-8d64-4083-a860-9085b48b8bec None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:40.026104 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd7889-8d64-4083-a860-9085b48b8bec None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:40.026104 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd7889-8d64-4083-a860-9085b48b8bec None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:40.027795 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 755/1518] 10.222.0.77 () {54 vars in 960 bytes} [Thu Feb 10 23:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:13:40.032962 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f15a1-a9e4-4d44-9fd9-acf2fc8d74b1 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:40.033430 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f15a1-a9e4-4d44-9fd9-acf2fc8d74b1 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:40.033539 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f15a1-a9e4-4d44-9fd9-acf2fc8d74b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:40.051958 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-963f15a1-a9e4-4d44-9fd9-acf2fc8d74b1 None None] MFA Rules not processed for user `0f5243eef2a24a518b30526425c0b2c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:13:40.053142 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-963f15a1-a9e4-4d44-9fd9-acf2fc8d74b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:13:40.061826 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 764/1519] 10.222.0.77 () {58 vars in 1057 bytes} [Thu Feb 10 23:13:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:13:40.068990 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd7889-8d64-4083-a860-9085b48b8bec None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:13:40.082204 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd7889-8d64-4083-a860-9085b48b8bec None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:13:40.087714 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bc4f9-ff00-4e95-a166-0db236f290a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f5243eef2a24a518b30526425c0b2c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:13:40.088649 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bc4f9-ff00-4e95-a166-0db236f290a0 service placement] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:40.088933 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bc4f9-ff00-4e95-a166-0db236f290a0 service placement] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:40.089204 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bc4f9-ff00-4e95-a166-0db236f290a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:40.098397 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bc4f9-ff00-4e95-a166-0db236f290a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:13:40.100016 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bc4f9-ff00-4e95-a166-0db236f290a0 service placement] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:13:40.110210 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 756/1520] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:13:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:13:43.975193 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6400b-63e3-4dd3-98b3-502d6da3c6b4 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:43.975767 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6400b-63e3-4dd3-98b3-502d6da3c6b4 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:43.975767 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6400b-63e3-4dd3-98b3-502d6da3c6b4 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:43.978093 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 765/1521] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 23:13:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:13:43.982994 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc96f3c-be14-413b-9482-a5d7b1af1acd None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:43.983430 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc96f3c-be14-413b-9482-a5d7b1af1acd None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:43.983548 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc96f3c-be14-413b-9482-a5d7b1af1acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:44.002104 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-4dc96f3c-be14-413b-9482-a5d7b1af1acd None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:13:44.003277 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-4dc96f3c-be14-413b-9482-a5d7b1af1acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:13:44.011097 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 757/1522] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 23:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:13:44.163222 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6400b-63e3-4dd3-98b3-502d6da3c6b4 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:13:44.177693 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6400b-63e3-4dd3-98b3-502d6da3c6b4 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:13:44.183400 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9b6ad-88c9-4068-b977-fb291699be86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:13:44.184053 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9b6ad-88c9-4068-b977-fb291699be86 service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:44.184336 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9b6ad-88c9-4068-b977-fb291699be86 service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:44.184616 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9b6ad-88c9-4068-b977-fb291699be86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:44.192445 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9b6ad-88c9-4068-b977-fb291699be86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:13:44.194017 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9b6ad-88c9-4068-b977-fb291699be86 service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:13:44.203856 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 766/1523] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:13:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:13:45.502796 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be35c87-134e-43cd-8282-a68be4f004a2 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:45.503398 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be35c87-134e-43cd-8282-a68be4f004a2 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:45.503398 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be35c87-134e-43cd-8282-a68be4f004a2 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:45.505211 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 758/1524] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 23:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:13:45.510588 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5860dd-5082-446e-902b-5e8930b1c4a8 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:45.511022 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5860dd-5082-446e-902b-5e8930b1c4a8 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:45.511172 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5860dd-5082-446e-902b-5e8930b1c4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:45.529749 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-1f5860dd-5082-446e-902b-5e8930b1c4a8 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:13:45.530930 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-1f5860dd-5082-446e-902b-5e8930b1c4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:13:45.538627 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 767/1525] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 23:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:13:45.689180 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be35c87-134e-43cd-8282-a68be4f004a2 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:13:45.703513 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be35c87-134e-43cd-8282-a68be4f004a2 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:13:45.708781 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c1064-f91f-4521-b1dc-3ba315f96725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:13:45.709405 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c1064-f91f-4521-b1dc-3ba315f96725 service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:45.709690 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c1064-f91f-4521-b1dc-3ba315f96725 service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:45.709966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c1064-f91f-4521-b1dc-3ba315f96725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:45.718671 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c1064-f91f-4521-b1dc-3ba315f96725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:13:45.720288 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c1064-f91f-4521-b1dc-3ba315f96725 service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:13:45.730225 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 759/1526] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:13:49.924890 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7878c24-896c-4f68-ae95-11a22311834d None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:49.925502 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7878c24-896c-4f68-ae95-11a22311834d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:49.925502 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7878c24-896c-4f68-ae95-11a22311834d None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:49.927223 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 768/1527] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 23:13:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:13:49.933525 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccaaee-674e-47ae-a01d-8c88dcee0f7b None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:49.934008 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccaaee-674e-47ae-a01d-8c88dcee0f7b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:49.934110 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccaaee-674e-47ae-a01d-8c88dcee0f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:49.955351 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-7cccaaee-674e-47ae-a01d-8c88dcee0f7b None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:13:49.956567 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-7cccaaee-674e-47ae-a01d-8c88dcee0f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:13:49.966747 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 760/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 23:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:13:50.010658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7878c24-896c-4f68-ae95-11a22311834d None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:13:50.012375 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-f7878c24-896c-4f68-ae95-11a22311834d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:13:50.082731 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7878c24-896c-4f68-ae95-11a22311834d None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:13:50.086660 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c3cb0-a421-4a27-a1a7-655a6924207b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:13:50.087398 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c3cb0-a421-4a27-a1a7-655a6924207b service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:50.087673 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c3cb0-a421-4a27-a1a7-655a6924207b service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:50.087979 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c3cb0-a421-4a27-a1a7-655a6924207b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:50.101896 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c3cb0-a421-4a27-a1a7-655a6924207b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:13:50.104607 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c3cb0-a421-4a27-a1a7-655a6924207b service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:13:50.117901 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 769/1529] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:13:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:13:52.342625 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58348b-1bce-4d32-9ea4-7b9972df9d8a None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:52.343137 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58348b-1bce-4d32-9ea4-7b9972df9d8a None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:52.343234 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58348b-1bce-4d32-9ea4-7b9972df9d8a None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:52.345026 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 761/1530] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 23:13:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:13:52.350204 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03960f2a-3e6c-45ea-8188-530b4d7f6d3d None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:52.350601 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03960f2a-3e6c-45ea-8188-530b4d7f6d3d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:52.350749 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03960f2a-3e6c-45ea-8188-530b4d7f6d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:52.369392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-03960f2a-3e6c-45ea-8188-530b4d7f6d3d None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:13:52.370582 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-03960f2a-3e6c-45ea-8188-530b4d7f6d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:13:52.378273 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 770/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 23:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:13:52.413752 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58348b-1bce-4d32-9ea4-7b9972df9d8a None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:13:52.424586 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58348b-1bce-4d32-9ea4-7b9972df9d8a None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:13:52.428107 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0d75d-1a30-45d5-ae4b-91c66fb8d106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:13:52.428729 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0d75d-1a30-45d5-ae4b-91c66fb8d106 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:52.429012 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0d75d-1a30-45d5-ae4b-91c66fb8d106 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:52.429288 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0d75d-1a30-45d5-ae4b-91c66fb8d106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:52.438200 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0d75d-1a30-45d5-ae4b-91c66fb8d106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:13:52.439615 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0d75d-1a30-45d5-ae4b-91c66fb8d106 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:13:52.449602 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 762/1532] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:13:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:13:56.160410 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895c0e-d82b-47a4-b3bd-df7428312da1 None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:56.160966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895c0e-d82b-47a4-b3bd-df7428312da1 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:56.160966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895c0e-d82b-47a4-b3bd-df7428312da1 None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:56.162765 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 771/1533] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 23:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:13:56.168764 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f79d34-5fbd-468b-ad19-422a84d7fe3d None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:56.169175 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f79d34-5fbd-468b-ad19-422a84d7fe3d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:56.169313 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f79d34-5fbd-468b-ad19-422a84d7fe3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:56.187468 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-94f79d34-5fbd-468b-ad19-422a84d7fe3d None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:13:56.188665 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-94f79d34-5fbd-468b-ad19-422a84d7fe3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:13:56.196453 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 763/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 23:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:13:56.449946 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42895c0e-d82b-47a4-b3bd-df7428312da1 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:13:56.451618 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-42895c0e-d82b-47a4-b3bd-df7428312da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:13:56.506340 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42895c0e-d82b-47a4-b3bd-df7428312da1 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:13:56.510779 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925a585-b456-4e6b-b3fd-ae21a5b0f6ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:13:56.511417 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925a585-b456-4e6b-b3fd-ae21a5b0f6ad service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:56.511700 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925a585-b456-4e6b-b3fd-ae21a5b0f6ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:56.512013 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925a585-b456-4e6b-b3fd-ae21a5b0f6ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:56.520667 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925a585-b456-4e6b-b3fd-ae21a5b0f6ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:13:56.522076 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925a585-b456-4e6b-b3fd-ae21a5b0f6ad service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:13:56.531451 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 772/1535] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:13:58.817676 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be2d0c-6c66-4941-a38b-98287cc3a7df None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:58.818248 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be2d0c-6c66-4941-a38b-98287cc3a7df None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:58.818248 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be2d0c-6c66-4941-a38b-98287cc3a7df None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:58.820391 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 764/1536] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 23:13:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:13:58.826464 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6130340-86ac-4946-a157-cdb991ea796c None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:58.826911 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6130340-86ac-4946-a157-cdb991ea796c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:58.827017 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6130340-86ac-4946-a157-cdb991ea796c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:58.845616 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-b6130340-86ac-4946-a157-cdb991ea796c None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:13:58.846806 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-b6130340-86ac-4946-a157-cdb991ea796c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:13:58.855278 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 773/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 23:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:13:59.109747 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5dd02-1699-44f1-88e4-d54d47ea34ab None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:59.110032 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5dd02-1699-44f1-88e4-d54d47ea34ab None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:59.110308 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5dd02-1699-44f1-88e4-d54d47ea34ab None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:59.112100 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 765/1538] 10.222.0.77 () {54 vars in 963 bytes} [Thu Feb 10 23:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:13:59.117035 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bd83f-8cce-4b11-8559-d5c45866a129 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:59.117325 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bd83f-8cce-4b11-8559-d5c45866a129 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:59.118404 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bd83f-8cce-4b11-8559-d5c45866a129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:59.136414 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-0d1bd83f-8cce-4b11-8559-d5c45866a129 None None] MFA Rules not processed for user `d4899bdd65bb4cccae615cc5e8192388`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:13:59.137606 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-0d1bd83f-8cce-4b11-8559-d5c45866a129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:13:59.143987 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 774/1539] 10.222.0.77 () {58 vars in 1060 bytes} [Thu Feb 10 23:13:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:13:59.152369 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5dd02-1699-44f1-88e4-d54d47ea34ab None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:13:59.162721 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5dd02-1699-44f1-88e4-d54d47ea34ab None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:13:59.166879 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5aa839-705c-4966-a23d-6819633e5711 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:13:59.167490 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aa839-705c-4966-a23d-6819633e5711 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:13:59.167768 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aa839-705c-4966-a23d-6819633e5711 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:13:59.168077 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aa839-705c-4966-a23d-6819633e5711 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:13:59.176661 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5aa839-705c-4966-a23d-6819633e5711 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:13:59.178059 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5aa839-705c-4966-a23d-6819633e5711 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:13:59.187618 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 766/1540] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:13:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:15:23.251650 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a119be-cdf8-4bab-ac84-05537b8454e5 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:23.254830 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a119be-cdf8-4bab-ac84-05537b8454e5 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:23.254830 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a119be-cdf8-4bab-ac84-05537b8454e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:23.278160 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-03a119be-cdf8-4bab-ac84-05537b8454e5 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:23.279360 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-03a119be-cdf8-4bab-ac84-05537b8454e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:23.290256 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 775/1541] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:23.299314 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164c0f0-3383-4230-838c-a148e6a73af1 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:23.299889 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164c0f0-3383-4230-838c-a148e6a73af1 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:23.299889 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164c0f0-3383-4230-838c-a148e6a73af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:23.327735 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-a164c0f0-3383-4230-838c-a148e6a73af1 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:23.329191 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a164c0f0-3383-4230-838c-a148e6a73af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:23.343623 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 767/1542] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:23.348420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a119be-cdf8-4bab-ac84-05537b8454e5 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:23.360645 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a119be-cdf8-4bab-ac84-05537b8454e5 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:23.369276 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550f50d-9867-42cd-9bdb-cc9b13fec2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:23.369944 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550f50d-9867-42cd-9bdb-cc9b13fec2da admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:23.370224 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550f50d-9867-42cd-9bdb-cc9b13fec2da admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:23.370495 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550f50d-9867-42cd-9bdb-cc9b13fec2da admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:23.371238 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550f50d-9867-42cd-9bdb-cc9b13fec2da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:15:23.371638 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550f50d-9867-42cd-9bdb-cc9b13fec2da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:23.373282 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550f50d-9867-42cd-9bdb-cc9b13fec2da admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:23.386492 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 776/1543] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:15:23.394742 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164c0f0-3383-4230-838c-a148e6a73af1 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:23.407366 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164c0f0-3383-4230-838c-a148e6a73af1 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:23.417530 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f62710-8aa7-4ca7-8c63-1ea3792d4bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:23.418202 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f62710-8aa7-4ca7-8c63-1ea3792d4bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:23.418487 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f62710-8aa7-4ca7-8c63-1ea3792d4bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:23.418764 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f62710-8aa7-4ca7-8c63-1ea3792d4bd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:23.419471 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f62710-8aa7-4ca7-8c63-1ea3792d4bd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:23.421411 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f62710-8aa7-4ca7-8c63-1ea3792d4bd3 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:23.470931 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 768/1544] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:23 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:23.475439 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550f50d-9867-42cd-9bdb-cc9b13fec2da admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:23.489303 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550f50d-9867-42cd-9bdb-cc9b13fec2da admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:23.560054 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727e3dc-167e-43b0-a96a-329a4e4b4604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:23.560721 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727e3dc-167e-43b0-a96a-329a4e4b4604 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:23.561004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727e3dc-167e-43b0-a96a-329a4e4b4604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:23.561280 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727e3dc-167e-43b0-a96a-329a4e4b4604 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:23.561992 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727e3dc-167e-43b0-a96a-329a4e4b4604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:23.564000 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727e3dc-167e-43b0-a96a-329a4e4b4604 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:23.597803 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 777/1545] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:23 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:23.603077 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f62710-8aa7-4ca7-8c63-1ea3792d4bd3 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:23.616309 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f62710-8aa7-4ca7-8c63-1ea3792d4bd3 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:23.623265 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d1d57-edbb-4769-872c-201a12af629b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:23.623972 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d1d57-edbb-4769-872c-201a12af629b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:23.624263 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d1d57-edbb-4769-872c-201a12af629b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:23.624591 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d1d57-edbb-4769-872c-201a12af629b admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:23.625388 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d1d57-edbb-4769-872c-201a12af629b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:23.629119 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d1d57-edbb-4769-872c-201a12af629b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:23.640298 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc362682-c2c7-4235-84b0-20fcc9c717b9 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:23.640627 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc362682-c2c7-4235-84b0-20fcc9c717b9 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:23.640915 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc362682-c2c7-4235-84b0-20fcc9c717b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:23.645321 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 769/1546] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:23.654170 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d1d57-edbb-4769-872c-201a12af629b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:23.668260 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d1d57-edbb-4769-872c-201a12af629b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:23.670568 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-bc362682-c2c7-4235-84b0-20fcc9c717b9 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:23.675968 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-bc362682-c2c7-4235-84b0-20fcc9c717b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:23.681253 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa82412-01e2-43e0-b8ab-88d35ffc2f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:23.681941 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa82412-01e2-43e0-b8ab-88d35ffc2f65 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:23.682825 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa82412-01e2-43e0-b8ab-88d35ffc2f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:23.683109 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa82412-01e2-43e0-b8ab-88d35ffc2f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:23.683879 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa82412-01e2-43e0-b8ab-88d35ffc2f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:23.685497 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa82412-01e2-43e0-b8ab-88d35ffc2f65 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:23.688009 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 778/1547] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:23.696797 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189aee6-0b45-4156-818f-22381ab8e09a None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:23.697099 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189aee6-0b45-4156-818f-22381ab8e09a None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:23.697352 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189aee6-0b45-4156-818f-22381ab8e09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:23.699886 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 770/1548] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:23.704280 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa82412-01e2-43e0-b8ab-88d35ffc2f65 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:23.722791 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa82412-01e2-43e0-b8ab-88d35ffc2f65 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:23.728768 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-c189aee6-0b45-4156-818f-22381ab8e09a None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:23.730256 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-c189aee6-0b45-4156-818f-22381ab8e09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:23.735867 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69f8cd-718f-43a3-a3e8-613e85e32199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:23.736832 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69f8cd-718f-43a3-a3e8-613e85e32199 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:23.737125 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69f8cd-718f-43a3-a3e8-613e85e32199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:23.737408 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69f8cd-718f-43a3-a3e8-613e85e32199 admin admin] PATH_INFO: `/v3/projects/98ae7c6136b94b51bd44fa33e0d225fc/users/3fc84b127fde4ce4a262e4786acfd7ce/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:23.743349 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 779/1549] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:23.747445 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189aee6-0b45-4156-818f-22381ab8e09a None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:23.762129 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189aee6-0b45-4156-818f-22381ab8e09a None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:23.771343 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec85f6-4824-495e-91c5-dbab363b5eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:23.772032 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec85f6-4824-495e-91c5-dbab363b5eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:23.772320 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec85f6-4824-495e-91c5-dbab363b5eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:23.772687 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec85f6-4824-495e-91c5-dbab363b5eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:23.773309 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69f8cd-718f-43a3-a3e8-613e85e32199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ae7c6136b94b51bd44fa33e0d225fc, user_id=3fc84b127fde4ce4a262e4786acfd7ce, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:23.773432 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec85f6-4824-495e-91c5-dbab363b5eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:15:23.773716 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec85f6-4824-495e-91c5-dbab363b5eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:23.775346 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec85f6-4824-495e-91c5-dbab363b5eb4 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:23.776447 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69f8cd-718f-43a3-a3e8-613e85e32199 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:23.801280 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 780/1550] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:15:23.802629 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd44785-e9ed-4ba7-98ff-f5fdaf949602 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:23.804114 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd44785-e9ed-4ba7-98ff-f5fdaf949602 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:23.804399 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd44785-e9ed-4ba7-98ff-f5fdaf949602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:23.808522 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 771/1551] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:23 2022] PUT /identity/v3/projects/98ae7c6136b94b51bd44fa33e0d225fc/users/3fc84b127fde4ce4a262e4786acfd7ce/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:23.814081 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef0241-b3bc-48a8-a1c2-b1bcd7774f71 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:23.814375 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef0241-b3bc-48a8-a1c2-b1bcd7774f71 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:23.814656 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef0241-b3bc-48a8-a1c2-b1bcd7774f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:23.849819 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-c1ef0241-b3bc-48a8-a1c2-b1bcd7774f71 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:23.850946 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-c1ef0241-b3bc-48a8-a1c2-b1bcd7774f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:23.854077 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-8fd44785-e9ed-4ba7-98ff-f5fdaf949602 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:23.855260 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-8fd44785-e9ed-4ba7-98ff-f5fdaf949602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:23.939219 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 772/1552] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:23.940093 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef0241-b3bc-48a8-a1c2-b1bcd7774f71 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:23.944684 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 781/1553] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:23.946935 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afd614-78ce-4e4c-9ce8-53a60fde39c3 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:23.947469 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afd614-78ce-4e4c-9ce8-53a60fde39c3 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:23.948010 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afd614-78ce-4e4c-9ce8-53a60fde39c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:23.952410 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef0241-b3bc-48a8-a1c2-b1bcd7774f71 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:23.957257 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0ac52-3d84-4803-87f7-0b2039bd8075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:23.957909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0ac52-3d84-4803-87f7-0b2039bd8075 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:23.958191 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0ac52-3d84-4803-87f7-0b2039bd8075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:23.958466 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0ac52-3d84-4803-87f7-0b2039bd8075 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:23.959163 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0ac52-3d84-4803-87f7-0b2039bd8075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:23.961089 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0ac52-3d84-4803-87f7-0b2039bd8075 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:23.968722 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-53afd614-78ce-4e4c-9ce8-53a60fde39c3 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:23.970409 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-53afd614-78ce-4e4c-9ce8-53a60fde39c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:23.980048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 782/1554] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:23.982837 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcab86f-2388-4257-ba32-3c034befb8cb None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:23.984028 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcab86f-2388-4257-ba32-3c034befb8cb None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:23.984167 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcab86f-2388-4257-ba32-3c034befb8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:23.991240 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 773/1555] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:23 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:23.992818 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f9396-001f-4792-940d-a08994ac3d53 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:23.993111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f9396-001f-4792-940d-a08994ac3d53 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:23.993423 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f9396-001f-4792-940d-a08994ac3d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.008419 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-8fcab86f-2388-4257-ba32-3c034befb8cb None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:24.009611 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-8fcab86f-2388-4257-ba32-3c034befb8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:24.016026 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-831f9396-001f-4792-940d-a08994ac3d53 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:24.017227 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-831f9396-001f-4792-940d-a08994ac3d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:24.073751 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 783/1556] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:24.078845 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dab711-4799-4194-b467-865384c4c3a3 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.079153 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dab711-4799-4194-b467-865384c4c3a3 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.079438 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dab711-4799-4194-b467-865384c4c3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.080167 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 774/1557] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:24.082417 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b63b7-913f-462b-a1cb-038dab4d0df4 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.082417 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b63b7-913f-462b-a1cb-038dab4d0df4 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.082417 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b63b7-913f-462b-a1cb-038dab4d0df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.101960 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-af9b63b7-913f-462b-a1cb-038dab4d0df4 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:24.102780 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-35dab711-4799-4194-b467-865384c4c3a3 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:24.103801 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-af9b63b7-913f-462b-a1cb-038dab4d0df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:24.103943 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-35dab711-4799-4194-b467-865384c4c3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:24.111480 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 784/1558] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:24.111609 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 775/1559] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:24.115323 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b63b7-913f-462b-a1cb-038dab4d0df4 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:24.115479 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ca35f-cf70-4b24-b78c-8ef9755331fc None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.115479 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ca35f-cf70-4b24-b78c-8ef9755331fc None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.115479 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ca35f-cf70-4b24-b78c-8ef9755331fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.124668 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b63b7-913f-462b-a1cb-038dab4d0df4 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:24.129312 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cd0be-6f60-4788-856e-51b3699de69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:24.129968 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cd0be-6f60-4788-856e-51b3699de69c admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.130253 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cd0be-6f60-4788-856e-51b3699de69c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.130532 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cd0be-6f60-4788-856e-51b3699de69c admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.131249 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cd0be-6f60-4788-856e-51b3699de69c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:24.133266 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-ba0ca35f-cf70-4b24-b78c-8ef9755331fc None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:24.133403 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cd0be-6f60-4788-856e-51b3699de69c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:24.134838 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-ba0ca35f-cf70-4b24-b78c-8ef9755331fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:24.142732 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 785/1560] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:24.143339 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ca35f-cf70-4b24-b78c-8ef9755331fc None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:24.156971 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 776/1561] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:24 2022] POST /identity/v3/users => generated 296 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:24.156971 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea7608-abbc-4def-b0be-ef04538181bb None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.156971 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea7608-abbc-4def-b0be-ef04538181bb None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.156971 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea7608-abbc-4def-b0be-ef04538181bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.173677 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-26ea7608-abbc-4def-b0be-ef04538181bb None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:24.174878 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-26ea7608-abbc-4def-b0be-ef04538181bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:24.182590 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 777/1562] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:24.183905 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6382d16-8f50-4561-b188-9ad21daa3672 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.184201 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6382d16-8f50-4561-b188-9ad21daa3672 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.184474 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6382d16-8f50-4561-b188-9ad21daa3672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.198493 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ca35f-cf70-4b24-b78c-8ef9755331fc None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:24.201792 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-a6382d16-8f50-4561-b188-9ad21daa3672 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:24.202161 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c59c02-46a6-46e2-bf38-cf944acf7be6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:24.202806 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59c02-46a6-46e2-bf38-cf944acf7be6 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.202955 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a6382d16-8f50-4561-b188-9ad21daa3672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:24.203072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59c02-46a6-46e2-bf38-cf944acf7be6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.203343 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59c02-46a6-46e2-bf38-cf944acf7be6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.210527 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 778/1563] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:24.213091 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c20a16-690a-46fb-8ee0-36a1562f3dda None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.213337 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c59c02-46a6-46e2-bf38-cf944acf7be6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:24.213462 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c20a16-690a-46fb-8ee0-36a1562f3dda None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.213635 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c20a16-690a-46fb-8ee0-36a1562f3dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.214712 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c59c02-46a6-46e2-bf38-cf944acf7be6 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:24.224498 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 786/1564] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:24.225518 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c59c02-46a6-46e2-bf38-cf944acf7be6 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:24.232065 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-62c20a16-690a-46fb-8ee0-36a1562f3dda None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:24.233259 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-62c20a16-690a-46fb-8ee0-36a1562f3dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:24.235793 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c59c02-46a6-46e2-bf38-cf944acf7be6 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:24.240481 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583ddee-0e30-44de-bc81-f5d734a9792e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:24.241069 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 779/1565] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:24.242643 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f2ad0-e636-46fc-9228-504883d2f88a None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.242947 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f2ad0-e636-46fc-9228-504883d2f88a None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.243276 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f2ad0-e636-46fc-9228-504883d2f88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.244146 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583ddee-0e30-44de-bc81-f5d734a9792e admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.245188 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583ddee-0e30-44de-bc81-f5d734a9792e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.245603 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583ddee-0e30-44de-bc81-f5d734a9792e admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.246378 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583ddee-0e30-44de-bc81-f5d734a9792e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:15:24.246726 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583ddee-0e30-44de-bc81-f5d734a9792e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:24.248635 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583ddee-0e30-44de-bc81-f5d734a9792e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:24.262731 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 787/1566] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:15:24.263582 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583ddee-0e30-44de-bc81-f5d734a9792e admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:24.264583 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-134f2ad0-e636-46fc-9228-504883d2f88a None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:24.265770 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-134f2ad0-e636-46fc-9228-504883d2f88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:24.278479 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583ddee-0e30-44de-bc81-f5d734a9792e admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:24.282194 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 780/1567] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:24.283265 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f2ad0-e636-46fc-9228-504883d2f88a None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:24.285077 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f0a8b-cb42-4488-a4ce-daf3b36bc1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:24.285768 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f0a8b-cb42-4488-a4ce-daf3b36bc1fc admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.286187 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f0a8b-cb42-4488-a4ce-daf3b36bc1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.286468 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f0a8b-cb42-4488-a4ce-daf3b36bc1fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.287606 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f0a8b-cb42-4488-a4ce-daf3b36bc1fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:15:24.287606 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f0a8b-cb42-4488-a4ce-daf3b36bc1fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:24.289311 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f0a8b-cb42-4488-a4ce-daf3b36bc1fc admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:24.293798 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f2ad0-e636-46fc-9228-504883d2f88a None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:24.299254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f8124-974e-46f8-acb4-ad9d15794410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:24.300340 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f8124-974e-46f8-acb4-ad9d15794410 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.301268 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f8124-974e-46f8-acb4-ad9d15794410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.301806 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f8124-974e-46f8-acb4-ad9d15794410 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.302815 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f8124-974e-46f8-acb4-ad9d15794410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:24.303507 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 788/1568] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:15:24.304771 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f8124-974e-46f8-acb4-ad9d15794410 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:24.304893 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c16c7-4f6c-4fc5-b964-dc1900cdc206 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.305222 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c16c7-4f6c-4fc5-b964-dc1900cdc206 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.305622 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c16c7-4f6c-4fc5-b964-dc1900cdc206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.317761 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 781/1569] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:24.318717 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f8124-974e-46f8-acb4-ad9d15794410 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:24.329499 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-d43c16c7-4f6c-4fc5-b964-dc1900cdc206 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:24.330007 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f8124-974e-46f8-acb4-ad9d15794410 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:24.330697 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d43c16c7-4f6c-4fc5-b964-dc1900cdc206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:24.338079 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145a13d-1bbd-4e08-a92c-04f8f104e61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:24.339038 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145a13d-1bbd-4e08-a92c-04f8f104e61c admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.339535 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145a13d-1bbd-4e08-a92c-04f8f104e61c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.340031 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145a13d-1bbd-4e08-a92c-04f8f104e61c admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.341070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145a13d-1bbd-4e08-a92c-04f8f104e61c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:15:24.341614 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145a13d-1bbd-4e08-a92c-04f8f104e61c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:24.343740 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145a13d-1bbd-4e08-a92c-04f8f104e61c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:24.348958 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 789/1570] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:24.348958 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c16c7-4f6c-4fc5-b964-dc1900cdc206 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:24.358040 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c16c7-4f6c-4fc5-b964-dc1900cdc206 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:24.365520 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 782/1571] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:15:24.365657 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96300a89-65d3-4332-801c-9648a8d91e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:24.366175 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96300a89-65d3-4332-801c-9648a8d91e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.366459 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96300a89-65d3-4332-801c-9648a8d91e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.366734 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96300a89-65d3-4332-801c-9648a8d91e24 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.367779 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96300a89-65d3-4332-801c-9648a8d91e24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:15:24.368120 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96300a89-65d3-4332-801c-9648a8d91e24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:24.369929 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96300a89-65d3-4332-801c-9648a8d91e24 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:24.372934 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145a13d-1bbd-4e08-a92c-04f8f104e61c admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:24.383682 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145a13d-1bbd-4e08-a92c-04f8f104e61c admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:24.388056 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 790/1572] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:15:24.388517 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d51d2-1cc3-4b08-9cb7-bab15b90a189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:24.389179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d51d2-1cc3-4b08-9cb7-bab15b90a189 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.389467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d51d2-1cc3-4b08-9cb7-bab15b90a189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.389875 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d51d2-1cc3-4b08-9cb7-bab15b90a189 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.390444 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d51d2-1cc3-4b08-9cb7-bab15b90a189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:24.390594 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96300a89-65d3-4332-801c-9648a8d91e24 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:24.392415 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d51d2-1cc3-4b08-9cb7-bab15b90a189 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:24.402528 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96300a89-65d3-4332-801c-9648a8d91e24 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:24.408587 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624cef9-0a38-4c14-8106-2fe4fc7710af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:24.409544 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624cef9-0a38-4c14-8106-2fe4fc7710af admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.409783 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624cef9-0a38-4c14-8106-2fe4fc7710af admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.410001 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624cef9-0a38-4c14-8106-2fe4fc7710af admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.410766 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624cef9-0a38-4c14-8106-2fe4fc7710af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:15:24.411068 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624cef9-0a38-4c14-8106-2fe4fc7710af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:24.412701 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624cef9-0a38-4c14-8106-2fe4fc7710af admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:24.425690 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 783/1573] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:24 2022] POST /identity/v3/projects => generated 357 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:24.425890 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 791/1574] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:15:24.426509 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624cef9-0a38-4c14-8106-2fe4fc7710af admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:24.426639 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d51d2-1cc3-4b08-9cb7-bab15b90a189 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:24.436950 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624cef9-0a38-4c14-8106-2fe4fc7710af admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:24.495297 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d51d2-1cc3-4b08-9cb7-bab15b90a189 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:24.500832 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169fc88-246d-4f97-9f62-f48e1147367d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:24.501589 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169fc88-246d-4f97-9f62-f48e1147367d admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.501949 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169fc88-246d-4f97-9f62-f48e1147367d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.502237 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169fc88-246d-4f97-9f62-f48e1147367d admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.502949 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169fc88-246d-4f97-9f62-f48e1147367d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:24.504986 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169fc88-246d-4f97-9f62-f48e1147367d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:24.507023 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998ae09-ad1c-4673-9e6a-837f597cc9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:24.507830 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998ae09-ad1c-4673-9e6a-837f597cc9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.508841 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998ae09-ad1c-4673-9e6a-837f597cc9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.509130 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998ae09-ad1c-4673-9e6a-837f597cc9f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.509962 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998ae09-ad1c-4673-9e6a-837f597cc9f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:24.511554 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998ae09-ad1c-4673-9e6a-837f597cc9f8 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:24.522654 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 792/1575] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:24.523611 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998ae09-ad1c-4673-9e6a-837f597cc9f8 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:24.538430 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998ae09-ad1c-4673-9e6a-837f597cc9f8 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:24.539773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 784/1576] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:24 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:24.540705 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169fc88-246d-4f97-9f62-f48e1147367d admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:24.605206 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb33d0f-a05d-4a51-9173-d242e0208091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:24.605880 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb33d0f-a05d-4a51-9173-d242e0208091 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.606225 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb33d0f-a05d-4a51-9173-d242e0208091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.606573 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb33d0f-a05d-4a51-9173-d242e0208091 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.607450 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb33d0f-a05d-4a51-9173-d242e0208091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:15:24.607842 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb33d0f-a05d-4a51-9173-d242e0208091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:24.609524 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb33d0f-a05d-4a51-9173-d242e0208091 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:24.623145 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 793/1577] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:15:24.624089 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb33d0f-a05d-4a51-9173-d242e0208091 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:24.636830 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb33d0f-a05d-4a51-9173-d242e0208091 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:24.639959 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169fc88-246d-4f97-9f62-f48e1147367d admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:24.643008 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5abde-bf81-4d45-b84c-890ebc599944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:24.644171 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5abde-bf81-4d45-b84c-890ebc599944 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.644667 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5abde-bf81-4d45-b84c-890ebc599944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.644914 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07cc57-6061-4d5d-b8e5-1452474bba32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:24.645443 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5abde-bf81-4d45-b84c-890ebc599944 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.645624 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07cc57-6061-4d5d-b8e5-1452474bba32 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.645897 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07cc57-6061-4d5d-b8e5-1452474bba32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.646174 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07cc57-6061-4d5d-b8e5-1452474bba32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.646931 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07cc57-6061-4d5d-b8e5-1452474bba32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:24.647199 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5abde-bf81-4d45-b84c-890ebc599944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:24.649586 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07cc57-6061-4d5d-b8e5-1452474bba32 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:24.650826 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5abde-bf81-4d45-b84c-890ebc599944 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:24.681197 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 785/1578] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:24 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:24.682319 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07cc57-6061-4d5d-b8e5-1452474bba32 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:24.691838 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 794/1579] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:24 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:24.692697 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5abde-bf81-4d45-b84c-890ebc599944 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:24.762822 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07cc57-6061-4d5d-b8e5-1452474bba32 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:24.768649 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de50eba-bbf8-4dc6-8e8a-583aae6895d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:24.769703 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de50eba-bbf8-4dc6-8e8a-583aae6895d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.769991 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de50eba-bbf8-4dc6-8e8a-583aae6895d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.770295 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de50eba-bbf8-4dc6-8e8a-583aae6895d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.771032 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de50eba-bbf8-4dc6-8e8a-583aae6895d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:24.773315 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de50eba-bbf8-4dc6-8e8a-583aae6895d2 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:24.774140 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5abde-bf81-4d45-b84c-890ebc599944 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:24.779047 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62830002-4612-4fe0-9151-276981c8fe9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:24.779891 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62830002-4612-4fe0-9151-276981c8fe9b admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.780311 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62830002-4612-4fe0-9151-276981c8fe9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.780744 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62830002-4612-4fe0-9151-276981c8fe9b admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.781518 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62830002-4612-4fe0-9151-276981c8fe9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:24.783549 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62830002-4612-4fe0-9151-276981c8fe9b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:24.798000 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 786/1580] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:24 2022] POST /identity/v3/users => generated 279 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:24.799064 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de50eba-bbf8-4dc6-8e8a-583aae6895d2 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:24.812245 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de50eba-bbf8-4dc6-8e8a-583aae6895d2 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:24.817293 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecb0cb-32a6-436a-9afa-ea385cf38c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:24.818535 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 795/1581] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:24 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:24.818941 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecb0cb-32a6-436a-9afa-ea385cf38c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.819256 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62830002-4612-4fe0-9151-276981c8fe9b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:24.819694 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecb0cb-32a6-436a-9afa-ea385cf38c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.820098 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecb0cb-32a6-436a-9afa-ea385cf38c7a admin admin] PATH_INFO: `/v3/projects/0256f193432141a582df6c7960b3f1ce/users/04d26b3aaeac4e6095755df3d9e34737/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.840750 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecb0cb-32a6-436a-9afa-ea385cf38c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0256f193432141a582df6c7960b3f1ce, user_id=04d26b3aaeac4e6095755df3d9e34737, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:24.843876 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecb0cb-32a6-436a-9afa-ea385cf38c7a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:24.858765 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 787/1582] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:24 2022] PUT /identity/v3/projects/0256f193432141a582df6c7960b3f1ce/users/04d26b3aaeac4e6095755df3d9e34737/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:24.859494 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecb0cb-32a6-436a-9afa-ea385cf38c7a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:24.891935 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62830002-4612-4fe0-9151-276981c8fe9b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:24.930583 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecb0cb-32a6-436a-9afa-ea385cf38c7a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:24.936410 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a58f8-d686-427d-855f-1d3fc38e4faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:24.937145 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a58f8-d686-427d-855f-1d3fc38e4faf admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.937455 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a58f8-d686-427d-855f-1d3fc38e4faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.937809 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a58f8-d686-427d-855f-1d3fc38e4faf admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.938554 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a58f8-d686-427d-855f-1d3fc38e4faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:24.941699 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a58f8-d686-427d-855f-1d3fc38e4faf admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:24.962061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee47510-468f-4c22-a285-cd49f7083c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:24.963706 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee47510-468f-4c22-a285-cd49f7083c16 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:24.964183 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee47510-468f-4c22-a285-cd49f7083c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:24.964717 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee47510-468f-4c22-a285-cd49f7083c16 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:24.965687 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee47510-468f-4c22-a285-cd49f7083c16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:24.968270 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee47510-468f-4c22-a285-cd49f7083c16 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:24.980702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 788/1583] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:24 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:24.982877 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a58f8-d686-427d-855f-1d3fc38e4faf admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.005063 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 796/1584] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:24 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:25.006190 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee47510-468f-4c22-a285-cd49f7083c16 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.019558 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee47510-468f-4c22-a285-cd49f7083c16 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.074456 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a58f8-d686-427d-855f-1d3fc38e4faf admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.079409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153fb97-a6e0-4aee-848e-30df5bb342ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.080154 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153fb97-a6e0-4aee-848e-30df5bb342ec admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.080454 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153fb97-a6e0-4aee-848e-30df5bb342ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.080713 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153fb97-a6e0-4aee-848e-30df5bb342ec admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.081445 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153fb97-a6e0-4aee-848e-30df5bb342ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.083365 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153fb97-a6e0-4aee-848e-30df5bb342ec admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.089267 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8c96e-b8da-422a-aa0a-cfafd66b15ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.089960 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8c96e-b8da-422a-aa0a-cfafd66b15ab admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.090245 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8c96e-b8da-422a-aa0a-cfafd66b15ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.090521 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8c96e-b8da-422a-aa0a-cfafd66b15ab admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.091272 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8c96e-b8da-422a-aa0a-cfafd66b15ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.093478 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8c96e-b8da-422a-aa0a-cfafd66b15ab admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.109066 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 789/1585] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:24 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:25.110272 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153fb97-a6e0-4aee-848e-30df5bb342ec admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.119130 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 797/1586] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:25 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:25.120006 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8c96e-b8da-422a-aa0a-cfafd66b15ab admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.122552 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153fb97-a6e0-4aee-848e-30df5bb342ec admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.127354 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a692e4-f0ce-4a58-b810-61fbfdc2a7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.128314 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a692e4-f0ce-4a58-b810-61fbfdc2a7dc admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.128627 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a692e4-f0ce-4a58-b810-61fbfdc2a7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.129046 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a692e4-f0ce-4a58-b810-61fbfdc2a7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.129613 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a692e4-f0ce-4a58-b810-61fbfdc2a7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.131229 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a692e4-f0ce-4a58-b810-61fbfdc2a7dc admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.132887 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8c96e-b8da-422a-aa0a-cfafd66b15ab admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.139598 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914db61-cd96-4a71-8780-ba5d3e6f5f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.141499 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914db61-cd96-4a71-8780-ba5d3e6f5f64 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.141792 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914db61-cd96-4a71-8780-ba5d3e6f5f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.145186 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914db61-cd96-4a71-8780-ba5d3e6f5f64 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.145312 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 790/1587] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:25.145424 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914db61-cd96-4a71-8780-ba5d3e6f5f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.145513 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e535808-93b4-4c25-99b1-e692d8b2c8b4 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.145513 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e535808-93b4-4c25-99b1-e692d8b2c8b4 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.145513 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e535808-93b4-4c25-99b1-e692d8b2c8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.146681 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914db61-cd96-4a71-8780-ba5d3e6f5f64 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.161889 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-8e535808-93b4-4c25-99b1-e692d8b2c8b4 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:25.163081 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-8e535808-93b4-4c25-99b1-e692d8b2c8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:25.173542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 798/1588] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:25 2022] POST /identity/v3/users => generated 293 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:25.173542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914db61-cd96-4a71-8780-ba5d3e6f5f64 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.173823 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 791/1589] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:25.173823 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e535808-93b4-4c25-99b1-e692d8b2c8b4 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.184680 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914db61-cd96-4a71-8780-ba5d3e6f5f64 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.185724 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e535808-93b4-4c25-99b1-e692d8b2c8b4 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.189635 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fed7de-d099-43f6-bb17-27f6818814e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.190230 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695c251-964c-4143-9372-31cedacc68d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.190365 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fed7de-d099-43f6-bb17-27f6818814e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.190563 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fed7de-d099-43f6-bb17-27f6818814e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.190843 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fed7de-d099-43f6-bb17-27f6818814e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.190944 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695c251-964c-4143-9372-31cedacc68d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.191159 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695c251-964c-4143-9372-31cedacc68d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.191436 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695c251-964c-4143-9372-31cedacc68d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.191548 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fed7de-d099-43f6-bb17-27f6818814e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.192204 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695c251-964c-4143-9372-31cedacc68d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.193472 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fed7de-d099-43f6-bb17-27f6818814e1 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.193784 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695c251-964c-4143-9372-31cedacc68d9 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.207537 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 792/1590] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:25.207537 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b394b0-add1-498f-8d4d-8fed783643af None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.207537 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b394b0-add1-498f-8d4d-8fed783643af None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.207537 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b394b0-add1-498f-8d4d-8fed783643af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.218375 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 799/1591] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:25 2022] POST /identity/v3/users => generated 290 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:25.218375 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fed7de-d099-43f6-bb17-27f6818814e1 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.228500 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fed7de-d099-43f6-bb17-27f6818814e1 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.233118 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dbfaa-fa26-4b74-96ee-2a2bff5a37de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.233778 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dbfaa-fa26-4b74-96ee-2a2bff5a37de admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.234144 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dbfaa-fa26-4b74-96ee-2a2bff5a37de admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.235194 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dbfaa-fa26-4b74-96ee-2a2bff5a37de admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.235979 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2dbfaa-fa26-4b74-96ee-2a2bff5a37de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.237577 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2dbfaa-fa26-4b74-96ee-2a2bff5a37de admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.237971 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-73b394b0-add1-498f-8d4d-8fed783643af None None] MFA Rules not processed for user `3fc84b127fde4ce4a262e4786acfd7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:25.239196 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-73b394b0-add1-498f-8d4d-8fed783643af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:25.248868 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 800/1592] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:25.249677 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dbfaa-fa26-4b74-96ee-2a2bff5a37de admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.259276 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dbfaa-fa26-4b74-96ee-2a2bff5a37de admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.264005 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db4656-e14c-428e-960c-3f58f4dfa283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.264770 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db4656-e14c-428e-960c-3f58f4dfa283 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.265295 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db4656-e14c-428e-960c-3f58f4dfa283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.265577 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db4656-e14c-428e-960c-3f58f4dfa283 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.266308 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db4656-e14c-428e-960c-3f58f4dfa283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.267909 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db4656-e14c-428e-960c-3f58f4dfa283 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.278719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 801/1593] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:25.279367 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db4656-e14c-428e-960c-3f58f4dfa283 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.289111 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db4656-e14c-428e-960c-3f58f4dfa283 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.294358 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01790397-7b99-4f88-a7af-4f1d1edc4688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.294997 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01790397-7b99-4f88-a7af-4f1d1edc4688 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.295280 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01790397-7b99-4f88-a7af-4f1d1edc4688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.295554 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01790397-7b99-4f88-a7af-4f1d1edc4688 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.296318 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01790397-7b99-4f88-a7af-4f1d1edc4688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.298170 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01790397-7b99-4f88-a7af-4f1d1edc4688 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.303521 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 793/1594] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:25.304397 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b394b0-add1-498f-8d4d-8fed783643af None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.312330 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 802/1595] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:25.312330 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01790397-7b99-4f88-a7af-4f1d1edc4688 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.313785 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-01790397-7b99-4f88-a7af-4f1d1edc4688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:25.315635 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b394b0-add1-498f-8d4d-8fed783643af None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.320246 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc451c5-d99f-401f-8289-74e58d885cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.321041 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc451c5-d99f-401f-8289-74e58d885cbc admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.321322 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc451c5-d99f-401f-8289-74e58d885cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.321635 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc451c5-d99f-401f-8289-74e58d885cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.322459 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc451c5-d99f-401f-8289-74e58d885cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.324075 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc451c5-d99f-401f-8289-74e58d885cbc admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.333853 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 794/1596] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:25.334640 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc451c5-d99f-401f-8289-74e58d885cbc admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.344712 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc451c5-d99f-401f-8289-74e58d885cbc admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.349446 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed0d96-26be-4109-b539-aedcb879422a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.350212 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed0d96-26be-4109-b539-aedcb879422a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.350400 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed0d96-26be-4109-b539-aedcb879422a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.350679 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed0d96-26be-4109-b539-aedcb879422a admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.351404 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed0d96-26be-4109-b539-aedcb879422a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.353683 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed0d96-26be-4109-b539-aedcb879422a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.363651 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 795/1597] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:25.364413 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed0d96-26be-4109-b539-aedcb879422a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.374954 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed0d96-26be-4109-b539-aedcb879422a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.376930 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01790397-7b99-4f88-a7af-4f1d1edc4688 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.379517 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432d0fa-b476-484e-9c7b-fd8c527a8007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.380200 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432d0fa-b476-484e-9c7b-fd8c527a8007 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.380483 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23961c4d-f767-4a97-9e55-6666667815d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.380610 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432d0fa-b476-484e-9c7b-fd8c527a8007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.380759 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432d0fa-b476-484e-9c7b-fd8c527a8007 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.381116 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23961c4d-f767-4a97-9e55-6666667815d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.381402 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23961c4d-f767-4a97-9e55-6666667815d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.381493 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432d0fa-b476-484e-9c7b-fd8c527a8007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.381682 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23961c4d-f767-4a97-9e55-6666667815d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.383064 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432d0fa-b476-484e-9c7b-fd8c527a8007 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.390614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23961c4d-f767-4a97-9e55-6666667815d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.392094 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23961c4d-f767-4a97-9e55-6666667815d8 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.393386 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 796/1598] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:25.394161 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432d0fa-b476-484e-9c7b-fd8c527a8007 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.403063 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 803/1599] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:25.403920 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23961c4d-f767-4a97-9e55-6666667815d8 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.404063 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432d0fa-b476-484e-9c7b-fd8c527a8007 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.408443 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f47114-205b-49f4-8411-dc6855f81c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.409095 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f47114-205b-49f4-8411-dc6855f81c7b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.409382 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f47114-205b-49f4-8411-dc6855f81c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.409656 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f47114-205b-49f4-8411-dc6855f81c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.410383 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f47114-205b-49f4-8411-dc6855f81c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.412010 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f47114-205b-49f4-8411-dc6855f81c7b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.413022 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23961c4d-f767-4a97-9e55-6666667815d8 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.418189 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03835faa-6824-46df-9254-cced83b9efd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.418836 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03835faa-6824-46df-9254-cced83b9efd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.419122 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03835faa-6824-46df-9254-cced83b9efd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.419401 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03835faa-6824-46df-9254-cced83b9efd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.420166 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03835faa-6824-46df-9254-cced83b9efd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.421733 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03835faa-6824-46df-9254-cced83b9efd8 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.423164 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 797/1600] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:25.423994 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f47114-205b-49f4-8411-dc6855f81c7b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.432553 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 804/1601] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:25.433879 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc4309-a361-4e6b-aa24-bfc80d3a7097 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.434166 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc4309-a361-4e6b-aa24-bfc80d3a7097 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.434440 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc4309-a361-4e6b-aa24-bfc80d3a7097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.438423 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f47114-205b-49f4-8411-dc6855f81c7b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.443701 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c2de7-66db-4e12-8024-2d0afc04f4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.444628 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c2de7-66db-4e12-8024-2d0afc04f4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.445043 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c2de7-66db-4e12-8024-2d0afc04f4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.445415 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c2de7-66db-4e12-8024-2d0afc04f4e2 admin admin] PATH_INFO: `/v3/projects/7717da15265145e3854616825c2b1d4c/users/06f9f3ad3cfa414d884e017b0376c27e/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.452327 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-48dc4309-a361-4e6b-aa24-bfc80d3a7097 None None] MFA Rules not processed for user `3fc84b127fde4ce4a262e4786acfd7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:25.453561 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-48dc4309-a361-4e6b-aa24-bfc80d3a7097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:25.460245 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c2de7-66db-4e12-8024-2d0afc04f4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7717da15265145e3854616825c2b1d4c, user_id=06f9f3ad3cfa414d884e017b0376c27e, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.460871 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 805/1602] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:25.462504 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc4309-a361-4e6b-aa24-bfc80d3a7097 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.463708 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c2de7-66db-4e12-8024-2d0afc04f4e2 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.475866 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc4309-a361-4e6b-aa24-bfc80d3a7097 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.479623 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 798/1603] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:25 2022] PUT /identity/v3/projects/7717da15265145e3854616825c2b1d4c/users/06f9f3ad3cfa414d884e017b0376c27e/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:25.480638 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c2de7-66db-4e12-8024-2d0afc04f4e2 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.568770 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5554a-ad72-444a-b353-fc6fe92a2abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.569487 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5554a-ad72-444a-b353-fc6fe92a2abc admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.569815 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5554a-ad72-444a-b353-fc6fe92a2abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.570121 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5554a-ad72-444a-b353-fc6fe92a2abc admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.570972 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5554a-ad72-444a-b353-fc6fe92a2abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.573190 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5554a-ad72-444a-b353-fc6fe92a2abc admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.579552 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c2de7-66db-4e12-8024-2d0afc04f4e2 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.587897 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 806/1604] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:25.588055 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca5064-add6-4a28-8df1-3e1fe4f244eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.588156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5554a-ad72-444a-b353-fc6fe92a2abc admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.588254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca5064-add6-4a28-8df1-3e1fe4f244eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.588254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca5064-add6-4a28-8df1-3e1fe4f244eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.588254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca5064-add6-4a28-8df1-3e1fe4f244eb admin admin] PATH_INFO: `/v3/projects/814fc0f0284442fe80c9b5e89352a787/users/347271993cab43ef86eefef51b16dca5/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.600196 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5554a-ad72-444a-b353-fc6fe92a2abc admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.604909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca5064-add6-4a28-8df1-3e1fe4f244eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=814fc0f0284442fe80c9b5e89352a787, user_id=347271993cab43ef86eefef51b16dca5, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.606738 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5ea58-3132-48ab-afd5-d7796a64d8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.607703 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5ea58-3132-48ab-afd5-d7796a64d8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.607889 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca5064-add6-4a28-8df1-3e1fe4f244eb admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.608983 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5ea58-3132-48ab-afd5-d7796a64d8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.608983 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5ea58-3132-48ab-afd5-d7796a64d8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.609764 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5ea58-3132-48ab-afd5-d7796a64d8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.611122 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5ea58-3132-48ab-afd5-d7796a64d8c4 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.639865 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 799/1605] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:25 2022] PUT /identity/v3/projects/814fc0f0284442fe80c9b5e89352a787/users/347271993cab43ef86eefef51b16dca5/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:25.640121 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 807/1606] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:25.640228 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca5064-add6-4a28-8df1-3e1fe4f244eb admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.640331 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5ea58-3132-48ab-afd5-d7796a64d8c4 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.640331 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5ea58-3132-48ab-afd5-d7796a64d8c4 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.715617 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca5064-add6-4a28-8df1-3e1fe4f244eb admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.720325 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ed0d3-f2aa-4afa-a3b3-1b0949c6af83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.720541 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75529f5f-3a5c-4910-8d47-e3b77d2a85ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.721423 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75529f5f-3a5c-4910-8d47-e3b77d2a85ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.721624 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ed0d3-f2aa-4afa-a3b3-1b0949c6af83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.721715 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75529f5f-3a5c-4910-8d47-e3b77d2a85ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.721938 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ed0d3-f2aa-4afa-a3b3-1b0949c6af83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.722045 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75529f5f-3a5c-4910-8d47-e3b77d2a85ea admin admin] PATH_INFO: `/v3/projects/9abf9a2d9786407db88747489fccee75/users/c79ad420f1064032886213df293b789e/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.722130 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ed0d3-f2aa-4afa-a3b3-1b0949c6af83 admin admin] PATH_INFO: `/v3/projects/77ee0d232a574e3e8ad570987e058990/users/a1190ab3568d40ac81b172012b78d18c/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.738332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75529f5f-3a5c-4910-8d47-e3b77d2a85ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9abf9a2d9786407db88747489fccee75, user_id=c79ad420f1064032886213df293b789e, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.738848 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ed0d3-f2aa-4afa-a3b3-1b0949c6af83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ee0d232a574e3e8ad570987e058990, user_id=a1190ab3568d40ac81b172012b78d18c, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.741720 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75529f5f-3a5c-4910-8d47-e3b77d2a85ea admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.743963 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ed0d3-f2aa-4afa-a3b3-1b0949c6af83 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.760899 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 800/1607] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:25 2022] PUT /identity/v3/projects/9abf9a2d9786407db88747489fccee75/users/c79ad420f1064032886213df293b789e/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:25.765515 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742576a-97a6-446d-a09e-3c952f2525c9 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.765810 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742576a-97a6-446d-a09e-3c952f2525c9 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.766239 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742576a-97a6-446d-a09e-3c952f2525c9 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.766392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 808/1608] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:25 2022] PUT /identity/v3/projects/77ee0d232a574e3e8ad570987e058990/users/a1190ab3568d40ac81b172012b78d18c/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:25.767889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062f6e8-72a7-4afa-9a76-6d47b06e118c None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.768417 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 801/1609] 10.222.0.77 () {54 vars in 961 bytes} [Thu Feb 10 23:15:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:15:25.769207 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742576a-97a6-446d-a09e-3c952f2525c9 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.774135 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062f6e8-72a7-4afa-9a76-6d47b06e118c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.779640 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062f6e8-72a7-4afa-9a76-6d47b06e118c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.830466 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-a062f6e8-72a7-4afa-9a76-6d47b06e118c None None] MFA Rules not processed for user `06f9f3ad3cfa414d884e017b0376c27e`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:25.831690 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a062f6e8-72a7-4afa-9a76-6d47b06e118c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:25.882490 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742576a-97a6-446d-a09e-3c952f2525c9 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.889656 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56909d-9184-479c-a909-cd2379e33fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:25.890900 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56909d-9184-479c-a909-cd2379e33fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.890900 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56909d-9184-479c-a909-cd2379e33fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.891339 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56909d-9184-479c-a909-cd2379e33fd3 admin admin] PATH_INFO: `/v3/projects/9ab12603f3ae4b098df08267be769e7a/users/bf4571d4a93246429874fb6bced95c85/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.907769 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56909d-9184-479c-a909-cd2379e33fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ab12603f3ae4b098df08267be769e7a, user_id=bf4571d4a93246429874fb6bced95c85, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:25.910560 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56909d-9184-479c-a909-cd2379e33fd3 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:25.925795 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 809/1610] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:25 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:25.926696 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062f6e8-72a7-4afa-9a76-6d47b06e118c None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:25.931718 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 802/1611] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:25 2022] PUT /identity/v3/projects/9ab12603f3ae4b098df08267be769e7a/users/bf4571d4a93246429874fb6bced95c85/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:25.933015 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b5ce8-c121-4db3-b700-b7f1956577c5 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:25.933378 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b5ce8-c121-4db3-b700-b7f1956577c5 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:25.933732 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b5ce8-c121-4db3-b700-b7f1956577c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:25.941156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062f6e8-72a7-4afa-9a76-6d47b06e118c None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:25.966256 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-987b5ce8-c121-4db3-b700-b7f1956577c5 None None] MFA Rules not processed for user `347271993cab43ef86eefef51b16dca5`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:25.967720 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-987b5ce8-c121-4db3-b700-b7f1956577c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:26.004500 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462569a-f036-4c2d-858b-a1df303bc368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:26.005107 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462569a-f036-4c2d-858b-a1df303bc368 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:26.005390 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462569a-f036-4c2d-858b-a1df303bc368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:26.005665 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462569a-f036-4c2d-858b-a1df303bc368 admin admin] PATH_INFO: `/v3/projects/40d29f1656b846b189997591a14ec771/users/0f817d94cd1f404da4c0576f9207c600/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:26.023428 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462569a-f036-4c2d-858b-a1df303bc368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40d29f1656b846b189997591a14ec771, user_id=0f817d94cd1f404da4c0576f9207c600, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:26.027057 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462569a-f036-4c2d-858b-a1df303bc368 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:26.040039 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 803/1612] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:26.040039 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bd77a-48d9-4141-83e0-34ff36fe5b4c None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:26.040480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bd77a-48d9-4141-83e0-34ff36fe5b4c None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:26.040480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bd77a-48d9-4141-83e0-34ff36fe5b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:26.046183 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 810/1613] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:25 2022] PUT /identity/v3/projects/40d29f1656b846b189997591a14ec771/users/0f817d94cd1f404da4c0576f9207c600/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:26.047767 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788e3ca-e823-40f5-a2c6-5a85a126490b None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:26.048105 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788e3ca-e823-40f5-a2c6-5a85a126490b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:26.048383 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788e3ca-e823-40f5-a2c6-5a85a126490b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:26.073784 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-a788e3ca-e823-40f5-a2c6-5a85a126490b None None] MFA Rules not processed for user `551da2c9fab74cb8b14287a5634adb25`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:26.078882 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a788e3ca-e823-40f5-a2c6-5a85a126490b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:26.108393 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-038bd77a-48d9-4141-83e0-34ff36fe5b4c None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:26.109603 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-038bd77a-48d9-4141-83e0-34ff36fe5b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:26.177240 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 811/1614] 10.222.0.77 () {58 vars in 1058 bytes} [Thu Feb 10 23:15:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:26.179253 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659c56b-c4d5-4ff1-9b4f-d1c64ced5b9f None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:26.179658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659c56b-c4d5-4ff1-9b4f-d1c64ced5b9f None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:26.180609 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659c56b-c4d5-4ff1-9b4f-d1c64ced5b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:26.215362 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-8659c56b-c4d5-4ff1-9b4f-d1c64ced5b9f None None] MFA Rules not processed for user `c79ad420f1064032886213df293b789e`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:26.216989 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-8659c56b-c4d5-4ff1-9b4f-d1c64ced5b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:26.221503 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 804/1615] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:26.222776 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bd77a-48d9-4141-83e0-34ff36fe5b4c None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:26.255543 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bd77a-48d9-4141-83e0-34ff36fe5b4c None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:26.264570 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac0516-b85f-4e70-80ed-f859cb690904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:26.265251 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac0516-b85f-4e70-80ed-f859cb690904 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:26.265544 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac0516-b85f-4e70-80ed-f859cb690904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:26.265822 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac0516-b85f-4e70-80ed-f859cb690904 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:26.266540 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac0516-b85f-4e70-80ed-f859cb690904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:26.268966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac0516-b85f-4e70-80ed-f859cb690904 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:26.296106 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 812/1616] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:26.297570 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9b18b-39b3-4010-afcd-22b1ed788764 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:26.297862 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9b18b-39b3-4010-afcd-22b1ed788764 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:26.298144 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9b18b-39b3-4010-afcd-22b1ed788764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:26.301886 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 805/1617] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:26 2022] POST /identity/v3/projects => generated 357 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:26.303620 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a24f7-38b3-480e-aa8f-6441e4946a2b None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:26.304218 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a24f7-38b3-480e-aa8f-6441e4946a2b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:26.304441 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a24f7-38b3-480e-aa8f-6441e4946a2b None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:26.307163 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 806/1618] 10.222.0.77 () {54 vars in 961 bytes} [Thu Feb 10 23:15:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:15:26.308696 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2fd14-6bff-49ef-9eda-e3219faa812e None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:26.309884 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2fd14-6bff-49ef-9eda-e3219faa812e None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:26.310332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2fd14-6bff-49ef-9eda-e3219faa812e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:26.322949 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-7ec9b18b-39b3-4010-afcd-22b1ed788764 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:26.324382 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-7ec9b18b-39b3-4010-afcd-22b1ed788764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:26.339498 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-31f2fd14-6bff-49ef-9eda-e3219faa812e None None] MFA Rules not processed for user `0f817d94cd1f404da4c0576f9207c600`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:26.340795 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-31f2fd14-6bff-49ef-9eda-e3219faa812e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:26.406358 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 813/1619] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:26.410387 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9b18b-39b3-4010-afcd-22b1ed788764 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:26.410913 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 807/1620] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:26.411937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2fd14-6bff-49ef-9eda-e3219faa812e None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:26.471041 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2fd14-6bff-49ef-9eda-e3219faa812e None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:26.474723 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44069159-8da2-4f39-94a0-e2295b119f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:26.475374 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44069159-8da2-4f39-94a0-e2295b119f59 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:26.475652 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44069159-8da2-4f39-94a0-e2295b119f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:26.475959 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44069159-8da2-4f39-94a0-e2295b119f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:26.485852 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44069159-8da2-4f39-94a0-e2295b119f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:26.487342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44069159-8da2-4f39-94a0-e2295b119f59 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:26.488125 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9b18b-39b3-4010-afcd-22b1ed788764 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:26.494626 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210c8bb-f993-4e2d-a3d8-4952ad0c077d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:26.495210 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210c8bb-f993-4e2d-a3d8-4952ad0c077d service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:26.495494 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210c8bb-f993-4e2d-a3d8-4952ad0c077d service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:26.495850 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210c8bb-f993-4e2d-a3d8-4952ad0c077d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:26.499513 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 808/1621] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:26.500987 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44069159-8da2-4f39-94a0-e2295b119f59 service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:26.513045 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44069159-8da2-4f39-94a0-e2295b119f59 service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:26.520409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f2745-626f-49f3-9cf2-351d37ee105b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:26.521874 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f2745-626f-49f3-9cf2-351d37ee105b admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:26.522160 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f2745-626f-49f3-9cf2-351d37ee105b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:26.523062 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f2745-626f-49f3-9cf2-351d37ee105b admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:26.524362 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f2745-626f-49f3-9cf2-351d37ee105b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:26.526289 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f2745-626f-49f3-9cf2-351d37ee105b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:26.558654 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 809/1622] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:26 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:26.559927 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f2745-626f-49f3-9cf2-351d37ee105b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:26.581084 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210c8bb-f993-4e2d-a3d8-4952ad0c077d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:26.584217 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210c8bb-f993-4e2d-a3d8-4952ad0c077d service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:26.598976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 814/1623] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:26.601082 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ca089-8eee-42ec-b8f4-1ce132a57b44 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:26.601375 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ca089-8eee-42ec-b8f4-1ce132a57b44 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:26.601656 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ca089-8eee-42ec-b8f4-1ce132a57b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:26.623183 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-fb9ca089-8eee-42ec-b8f4-1ce132a57b44 None None] MFA Rules not processed for user `551da2c9fab74cb8b14287a5634adb25`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:26.624431 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-fb9ca089-8eee-42ec-b8f4-1ce132a57b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:26.639811 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f2745-626f-49f3-9cf2-351d37ee105b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:26.651976 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025be96e-d2d8-47f3-ad31-0ac4a92cf30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:26.652704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025be96e-d2d8-47f3-ad31-0ac4a92cf30d admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:26.652994 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025be96e-d2d8-47f3-ad31-0ac4a92cf30d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:26.654956 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025be96e-d2d8-47f3-ad31-0ac4a92cf30d admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:26.655681 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025be96e-d2d8-47f3-ad31-0ac4a92cf30d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:26.657720 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025be96e-d2d8-47f3-ad31-0ac4a92cf30d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:26.690677 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 810/1624] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:26 2022] POST /identity/v3/users => generated 285 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:26.691548 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025be96e-d2d8-47f3-ad31-0ac4a92cf30d admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:26.704142 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025be96e-d2d8-47f3-ad31-0ac4a92cf30d admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:26.710091 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5275196-6445-40aa-bc7f-4b1cf93345d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:26.710759 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5275196-6445-40aa-bc7f-4b1cf93345d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:26.712205 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5275196-6445-40aa-bc7f-4b1cf93345d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:26.712511 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5275196-6445-40aa-bc7f-4b1cf93345d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:26.713231 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5275196-6445-40aa-bc7f-4b1cf93345d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:26.718663 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5275196-6445-40aa-bc7f-4b1cf93345d7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:26.734520 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 815/1625] 10.222.0.77 () {58 vars in 1058 bytes} [Thu Feb 10 23:15:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:26.735678 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ca089-8eee-42ec-b8f4-1ce132a57b44 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:26.788918 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 811/1626] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:26 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:26.790944 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5275196-6445-40aa-bc7f-4b1cf93345d7 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:26.812280 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ca089-8eee-42ec-b8f4-1ce132a57b44 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:26.901277 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166de688-e132-4b91-8533-30df0c41406b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:26.901976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166de688-e132-4b91-8533-30df0c41406b service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:26.902267 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166de688-e132-4b91-8533-30df0c41406b service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:26.902597 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166de688-e132-4b91-8533-30df0c41406b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:26.921957 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166de688-e132-4b91-8533-30df0c41406b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:26.922953 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5275196-6445-40aa-bc7f-4b1cf93345d7 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:26.923473 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166de688-e132-4b91-8533-30df0c41406b service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:26.940843 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43464f3d-2c70-4612-a061-9519ab42b0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:26.941841 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43464f3d-2c70-4612-a061-9519ab42b0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:26.942130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43464f3d-2c70-4612-a061-9519ab42b0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:26.942418 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43464f3d-2c70-4612-a061-9519ab42b0c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:26.943130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43464f3d-2c70-4612-a061-9519ab42b0c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:26.945262 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43464f3d-2c70-4612-a061-9519ab42b0c1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:26.945466 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 816/1627] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:26.947399 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166de688-e132-4b91-8533-30df0c41406b service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:26.960071 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166de688-e132-4b91-8533-30df0c41406b service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:26.966390 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1bb13-0517-4365-875f-fd56ec8e40c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:26.967124 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1bb13-0517-4365-875f-fd56ec8e40c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:26.967465 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1bb13-0517-4365-875f-fd56ec8e40c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:26.967799 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1bb13-0517-4365-875f-fd56ec8e40c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:26.968588 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1bb13-0517-4365-875f-fd56ec8e40c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:26.970621 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1bb13-0517-4365-875f-fd56ec8e40c2 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:26.975177 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 812/1628] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:26 2022] POST /identity/v3/users => generated 296 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:26.976436 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43464f3d-2c70-4612-a061-9519ab42b0c1 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:26.985234 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 817/1629] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:26.985234 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1bb13-0517-4365-875f-fd56ec8e40c2 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:26.996286 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1bb13-0517-4365-875f-fd56ec8e40c2 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:27.009661 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac86d3e-b888-482f-bcfb-d2c82d0c8e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:27.010348 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac86d3e-b888-482f-bcfb-d2c82d0c8e72 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:27.010631 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac86d3e-b888-482f-bcfb-d2c82d0c8e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:27.011109 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac86d3e-b888-482f-bcfb-d2c82d0c8e72 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:27.011765 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac86d3e-b888-482f-bcfb-d2c82d0c8e72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:27.014743 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac86d3e-b888-482f-bcfb-d2c82d0c8e72 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:27.049160 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 818/1630] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:26 2022] POST /identity/v3/users => generated 296 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:27.050920 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147f15d-2938-43fe-a19f-5b39489bb8aa None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:27.051388 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147f15d-2938-43fe-a19f-5b39489bb8aa None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:27.051987 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147f15d-2938-43fe-a19f-5b39489bb8aa None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:27.053910 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 819/1631] 10.222.0.77 () {54 vars in 912 bytes} [Thu Feb 10 23:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:15:27.054540 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147f15d-2938-43fe-a19f-5b39489bb8aa None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:27.073804 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43464f3d-2c70-4612-a061-9519ab42b0c1 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:27.078877 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147f15d-2938-43fe-a19f-5b39489bb8aa None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:27.089830 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6c074-a2e1-4a16-af39-bebba5e68eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:27.090516 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6c074-a2e1-4a16-af39-bebba5e68eba admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:27.090813 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6c074-a2e1-4a16-af39-bebba5e68eba admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:27.091587 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6c074-a2e1-4a16-af39-bebba5e68eba admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:27.092551 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6c074-a2e1-4a16-af39-bebba5e68eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:27.094775 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6c074-a2e1-4a16-af39-bebba5e68eba admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:27.096241 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34321e-d077-4739-a900-248730fb68a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:27.097162 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34321e-d077-4739-a900-248730fb68a8 service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:27.097646 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34321e-d077-4739-a900-248730fb68a8 service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:27.098162 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34321e-d077-4739-a900-248730fb68a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:27.110536 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 820/1632] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:27.111520 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6c074-a2e1-4a16-af39-bebba5e68eba admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:27.125658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6c074-a2e1-4a16-af39-bebba5e68eba admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:27.132398 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff17e91-711a-4d5e-927f-1271ab937109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:27.134139 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff17e91-711a-4d5e-927f-1271ab937109 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:27.134527 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff17e91-711a-4d5e-927f-1271ab937109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:27.134908 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff17e91-711a-4d5e-927f-1271ab937109 admin admin] PATH_INFO: `/v3/projects/fee7b0f91c59456180625364ad763114/users/f259c487e9b04b7794c73735f1097d6e/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:27.156725 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff17e91-711a-4d5e-927f-1271ab937109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee7b0f91c59456180625364ad763114, user_id=f259c487e9b04b7794c73735f1097d6e, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:27.160540 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff17e91-711a-4d5e-927f-1271ab937109 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:27.173036 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34321e-d077-4739-a900-248730fb68a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:27.175592 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34321e-d077-4739-a900-248730fb68a8 service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:27.179892 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 821/1633] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:27 2022] PUT /identity/v3/projects/fee7b0f91c59456180625364ad763114/users/f259c487e9b04b7794c73735f1097d6e/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:27.181263 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff17e91-711a-4d5e-927f-1271ab937109 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:27.188269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 813/1634] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:27.189926 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c52dea-7e8c-4473-b391-bf7acdbe9aaa None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:27.190348 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c52dea-7e8c-4473-b391-bf7acdbe9aaa None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:27.190717 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c52dea-7e8c-4473-b391-bf7acdbe9aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:27.215924 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-92c52dea-7e8c-4473-b391-bf7acdbe9aaa None None] MFA Rules not processed for user `551da2c9fab74cb8b14287a5634adb25`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:27.217309 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-92c52dea-7e8c-4473-b391-bf7acdbe9aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:27.299474 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff17e91-711a-4d5e-927f-1271ab937109 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:27.311343 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb5873-b2e1-4e89-8469-65695045c93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:27.312340 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb5873-b2e1-4e89-8469-65695045c93f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:27.313374 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb5873-b2e1-4e89-8469-65695045c93f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:27.313820 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb5873-b2e1-4e89-8469-65695045c93f admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:27.314790 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb5873-b2e1-4e89-8469-65695045c93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:27.318010 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb5873-b2e1-4e89-8469-65695045c93f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:27.332985 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 822/1635] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:27.334580 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb5873-b2e1-4e89-8469-65695045c93f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:27.349482 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb5873-b2e1-4e89-8469-65695045c93f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:27.359876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685dee6-1452-4eb9-ab63-f53d2635e080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:27.362957 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685dee6-1452-4eb9-ab63-f53d2635e080 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:27.363508 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685dee6-1452-4eb9-ab63-f53d2635e080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:27.364018 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685dee6-1452-4eb9-ab63-f53d2635e080 admin admin] PATH_INFO: `/v3/projects/87f8da83fdba4d7c915ebcfaff794d45/users/3a5b8c3eb9194f8b92aecb533f6edfef/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:27.380682 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 814/1636] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Feb 10 23:15:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:27.381442 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c52dea-7e8c-4473-b391-bf7acdbe9aaa None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:27.395626 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c52dea-7e8c-4473-b391-bf7acdbe9aaa None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:27.402678 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eebf79-2a10-475c-acb3-2d10151bf958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:27.403502 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eebf79-2a10-475c-acb3-2d10151bf958 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:27.403882 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eebf79-2a10-475c-acb3-2d10151bf958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:27.404171 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eebf79-2a10-475c-acb3-2d10151bf958 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:27.405042 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eebf79-2a10-475c-acb3-2d10151bf958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:27.407286 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eebf79-2a10-475c-acb3-2d10151bf958 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:27.416932 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685dee6-1452-4eb9-ab63-f53d2635e080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f8da83fdba4d7c915ebcfaff794d45, user_id=3a5b8c3eb9194f8b92aecb533f6edfef, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:27.423141 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 815/1637] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:27.424158 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685dee6-1452-4eb9-ab63-f53d2635e080 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:27.424586 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eebf79-2a10-475c-acb3-2d10151bf958 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:27.439362 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eebf79-2a10-475c-acb3-2d10151bf958 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:27.447034 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847ee48-f990-40b8-9701-b60ea1897682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:27.448405 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847ee48-f990-40b8-9701-b60ea1897682 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:27.448867 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847ee48-f990-40b8-9701-b60ea1897682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:27.449155 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847ee48-f990-40b8-9701-b60ea1897682 admin admin] PATH_INFO: `/v3/projects/61361c86dc5348abb4755c5785b4bf8f/users/3093cb5edb944d3489029b560169b28b/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:27.452116 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 823/1638] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:27 2022] PUT /identity/v3/projects/87f8da83fdba4d7c915ebcfaff794d45/users/3a5b8c3eb9194f8b92aecb533f6edfef/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:27.453363 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685dee6-1452-4eb9-ab63-f53d2635e080 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:27.458742 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-4685dee6-1452-4eb9-ab63-f53d2635e080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:27.467125 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847ee48-f990-40b8-9701-b60ea1897682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61361c86dc5348abb4755c5785b4bf8f, user_id=3093cb5edb944d3489029b560169b28b, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:27.470393 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847ee48-f990-40b8-9701-b60ea1897682 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:27.490369 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 816/1639] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:27 2022] PUT /identity/v3/projects/61361c86dc5348abb4755c5785b4bf8f/users/3093cb5edb944d3489029b560169b28b/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:27.491613 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847ee48-f990-40b8-9701-b60ea1897682 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:27.524888 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685dee6-1452-4eb9-ab63-f53d2635e080 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:27.582672 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847ee48-f990-40b8-9701-b60ea1897682 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:27.588538 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490ff0e-7e6a-44f9-9be3-bf99538b6cd1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd367d4b48c634351a427f2f1b468d4ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:27.589661 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f08d1c-ea60-4cae-ab56-5b61cfd3e3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:27.590392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490ff0e-7e6a-44f9-9be3-bf99538b6cd1 service glance] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:27.590608 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f08d1c-ea60-4cae-ab56-5b61cfd3e3ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:27.590847 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f08d1c-ea60-4cae-ab56-5b61cfd3e3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:27.591274 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f08d1c-ea60-4cae-ab56-5b61cfd3e3ed admin admin] PATH_INFO: `/v3/projects/fee7b0f91c59456180625364ad763114/users/f259c487e9b04b7794c73735f1097d6e/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:27.591517 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490ff0e-7e6a-44f9-9be3-bf99538b6cd1 service glance] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:27.592057 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490ff0e-7e6a-44f9-9be3-bf99538b6cd1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:27.594858 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f08d1c-ea60-4cae-ab56-5b61cfd3e3ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee7b0f91c59456180625364ad763114, user_id=f259c487e9b04b7794c73735f1097d6e, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:27.599118 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f08d1c-ea60-4cae-ab56-5b61cfd3e3ed admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:27.613691 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 817/1640] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:27 2022] PUT /identity/v3/projects/fee7b0f91c59456180625364ad763114/users/f259c487e9b04b7794c73735f1097d6e/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:27.614918 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f08d1c-ea60-4cae-ab56-5b61cfd3e3ed admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:27.707940 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490ff0e-7e6a-44f9-9be3-bf99538b6cd1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:27.708751 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f08d1c-ea60-4cae-ab56-5b61cfd3e3ed admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:27.711880 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490ff0e-7e6a-44f9-9be3-bf99538b6cd1 service glance] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:27.716130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbfe35-9dc0-478b-97a0-2ad7b4c0c6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:27.717073 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbfe35-9dc0-478b-97a0-2ad7b4c0c6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:27.717529 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbfe35-9dc0-478b-97a0-2ad7b4c0c6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:27.717971 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbfe35-9dc0-478b-97a0-2ad7b4c0c6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:27.718875 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbfe35-9dc0-478b-97a0-2ad7b4c0c6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:27.720690 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbfe35-9dc0-478b-97a0-2ad7b4c0c6b5 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:27.728868 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 824/1641] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:27.730096 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490ff0e-7e6a-44f9-9be3-bf99538b6cd1 service glance] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:27.733136 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 818/1642] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:27.735484 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8dce3-33a9-46d7-8daf-45dead82770a None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:27.736131 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8dce3-33a9-46d7-8daf-45dead82770a None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:27.736800 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8dce3-33a9-46d7-8daf-45dead82770a None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:27.739017 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 819/1643] 10.222.0.77 () {54 vars in 912 bytes} [Thu Feb 10 23:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:15:27.740448 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3376e9b-1dd3-4a93-b188-6bc68dbaf177 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:27.740928 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3376e9b-1dd3-4a93-b188-6bc68dbaf177 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:27.741420 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3376e9b-1dd3-4a93-b188-6bc68dbaf177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:27.745137 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490ff0e-7e6a-44f9-9be3-bf99538b6cd1 service glance] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:27.752594 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae13693-cc9c-472e-a47d-a66072ad4a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:27.753403 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae13693-cc9c-472e-a47d-a66072ad4a15 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:27.753831 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae13693-cc9c-472e-a47d-a66072ad4a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:27.754206 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae13693-cc9c-472e-a47d-a66072ad4a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:27.755117 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae13693-cc9c-472e-a47d-a66072ad4a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:27.757357 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae13693-cc9c-472e-a47d-a66072ad4a15 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:27.786744 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 825/1644] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:27.788872 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae13693-cc9c-472e-a47d-a66072ad4a15 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:27.793146 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-c3376e9b-1dd3-4a93-b188-6bc68dbaf177 None None] MFA Rules not processed for user `f259c487e9b04b7794c73735f1097d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:27.794437 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-c3376e9b-1dd3-4a93-b188-6bc68dbaf177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:27.802950 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae13693-cc9c-472e-a47d-a66072ad4a15 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:27.816023 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f24db1-9ed8-453b-b754-5c36a206c0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:27.817315 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f24db1-9ed8-453b-b754-5c36a206c0d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:27.817975 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f24db1-9ed8-453b-b754-5c36a206c0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:27.818574 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f24db1-9ed8-453b-b754-5c36a206c0d1 admin admin] PATH_INFO: `/v3/projects/87f8da83fdba4d7c915ebcfaff794d45/users/3a5b8c3eb9194f8b92aecb533f6edfef/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:27.824892 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f24db1-9ed8-453b-b754-5c36a206c0d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f8da83fdba4d7c915ebcfaff794d45, user_id=3a5b8c3eb9194f8b92aecb533f6edfef, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:27.827677 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f24db1-9ed8-453b-b754-5c36a206c0d1 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:27.856726 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 826/1645] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:27 2022] PUT /identity/v3/projects/87f8da83fdba4d7c915ebcfaff794d45/users/3a5b8c3eb9194f8b92aecb533f6edfef/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:27.856726 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9660e61-047f-4937-9c38-dbc7e41207b1 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:27.856726 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9660e61-047f-4937-9c38-dbc7e41207b1 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:27.856726 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9660e61-047f-4937-9c38-dbc7e41207b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:27.886969 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-a9660e61-047f-4937-9c38-dbc7e41207b1 None None] MFA Rules not processed for user `551da2c9fab74cb8b14287a5634adb25`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:27.892625 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 820/1646] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:27 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:27.892625 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3376e9b-1dd3-4a93-b188-6bc68dbaf177 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:27.892848 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a9660e61-047f-4937-9c38-dbc7e41207b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:27.904500 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3376e9b-1dd3-4a93-b188-6bc68dbaf177 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:27.969963 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d341725-89f5-47a2-907a-8a179052d08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:27.970780 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d341725-89f5-47a2-907a-8a179052d08f admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:27.971066 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d341725-89f5-47a2-907a-8a179052d08f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:27.971349 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d341725-89f5-47a2-907a-8a179052d08f admin admin] PATH_INFO: `/v3/projects/61361c86dc5348abb4755c5785b4bf8f/users/3093cb5edb944d3489029b560169b28b/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:27.973746 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d341725-89f5-47a2-907a-8a179052d08f admin admin] RBAC: Authorizing `identity:create_grant(project_id=61361c86dc5348abb4755c5785b4bf8f, user_id=3093cb5edb944d3489029b560169b28b, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:27.976557 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d341725-89f5-47a2-907a-8a179052d08f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:27.982830 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 827/1647] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Feb 10 23:15:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:27.984948 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf1325-bbf2-443e-a4a0-af3da3932114 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:27.985248 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf1325-bbf2-443e-a4a0-af3da3932114 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:27.985618 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf1325-bbf2-443e-a4a0-af3da3932114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:27.998520 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 821/1648] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:27 2022] PUT /identity/v3/projects/61361c86dc5348abb4755c5785b4bf8f/users/3093cb5edb944d3489029b560169b28b/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:27.999663 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d341725-89f5-47a2-907a-8a179052d08f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:28.020540 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-20bf1325-bbf2-443e-a4a0-af3da3932114 None None] MFA Rules not processed for user `3a5b8c3eb9194f8b92aecb533f6edfef`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:28.023332 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-20bf1325-bbf2-443e-a4a0-af3da3932114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:28.068907 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d341725-89f5-47a2-907a-8a179052d08f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:28.073750 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1dc3d-e3be-4260-8057-d9948aef4823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:28.074419 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1dc3d-e3be-4260-8057-d9948aef4823 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:28.074704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1dc3d-e3be-4260-8057-d9948aef4823 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:28.074983 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1dc3d-e3be-4260-8057-d9948aef4823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:28.131398 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 828/1649] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:28.136423 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf1325-bbf2-443e-a4a0-af3da3932114 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:28.149829 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf1325-bbf2-443e-a4a0-af3da3932114 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:28.158028 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7df13-c7ca-49a0-a550-41ec4b8f0474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:28.158225 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1dc3d-e3be-4260-8057-d9948aef4823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:28.158702 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7df13-c7ca-49a0-a550-41ec4b8f0474 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:28.158989 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7df13-c7ca-49a0-a550-41ec4b8f0474 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:28.159368 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7df13-c7ca-49a0-a550-41ec4b8f0474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:28.159888 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1dc3d-e3be-4260-8057-d9948aef4823 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:28.172398 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 822/1650] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:27 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:28.174029 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298a944-5a83-47db-8cb7-89cd4c34cc32 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:28.174326 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298a944-5a83-47db-8cb7-89cd4c34cc32 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:28.174606 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298a944-5a83-47db-8cb7-89cd4c34cc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:28.245121 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-d298a944-5a83-47db-8cb7-89cd4c34cc32 None None] MFA Rules not processed for user `3093cb5edb944d3489029b560169b28b`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:28.246502 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-d298a944-5a83-47db-8cb7-89cd4c34cc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:28.297316 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7df13-c7ca-49a0-a550-41ec4b8f0474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:28.299220 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7df13-c7ca-49a0-a550-41ec4b8f0474 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:28.325347 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 829/1651] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:28.327029 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7df13-c7ca-49a0-a550-41ec4b8f0474 service cinder] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:28.345980 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7df13-c7ca-49a0-a550-41ec4b8f0474 service cinder] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:28.372921 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55108d32-59db-46a7-a952-dbdd4f93a681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:28.373395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55108d32-59db-46a7-a952-dbdd4f93a681 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:28.373686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55108d32-59db-46a7-a952-dbdd4f93a681 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:28.380590 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55108d32-59db-46a7-a952-dbdd4f93a681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:28.424743 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 823/1652] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:28.431401 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55108d32-59db-46a7-a952-dbdd4f93a681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:28.432934 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55108d32-59db-46a7-a952-dbdd4f93a681 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:28.451003 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 830/1653] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:28.472030 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793e01b-f75e-4567-bc24-f1ccdc883b3e None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:28.472331 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793e01b-f75e-4567-bc24-f1ccdc883b3e None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:28.472626 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793e01b-f75e-4567-bc24-f1ccdc883b3e None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:28.475249 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 824/1654] 10.222.0.77 () {54 vars in 912 bytes} [Thu Feb 10 23:15:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:15:28.493474 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4d794-163b-402c-a28c-e76f85fe3fdc None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:28.493758 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4d794-163b-402c-a28c-e76f85fe3fdc None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:28.494043 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4d794-163b-402c-a28c-e76f85fe3fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:28.531925 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-43c4d794-163b-402c-a28c-e76f85fe3fdc None None] MFA Rules not processed for user `0d2af52f48dc435ca9a48cc0a32c31e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:28.533283 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-43c4d794-163b-402c-a28c-e76f85fe3fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:28.601259 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793e01b-f75e-4567-bc24-f1ccdc883b3e None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:28.623230 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793e01b-f75e-4567-bc24-f1ccdc883b3e None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:28.627032 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e1c40-fa81-4e3c-b692-1c64551efcc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:28.627880 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e1c40-fa81-4e3c-b692-1c64551efcc4 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:28.628005 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e1c40-fa81-4e3c-b692-1c64551efcc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:28.628318 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e1c40-fa81-4e3c-b692-1c64551efcc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:28.639177 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 831/1655] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Feb 10 23:15:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:28.652348 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e1c40-fa81-4e3c-b692-1c64551efcc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:28.653825 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e1c40-fa81-4e3c-b692-1c64551efcc4 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:28.675522 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 825/1656] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:28.705085 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4d794-163b-402c-a28c-e76f85fe3fdc None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:28.715012 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4d794-163b-402c-a28c-e76f85fe3fdc None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:28.725812 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6f04a-e5dc-4509-975b-7a76048fb261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:28.726467 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6f04a-e5dc-4509-975b-7a76048fb261 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:28.726753 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6f04a-e5dc-4509-975b-7a76048fb261 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:28.727240 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6f04a-e5dc-4509-975b-7a76048fb261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:28.744034 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6f04a-e5dc-4509-975b-7a76048fb261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:28.746162 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6f04a-e5dc-4509-975b-7a76048fb261 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:28.768195 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 832/1657] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:28.814463 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e1c40-fa81-4e3c-b692-1c64551efcc4 service cinder] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:28.824428 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e1c40-fa81-4e3c-b692-1c64551efcc4 service cinder] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:28.838827 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e003775-8250-4850-ad73-0dd08e1d9746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:28.839485 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e003775-8250-4850-ad73-0dd08e1d9746 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:28.839771 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e003775-8250-4850-ad73-0dd08e1d9746 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:28.840069 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e003775-8250-4850-ad73-0dd08e1d9746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:28.952494 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e003775-8250-4850-ad73-0dd08e1d9746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:28.955129 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e003775-8250-4850-ad73-0dd08e1d9746 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:28.978463 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 826/1658] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:28 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:29.609209 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6f04a-e5dc-4509-975b-7a76048fb261 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:29.624474 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6f04a-e5dc-4509-975b-7a76048fb261 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:29.635406 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba045f-2733-4dce-a09c-ef8166991414 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:29.636397 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba045f-2733-4dce-a09c-ef8166991414 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:29.636694 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba045f-2733-4dce-a09c-ef8166991414 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:29.636975 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba045f-2733-4dce-a09c-ef8166991414 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:29.731965 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e64dae-c739-4558-ba1c-fd0c206f5209 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:29.733047 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e64dae-c739-4558-ba1c-fd0c206f5209 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:29.733495 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e64dae-c739-4558-ba1c-fd0c206f5209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:29.784974 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba045f-2733-4dce-a09c-ef8166991414 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:29.786354 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba045f-2733-4dce-a09c-ef8166991414 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:29.794885 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-d4e64dae-c739-4558-ba1c-fd0c206f5209 None None] MFA Rules not processed for user `bf4571d4a93246429874fb6bced95c85`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:29.796494 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-d4e64dae-c739-4558-ba1c-fd0c206f5209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:29.821256 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 833/1659] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:29.987097 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 827/1660] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:15:29.998511 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49808fee-35c5-4f03-8262-8381f8dbb08e None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:29.999023 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49808fee-35c5-4f03-8262-8381f8dbb08e None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:29.999546 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49808fee-35c5-4f03-8262-8381f8dbb08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:30.034497 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-49808fee-35c5-4f03-8262-8381f8dbb08e None None] MFA Rules not processed for user `bf4571d4a93246429874fb6bced95c85`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:30.037128 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-49808fee-35c5-4f03-8262-8381f8dbb08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:30.055904 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 834/1661] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:30.165307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e64dae-c739-4558-ba1c-fd0c206f5209 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:30.184984 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e64dae-c739-4558-ba1c-fd0c206f5209 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:30.205435 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49808fee-35c5-4f03-8262-8381f8dbb08e None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:30.214125 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d99d96-3c40-40bf-8452-eb5fcb87b822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:30.214843 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d99d96-3c40-40bf-8452-eb5fcb87b822 service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:30.215127 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d99d96-3c40-40bf-8452-eb5fcb87b822 service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:30.215403 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d99d96-3c40-40bf-8452-eb5fcb87b822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:30.252298 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d99d96-3c40-40bf-8452-eb5fcb87b822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:30.256535 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d99d96-3c40-40bf-8452-eb5fcb87b822 service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:30.312340 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 828/1662] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:30.330017 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d99d96-3c40-40bf-8452-eb5fcb87b822 service nova] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:30.342504 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d99d96-3c40-40bf-8452-eb5fcb87b822 service nova] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:30.358210 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495124af-613c-413a-8489-1bbe30d4d978 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3093cb5edb944d3489029b560169b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61361c86dc5348abb4755c5785b4bf8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:30.358904 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495124af-613c-413a-8489-1bbe30d4d978 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:30.361362 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495124af-613c-413a-8489-1bbe30d4d978 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:30.361671 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495124af-613c-413a-8489-1bbe30d4d978 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:30.362444 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495124af-613c-413a-8489-1bbe30d4d978 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:15:30.372969 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495124af-613c-413a-8489-1bbe30d4d978 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:30.377300 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495124af-613c-413a-8489-1bbe30d4d978 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:30.416192 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 829/1663] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:15:30.418324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495124af-613c-413a-8489-1bbe30d4d978 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:30.441377 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495124af-613c-413a-8489-1bbe30d4d978 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:30.460039 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121d9cf-b5d5-4b94-a470-182699349323 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3093cb5edb944d3489029b560169b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61361c86dc5348abb4755c5785b4bf8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:30.460838 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121d9cf-b5d5-4b94-a470-182699349323 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:30.461402 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121d9cf-b5d5-4b94-a470-182699349323 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:30.461721 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121d9cf-b5d5-4b94-a470-182699349323 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:30.462701 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121d9cf-b5d5-4b94-a470-182699349323 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:30.468611 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121d9cf-b5d5-4b94-a470-182699349323 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:30.480580 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49808fee-35c5-4f03-8262-8381f8dbb08e None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:30.493943 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1661fe-5cbb-4812-9030-e61590b6754a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f5243eef2a24a518b30526425c0b2c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:30.494839 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1661fe-5cbb-4812-9030-e61590b6754a service placement] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:30.495404 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1661fe-5cbb-4812-9030-e61590b6754a service placement] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:30.495404 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1661fe-5cbb-4812-9030-e61590b6754a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:30.500968 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-ce1661fe-5cbb-4812-9030-e61590b6754a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:30.550756 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1661fe-5cbb-4812-9030-e61590b6754a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:30.553472 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1661fe-5cbb-4812-9030-e61590b6754a service placement] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:30.563529 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 830/1664] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:30 2022] POST /identity/v3/projects => generated 352 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:30.564803 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121d9cf-b5d5-4b94-a470-182699349323 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:30.588903 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 835/1665] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:15:30.744166 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121d9cf-b5d5-4b94-a470-182699349323 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:30.753407 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058a039-7e05-4d35-a715-40d24c84d85c tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3093cb5edb944d3489029b560169b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61361c86dc5348abb4755c5785b4bf8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:30.754270 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058a039-7e05-4d35-a715-40d24c84d85c tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:30.754670 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058a039-7e05-4d35-a715-40d24c84d85c tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:30.756386 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058a039-7e05-4d35-a715-40d24c84d85c tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:30.757425 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058a039-7e05-4d35-a715-40d24c84d85c tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:15:30.758155 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058a039-7e05-4d35-a715-40d24c84d85c tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:30.761111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058a039-7e05-4d35-a715-40d24c84d85c tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:30.792550 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 831/1666] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:15:30.865570 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1661fe-5cbb-4812-9030-e61590b6754a service placement] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:30.886915 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1661fe-5cbb-4812-9030-e61590b6754a service placement] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:30.898264 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0815c-cd01-4f0c-a3bc-d0eb9995a5e0 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3093cb5edb944d3489029b560169b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61361c86dc5348abb4755c5785b4bf8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:30.900333 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0815c-cd01-4f0c-a3bc-d0eb9995a5e0 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:30.901018 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0815c-cd01-4f0c-a3bc-d0eb9995a5e0 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:30.901531 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0815c-cd01-4f0c-a3bc-d0eb9995a5e0 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] PATH_INFO: `/v3/projects/131312d6db064180930b58eb88a57739` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:30.904303 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0815c-cd01-4f0c-a3bc-d0eb9995a5e0 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] RBAC: Authorizing `identity:delete_project(project_id=131312d6db064180930b58eb88a57739)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:30.928665 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0815c-cd01-4f0c-a3bc-d0eb9995a5e0 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:31.060881 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7df0815c-cd01-4f0c-a3bc-d0eb9995a5e0 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '131312d6db064180930b58eb88a57739', 'request_id': 'req-7df0815c-cd01-4f0c-a3bc-d0eb9995a5e0'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:31.080193 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7df0815c-cd01-4f0c-a3bc-d0eb9995a5e0 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '131312d6db064180930b58eb88a57739', 'request_id': 'req-7df0815c-cd01-4f0c-a3bc-d0eb9995a5e0'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:31.090900 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7df0815c-cd01-4f0c-a3bc-d0eb9995a5e0 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '131312d6db064180930b58eb88a57739', 'request_id': 'req-7df0815c-cd01-4f0c-a3bc-d0eb9995a5e0'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:31.121543 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7df0815c-cd01-4f0c-a3bc-d0eb9995a5e0 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] The token cache is being invalidate because project 131312d6db064180930b58eb88a57739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:15:31.122286 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7df0815c-cd01-4f0c-a3bc-d0eb9995a5e0 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:31.124655 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7df0815c-cd01-4f0c-a3bc-d0eb9995a5e0 tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:31.128742 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 836/1667] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:15:30 2022] DELETE /identity/v3/projects/131312d6db064180930b58eb88a57739 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:15:31.682289 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058a039-7e05-4d35-a715-40d24c84d85c tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:31.690748 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-d058a039-7e05-4d35-a715-40d24c84d85c tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:31.971351 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058a039-7e05-4d35-a715-40d24c84d85c tempest-VolumeQuotaClassesTest-430519487 tempest-VolumeQuotaClassesTest-430519487-project-admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:32.019595 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c07bd5-86d7-434e-b35a-b3b969991beb None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:32.020166 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c07bd5-86d7-434e-b35a-b3b969991beb None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:32.020508 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c07bd5-86d7-434e-b35a-b3b969991beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:32.059847 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-19c07bd5-86d7-434e-b35a-b3b969991beb None None] MFA Rules not processed for user `04d26b3aaeac4e6095755df3d9e34737`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:32.061783 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-19c07bd5-86d7-434e-b35a-b3b969991beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:32.256943 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c65ce-7ed4-4d32-9303-621a4e0a59ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:32.264258 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c65ce-7ed4-4d32-9303-621a4e0a59ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:32.264972 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c65ce-7ed4-4d32-9303-621a4e0a59ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:32.266755 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c65ce-7ed4-4d32-9303-621a4e0a59ec admin admin] PATH_INFO: `/v3/users/0f817d94cd1f404da4c0576f9207c600` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:32.272188 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c65ce-7ed4-4d32-9303-621a4e0a59ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f817d94cd1f404da4c0576f9207c600)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:32.293518 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c65ce-7ed4-4d32-9303-621a4e0a59ec admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:32.330365 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 837/1668] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:15:32.334875 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971236e-c739-4f90-b2f8-64c1d7af7e16 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:32.336794 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971236e-c739-4f90-b2f8-64c1d7af7e16 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:32.337112 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971236e-c739-4f90-b2f8-64c1d7af7e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:32.417879 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-1971236e-c739-4f90-b2f8-64c1d7af7e16 None None] MFA Rules not processed for user `04d26b3aaeac4e6095755df3d9e34737`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:32.420460 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-1971236e-c739-4f90-b2f8-64c1d7af7e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:32.453570 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 838/1669] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:32.467808 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-740c65ce-7ed4-4d32-9303-621a4e0a59ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f817d94cd1f404da4c0576f9207c600'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:32.468760 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971236e-c739-4f90-b2f8-64c1d7af7e16 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:32.471633 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-1971236e-c739-4f90-b2f8-64c1d7af7e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:32.528260 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-740c65ce-7ed4-4d32-9303-621a4e0a59ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f817d94cd1f404da4c0576f9207c600'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:32.530023 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-740c65ce-7ed4-4d32-9303-621a4e0a59ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f817d94cd1f404da4c0576f9207c600'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:32.533209 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-740c65ce-7ed4-4d32-9303-621a4e0a59ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f817d94cd1f404da4c0576f9207c600'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:32.552404 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-740c65ce-7ed4-4d32-9303-621a4e0a59ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f817d94cd1f404da4c0576f9207c600'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:32.600669 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 832/1670] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:15:31 2022] DELETE /identity/v3/users/0f817d94cd1f404da4c0576f9207c600 => generated 0 bytes in 919 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:32.606962 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793ada0-6086-440c-a459-163684ef2d20 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:32.607391 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793ada0-6086-440c-a459-163684ef2d20 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:32.607794 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793ada0-6086-440c-a459-163684ef2d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:32.685831 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-6793ada0-6086-440c-a459-163684ef2d20 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:32.695308 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-6793ada0-6086-440c-a459-163684ef2d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:32.821125 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971236e-c739-4f90-b2f8-64c1d7af7e16 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:32.908774 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 833/1671] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:33.009178 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793ada0-6086-440c-a459-163684ef2d20 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:33.011865 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-6793ada0-6086-440c-a459-163684ef2d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:33.059251 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aea5bb-d739-48d8-bc64-9fd47dea3404 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:33.060741 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aea5bb-d739-48d8-bc64-9fd47dea3404 service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:33.061592 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aea5bb-d739-48d8-bc64-9fd47dea3404 service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:33.061881 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aea5bb-d739-48d8-bc64-9fd47dea3404 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:33.068357 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e2aea5bb-d739-48d8-bc64-9fd47dea3404 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:33.274339 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793ada0-6086-440c-a459-163684ef2d20 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:33.285010 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aea5bb-d739-48d8-bc64-9fd47dea3404 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:33.288752 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aea5bb-d739-48d8-bc64-9fd47dea3404 service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:33.300201 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06bd4d-ab68-43ea-9f73-32b7f927d10d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:33.300863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06bd4d-ab68-43ea-9f73-32b7f927d10d service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:33.301342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06bd4d-ab68-43ea-9f73-32b7f927d10d service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:33.301784 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06bd4d-ab68-43ea-9f73-32b7f927d10d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:33.323965 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 839/1672] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 856 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:33.342787 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06bd4d-ab68-43ea-9f73-32b7f927d10d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:33.352374 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06bd4d-ab68-43ea-9f73-32b7f927d10d service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:33.437152 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 834/1673] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:33.512325 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aea5bb-d739-48d8-bc64-9fd47dea3404 service nova] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:33.513930 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e2aea5bb-d739-48d8-bc64-9fd47dea3404 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:33.551677 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aea5bb-d739-48d8-bc64-9fd47dea3404 service nova] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:33.574380 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bcc63-cd92-4fa4-a0b6-4154e7643dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:33.575281 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bcc63-cd92-4fa4-a0b6-4154e7643dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:33.575566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bcc63-cd92-4fa4-a0b6-4154e7643dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:33.575859 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bcc63-cd92-4fa4-a0b6-4154e7643dfd admin admin] PATH_INFO: `/v3/users/347271993cab43ef86eefef51b16dca5` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:33.582518 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bcc63-cd92-4fa4-a0b6-4154e7643dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=347271993cab43ef86eefef51b16dca5)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:33.583394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: WARNING py.warnings [None req-e04bcc63-cd92-4fa4-a0b6-4154e7643dfd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:15:33.583394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: warnings.warn(msg) Feb 10 23:15:33.583394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: Feb 10 23:15:33.584991 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bcc63-cd92-4fa4-a0b6-4154e7643dfd admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:33.768461 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e04bcc63-cd92-4fa4-a0b6-4154e7643dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '347271993cab43ef86eefef51b16dca5'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:33.803505 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e04bcc63-cd92-4fa4-a0b6-4154e7643dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '347271993cab43ef86eefef51b16dca5'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:33.804513 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e04bcc63-cd92-4fa4-a0b6-4154e7643dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '347271993cab43ef86eefef51b16dca5'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:33.816543 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e04bcc63-cd92-4fa4-a0b6-4154e7643dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '347271993cab43ef86eefef51b16dca5'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:33.819354 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e04bcc63-cd92-4fa4-a0b6-4154e7643dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '347271993cab43ef86eefef51b16dca5'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:33.880889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 840/1674] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:15:33 2022] DELETE /identity/v3/users/347271993cab43ef86eefef51b16dca5 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:33.886441 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468eb2e-69be-4939-824c-6f3c7571aa76 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:33.886729 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468eb2e-69be-4939-824c-6f3c7571aa76 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:33.887008 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468eb2e-69be-4939-824c-6f3c7571aa76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:33.916563 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-3468eb2e-69be-4939-824c-6f3c7571aa76 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:33.918077 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-3468eb2e-69be-4939-824c-6f3c7571aa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:34.026946 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 835/1675] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:34.097691 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bcc63-cd92-4fa4-a0b6-4154e7643dfd admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:34.104793 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e04bcc63-cd92-4fa4-a0b6-4154e7643dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:34.292456 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bcc63-cd92-4fa4-a0b6-4154e7643dfd admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:34.297399 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2cd99-1231-43e2-a83d-16b4e84f4a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:34.298351 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2cd99-1231-43e2-a83d-16b4e84f4a96 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:34.298730 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2cd99-1231-43e2-a83d-16b4e84f4a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:34.299575 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2cd99-1231-43e2-a83d-16b4e84f4a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:34.318174 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2cd99-1231-43e2-a83d-16b4e84f4a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:34.320691 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2cd99-1231-43e2-a83d-16b4e84f4a96 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:34.339229 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 841/1676] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:34.824063 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2049b-748b-4d55-8bb6-ad04c3a21743 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:34.825194 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2049b-748b-4d55-8bb6-ad04c3a21743 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:34.825668 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2049b-748b-4d55-8bb6-ad04c3a21743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:34.835342 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2cd99-1231-43e2-a83d-16b4e84f4a96 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:34.838846 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-8ee2cd99-1231-43e2-a83d-16b4e84f4a96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:34.866591 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2cd99-1231-43e2-a83d-16b4e84f4a96 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:34.878943 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-47b2049b-748b-4d55-8bb6-ad04c3a21743 None None] MFA Rules not processed for user `9dca4ea4f2c8490e823a73dca6c303ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:34.880442 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c234d3-694d-4287-a018-cd384f70e914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:34.884151 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-47b2049b-748b-4d55-8bb6-ad04c3a21743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:34.884672 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c234d3-694d-4287-a018-cd384f70e914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:34.886853 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c234d3-694d-4287-a018-cd384f70e914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:34.887367 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c234d3-694d-4287-a018-cd384f70e914 admin admin] PATH_INFO: `/v3/users/c79ad420f1064032886213df293b789e` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:34.893210 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c234d3-694d-4287-a018-cd384f70e914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c79ad420f1064032886213df293b789e)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:34.904636 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c234d3-694d-4287-a018-cd384f70e914 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:35.023571 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-65c234d3-694d-4287-a018-cd384f70e914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c79ad420f1064032886213df293b789e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:35.057855 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 836/1677] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Feb 10 23:15:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:35.058438 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-65c234d3-694d-4287-a018-cd384f70e914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c79ad420f1064032886213df293b789e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:35.059176 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-65c234d3-694d-4287-a018-cd384f70e914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c79ad420f1064032886213df293b789e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:35.074148 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-65c234d3-694d-4287-a018-cd384f70e914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c79ad420f1064032886213df293b789e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:35.082018 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-65c234d3-694d-4287-a018-cd384f70e914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c79ad420f1064032886213df293b789e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:35.145428 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc3db0-d66f-4107-8597-3f4d7ccb19f5 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:35.146084 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc3db0-d66f-4107-8597-3f4d7ccb19f5 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:35.146825 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc3db0-d66f-4107-8597-3f4d7ccb19f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:35.148435 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 842/1678] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:15:34 2022] DELETE /identity/v3/users/c79ad420f1064032886213df293b789e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:35.183275 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c234d3-694d-4287-a018-cd384f70e914 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:35.185038 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-65c234d3-694d-4287-a018-cd384f70e914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:35.189035 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-01bc3db0-d66f-4107-8597-3f4d7ccb19f5 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:35.193228 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-01bc3db0-d66f-4107-8597-3f4d7ccb19f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:35.328989 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c234d3-694d-4287-a018-cd384f70e914 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:35.342945 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098323f-582c-4f4b-aa59-7c39177b66dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:35.346924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098323f-582c-4f4b-aa59-7c39177b66dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:35.347218 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098323f-582c-4f4b-aa59-7c39177b66dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:35.348480 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098323f-582c-4f4b-aa59-7c39177b66dd admin admin] PATH_INFO: `/v3/projects/40d29f1656b846b189997591a14ec771` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:35.352344 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098323f-582c-4f4b-aa59-7c39177b66dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=40d29f1656b846b189997591a14ec771)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:35.354768 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098323f-582c-4f4b-aa59-7c39177b66dd admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:35.488355 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 837/1679] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:15:35.489963 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954637b-dd5e-44d0-b986-9374823cc16d None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:35.490398 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954637b-dd5e-44d0-b986-9374823cc16d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:35.490826 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954637b-dd5e-44d0-b986-9374823cc16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:35.546490 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-2954637b-dd5e-44d0-b986-9374823cc16d None None] MFA Rules not processed for user `04d26b3aaeac4e6095755df3d9e34737`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:35.552560 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e098323f-582c-4f4b-aa59-7c39177b66dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40d29f1656b846b189997591a14ec771', 'request_id': 'req-e098323f-582c-4f4b-aa59-7c39177b66dd'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:35.556377 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-2954637b-dd5e-44d0-b986-9374823cc16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:35.576221 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e098323f-582c-4f4b-aa59-7c39177b66dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40d29f1656b846b189997591a14ec771', 'request_id': 'req-e098323f-582c-4f4b-aa59-7c39177b66dd'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:35.611438 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e098323f-582c-4f4b-aa59-7c39177b66dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40d29f1656b846b189997591a14ec771', 'request_id': 'req-e098323f-582c-4f4b-aa59-7c39177b66dd'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:35.630614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e098323f-582c-4f4b-aa59-7c39177b66dd admin admin] The token cache is being invalidate because project 40d29f1656b846b189997591a14ec771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:15:35.631048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e098323f-582c-4f4b-aa59-7c39177b66dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:35.632601 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e098323f-582c-4f4b-aa59-7c39177b66dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:35.635664 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 843/1680] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:15:35 2022] DELETE /identity/v3/projects/40d29f1656b846b189997591a14ec771 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:15:35.638006 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098323f-582c-4f4b-aa59-7c39177b66dd admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:35.641464 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e098323f-582c-4f4b-aa59-7c39177b66dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:35.769238 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 838/1681] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:35.770473 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954637b-dd5e-44d0-b986-9374823cc16d None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:35.780685 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-2954637b-dd5e-44d0-b986-9374823cc16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:35.944947 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098323f-582c-4f4b-aa59-7c39177b66dd admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:35.972753 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25266508-8df2-48bc-b3c4-80819ee53782 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce55b64dc528447993e32b00ae4d3a2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:35.975859 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25266508-8df2-48bc-b3c4-80819ee53782 service swift] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:35.976383 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25266508-8df2-48bc-b3c4-80819ee53782 service swift] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:35.978725 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25266508-8df2-48bc-b3c4-80819ee53782 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:35.981692 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-25266508-8df2-48bc-b3c4-80819ee53782 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:36.045102 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954637b-dd5e-44d0-b986-9374823cc16d None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:36.062157 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1740fa6-628e-482f-b593-a2a23da7b4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:36.063192 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1740fa6-628e-482f-b593-a2a23da7b4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:36.063517 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1740fa6-628e-482f-b593-a2a23da7b4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:36.063803 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1740fa6-628e-482f-b593-a2a23da7b4d5 admin admin] PATH_INFO: `/v3/users/3093cb5edb944d3489029b560169b28b` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:36.071068 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1740fa6-628e-482f-b593-a2a23da7b4d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3093cb5edb944d3489029b560169b28b)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:36.092938 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1740fa6-628e-482f-b593-a2a23da7b4d5 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:36.182258 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25266508-8df2-48bc-b3c4-80819ee53782 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:36.185243 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25266508-8df2-48bc-b3c4-80819ee53782 service swift] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:36.198497 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 844/1682] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Feb 10 23:15:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:15:36.201417 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25266508-8df2-48bc-b3c4-80819ee53782 service swift] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:36.205400 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-25266508-8df2-48bc-b3c4-80819ee53782 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:36.292129 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e1740fa6-628e-482f-b593-a2a23da7b4d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3093cb5edb944d3489029b560169b28b'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:36.353280 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e1740fa6-628e-482f-b593-a2a23da7b4d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3093cb5edb944d3489029b560169b28b'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:36.358311 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e1740fa6-628e-482f-b593-a2a23da7b4d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3093cb5edb944d3489029b560169b28b'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:36.360056 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e1740fa6-628e-482f-b593-a2a23da7b4d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3093cb5edb944d3489029b560169b28b'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:36.394513 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e1740fa6-628e-482f-b593-a2a23da7b4d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3093cb5edb944d3489029b560169b28b'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:36.470129 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 839/1683] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:15:35 2022] DELETE /identity/v3/users/3093cb5edb944d3489029b560169b28b => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:36.471725 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1740fa6-628e-482f-b593-a2a23da7b4d5 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:36.489746 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e1740fa6-628e-482f-b593-a2a23da7b4d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:36.586372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25266508-8df2-48bc-b3c4-80819ee53782 service swift] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:36.700955 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1740fa6-628e-482f-b593-a2a23da7b4d5 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:36.720931 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6acd9-5445-41cc-a598-e2bea24aeb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:36.721816 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6acd9-5445-41cc-a598-e2bea24aeb6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:36.722489 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6acd9-5445-41cc-a598-e2bea24aeb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:36.725493 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6acd9-5445-41cc-a598-e2bea24aeb6b admin admin] PATH_INFO: `/v3/projects/814fc0f0284442fe80c9b5e89352a787` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:36.733563 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6acd9-5445-41cc-a598-e2bea24aeb6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=814fc0f0284442fe80c9b5e89352a787)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:36.735665 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: WARNING py.warnings [None req-8da6acd9-5445-41cc-a598-e2bea24aeb6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 23:15:36.735665 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: warnings.warn(msg) Feb 10 23:15:36.735665 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: Feb 10 23:15:36.738436 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6acd9-5445-41cc-a598-e2bea24aeb6b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:36.843226 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9e524-5773-47c0-bca6-ddead41e238d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:36.843226 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9e524-5773-47c0-bca6-ddead41e238d service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:36.843226 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9e524-5773-47c0-bca6-ddead41e238d service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:36.843226 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9e524-5773-47c0-bca6-ddead41e238d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:36.845405 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-6eb9e524-5773-47c0-bca6-ddead41e238d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:36.908011 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9e524-5773-47c0-bca6-ddead41e238d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:36.909698 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9e524-5773-47c0-bca6-ddead41e238d service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:36.957736 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 845/1684] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 758 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:36.959127 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95febd-15db-4f64-8eb8-cd4fd70d188d None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:36.959424 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95febd-15db-4f64-8eb8-cd4fd70d188d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:36.959681 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95febd-15db-4f64-8eb8-cd4fd70d188d None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:36.962174 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 846/1685] 10.222.0.77 () {54 vars in 912 bytes} [Thu Feb 10 23:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:15:36.971481 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-8da6acd9-5445-41cc-a598-e2bea24aeb6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '814fc0f0284442fe80c9b5e89352a787', 'request_id': 'req-8da6acd9-5445-41cc-a598-e2bea24aeb6b'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:36.984748 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0618c89-d061-42b1-b497-e76891eb9192 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:36.987089 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0618c89-d061-42b1-b497-e76891eb9192 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:36.989917 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0618c89-d061-42b1-b497-e76891eb9192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:36.998290 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-8da6acd9-5445-41cc-a598-e2bea24aeb6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '814fc0f0284442fe80c9b5e89352a787', 'request_id': 'req-8da6acd9-5445-41cc-a598-e2bea24aeb6b'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:37.032107 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-8da6acd9-5445-41cc-a598-e2bea24aeb6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '814fc0f0284442fe80c9b5e89352a787', 'request_id': 'req-8da6acd9-5445-41cc-a598-e2bea24aeb6b'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:37.039190 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-c0618c89-d061-42b1-b497-e76891eb9192 None None] MFA Rules not processed for user `0d2af52f48dc435ca9a48cc0a32c31e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:37.041189 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-c0618c89-d061-42b1-b497-e76891eb9192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:37.056957 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-8da6acd9-5445-41cc-a598-e2bea24aeb6b admin admin] The token cache is being invalidate because project 814fc0f0284442fe80c9b5e89352a787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:15:37.057241 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-8da6acd9-5445-41cc-a598-e2bea24aeb6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:37.057894 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-8da6acd9-5445-41cc-a598-e2bea24aeb6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:37.060919 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 840/1686] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:15:36 2022] DELETE /identity/v3/projects/814fc0f0284442fe80c9b5e89352a787 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:37.066957 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76880ae8-1afc-470f-b78a-d525f7640907 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:37.069762 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76880ae8-1afc-470f-b78a-d525f7640907 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:37.071268 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76880ae8-1afc-470f-b78a-d525f7640907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:37.118835 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-76880ae8-1afc-470f-b78a-d525f7640907 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:37.120435 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-76880ae8-1afc-470f-b78a-d525f7640907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:37.154116 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 847/1687] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Feb 10 23:15:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:37.243930 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0618c89-d061-42b1-b497-e76891eb9192 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:37.246639 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-c0618c89-d061-42b1-b497-e76891eb9192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:37.279230 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0618c89-d061-42b1-b497-e76891eb9192 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:37.296338 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b3eac-9e1e-4c98-bfc3-eaa2a037b197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:37.297561 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b3eac-9e1e-4c98-bfc3-eaa2a037b197 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:37.300527 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b3eac-9e1e-4c98-bfc3-eaa2a037b197 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:37.301084 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b3eac-9e1e-4c98-bfc3-eaa2a037b197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:37.302844 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 841/1688] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:15:37.313280 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c75d0e-7303-4bee-9ab0-0f71d31c030a None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:37.313693 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c75d0e-7303-4bee-9ab0-0f71d31c030a None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:37.313991 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c75d0e-7303-4bee-9ab0-0f71d31c030a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:37.328528 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b3eac-9e1e-4c98-bfc3-eaa2a037b197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:37.331789 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b3eac-9e1e-4c98-bfc3-eaa2a037b197 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:37.358321 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 848/1689] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:15:37.383424 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-51c75d0e-7303-4bee-9ab0-0f71d31c030a None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:37.385900 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-51c75d0e-7303-4bee-9ab0-0f71d31c030a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:37.403076 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 842/1690] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:37.407506 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b3eac-9e1e-4c98-bfc3-eaa2a037b197 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:37.425813 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b3eac-9e1e-4c98-bfc3-eaa2a037b197 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:37.433187 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e35e9d-2057-43bf-b0dd-776285521502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:37.434492 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e35e9d-2057-43bf-b0dd-776285521502 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:37.435026 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e35e9d-2057-43bf-b0dd-776285521502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:37.435545 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e35e9d-2057-43bf-b0dd-776285521502 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:37.437247 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e35e9d-2057-43bf-b0dd-776285521502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:15:37.437789 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e35e9d-2057-43bf-b0dd-776285521502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:37.440067 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e35e9d-2057-43bf-b0dd-776285521502 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:37.459580 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 849/1691] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:15:37.464615 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c75d0e-7303-4bee-9ab0-0f71d31c030a None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:37.480508 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c75d0e-7303-4bee-9ab0-0f71d31c030a None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:37.486761 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00661a6-6f95-4404-b40b-abc241c2aa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:37.489525 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00661a6-6f95-4404-b40b-abc241c2aa9b admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:37.490220 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00661a6-6f95-4404-b40b-abc241c2aa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:37.490771 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00661a6-6f95-4404-b40b-abc241c2aa9b admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:37.496410 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00661a6-6f95-4404-b40b-abc241c2aa9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:37.501240 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00661a6-6f95-4404-b40b-abc241c2aa9b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:37.564678 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 843/1692] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:37 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:37.570900 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e35e9d-2057-43bf-b0dd-776285521502 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:37.587734 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e35e9d-2057-43bf-b0dd-776285521502 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:37.848857 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d16251-16e6-4e7d-91e6-68bfa25846b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:37.853186 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d16251-16e6-4e7d-91e6-68bfa25846b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:37.857048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d16251-16e6-4e7d-91e6-68bfa25846b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:37.859131 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d16251-16e6-4e7d-91e6-68bfa25846b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:37.860952 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d16251-16e6-4e7d-91e6-68bfa25846b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:37.871442 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d16251-16e6-4e7d-91e6-68bfa25846b0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:37.953839 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 850/1693] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:37 2022] POST /identity/v3/users => generated 286 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:37.955406 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00661a6-6f95-4404-b40b-abc241c2aa9b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:38.000539 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00661a6-6f95-4404-b40b-abc241c2aa9b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:38.030130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf81d8-500c-4d20-afb7-da46097e72ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:38.031210 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf81d8-500c-4d20-afb7-da46097e72ef admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:38.034814 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf81d8-500c-4d20-afb7-da46097e72ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:38.035376 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf81d8-500c-4d20-afb7-da46097e72ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:38.038082 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf81d8-500c-4d20-afb7-da46097e72ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:38.045596 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf81d8-500c-4d20-afb7-da46097e72ef admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:38.089256 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 844/1694] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:38.093581 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d16251-16e6-4e7d-91e6-68bfa25846b0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:38.114900 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d16251-16e6-4e7d-91e6-68bfa25846b0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:38.133221 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeac6f0-4e07-46ea-a86d-1ff85ff53dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:38.134101 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeac6f0-4e07-46ea-a86d-1ff85ff53dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:38.134485 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeac6f0-4e07-46ea-a86d-1ff85ff53dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:38.134861 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeac6f0-4e07-46ea-a86d-1ff85ff53dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:38.135813 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeac6f0-4e07-46ea-a86d-1ff85ff53dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:38.137615 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeac6f0-4e07-46ea-a86d-1ff85ff53dc0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:38.206515 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 851/1695] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:15:38.209140 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf81d8-500c-4d20-afb7-da46097e72ef admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:38.220927 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf81d8-500c-4d20-afb7-da46097e72ef admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:38.251647 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ceae9f-969b-4382-aa45-f71bc95bf0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:38.252587 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ceae9f-969b-4382-aa45-f71bc95bf0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:38.252870 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ceae9f-969b-4382-aa45-f71bc95bf0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:38.253147 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ceae9f-969b-4382-aa45-f71bc95bf0f7 admin admin] PATH_INFO: `/v3/projects/c0d9b982ac8c4b46af07aca069fe8328/users/5afc223ee14c4085b42620550fbb9876/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:38.259472 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeac6f0-4e07-46ea-a86d-1ff85ff53dc0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:38.261928 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-edeac6f0-4e07-46ea-a86d-1ff85ff53dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:38.300206 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeac6f0-4e07-46ea-a86d-1ff85ff53dc0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:38.306966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ceae9f-969b-4382-aa45-f71bc95bf0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d9b982ac8c4b46af07aca069fe8328, user_id=5afc223ee14c4085b42620550fbb9876, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:38.309752 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ceae9f-969b-4382-aa45-f71bc95bf0f7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:38.325666 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48527fe4-762a-4d26-9d4b-096403b43815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:38.325666 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48527fe4-762a-4d26-9d4b-096403b43815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:38.325666 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48527fe4-762a-4d26-9d4b-096403b43815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:38.325666 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48527fe4-762a-4d26-9d4b-096403b43815 admin admin] PATH_INFO: `/v3/projects/9abf9a2d9786407db88747489fccee75` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:38.330449 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48527fe4-762a-4d26-9d4b-096403b43815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9abf9a2d9786407db88747489fccee75)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:38.342370 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48527fe4-762a-4d26-9d4b-096403b43815 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:38.372821 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 845/1696] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:38 2022] PUT /identity/v3/projects/c0d9b982ac8c4b46af07aca069fe8328/users/5afc223ee14c4085b42620550fbb9876/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:38.386500 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b06b7-e3b0-4f70-8586-a091a03804a3 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:38.386872 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b06b7-e3b0-4f70-8586-a091a03804a3 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:38.388707 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b06b7-e3b0-4f70-8586-a091a03804a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:38.541502 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-b85b06b7-e3b0-4f70-8586-a091a03804a3 None None] MFA Rules not processed for user `5afc223ee14c4085b42620550fbb9876`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:38.548527 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-b85b06b7-e3b0-4f70-8586-a091a03804a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:38.596690 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-48527fe4-762a-4d26-9d4b-096403b43815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9abf9a2d9786407db88747489fccee75', 'request_id': 'req-48527fe4-762a-4d26-9d4b-096403b43815'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:38.621528 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-48527fe4-762a-4d26-9d4b-096403b43815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9abf9a2d9786407db88747489fccee75', 'request_id': 'req-48527fe4-762a-4d26-9d4b-096403b43815'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:38.649821 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-48527fe4-762a-4d26-9d4b-096403b43815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9abf9a2d9786407db88747489fccee75', 'request_id': 'req-48527fe4-762a-4d26-9d4b-096403b43815'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:38.688025 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-48527fe4-762a-4d26-9d4b-096403b43815 admin admin] The token cache is being invalidate because project 9abf9a2d9786407db88747489fccee75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:15:38.688947 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-48527fe4-762a-4d26-9d4b-096403b43815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:38.691653 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-48527fe4-762a-4d26-9d4b-096403b43815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:38.696178 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 852/1697] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:15:38 2022] DELETE /identity/v3/projects/9abf9a2d9786407db88747489fccee75 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:38.700089 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270475b-72a3-4262-bf30-bb37145ead48 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:38.701719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270475b-72a3-4262-bf30-bb37145ead48 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:38.703346 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270475b-72a3-4262-bf30-bb37145ead48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:38.754796 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-2270475b-72a3-4262-bf30-bb37145ead48 None None] MFA Rules not processed for user `0d2af52f48dc435ca9a48cc0a32c31e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:38.758976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2270475b-72a3-4262-bf30-bb37145ead48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:38.842708 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 846/1698] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:38.847571 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b06b7-e3b0-4f70-8586-a091a03804a3 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:38.850413 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-b85b06b7-e3b0-4f70-8586-a091a03804a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:39.009322 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 853/1699] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Feb 10 23:15:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:39.067131 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270475b-72a3-4262-bf30-bb37145ead48 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:39.070180 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2270475b-72a3-4262-bf30-bb37145ead48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:39.097966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270475b-72a3-4262-bf30-bb37145ead48 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:39.112852 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd3124-36b3-4f91-8fa7-e59d43323319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:39.115097 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd3124-36b3-4f91-8fa7-e59d43323319 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:39.115417 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd3124-36b3-4f91-8fa7-e59d43323319 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:39.115698 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd3124-36b3-4f91-8fa7-e59d43323319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:39.136839 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd3124-36b3-4f91-8fa7-e59d43323319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:39.153870 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd3124-36b3-4f91-8fa7-e59d43323319 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:39.182604 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b06b7-e3b0-4f70-8586-a091a03804a3 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:39.184319 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 854/1700] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:39.199094 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0644467-5d41-4246-9c0d-afe5aa21279c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:39.200974 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd3124-36b3-4f91-8fa7-e59d43323319 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:39.213652 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0644467-5d41-4246-9c0d-afe5aa21279c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:39.213980 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0644467-5d41-4246-9c0d-afe5aa21279c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:39.216133 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0644467-5d41-4246-9c0d-afe5aa21279c admin admin] PATH_INFO: `/v3/users/3a5b8c3eb9194f8b92aecb533f6edfef` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:39.220775 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0644467-5d41-4246-9c0d-afe5aa21279c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a5b8c3eb9194f8b92aecb533f6edfef)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:39.227093 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0644467-5d41-4246-9c0d-afe5aa21279c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:39.232848 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd3124-36b3-4f91-8fa7-e59d43323319 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:39.259635 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432db966-bb52-46e8-a4fe-79de51801a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:39.260215 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432db966-bb52-46e8-a4fe-79de51801a05 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:39.260215 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432db966-bb52-46e8-a4fe-79de51801a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:39.260614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432db966-bb52-46e8-a4fe-79de51801a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:39.294873 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432db966-bb52-46e8-a4fe-79de51801a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:39.296355 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432db966-bb52-46e8-a4fe-79de51801a05 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:39.325543 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-d0644467-5d41-4246-9c0d-afe5aa21279c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a5b8c3eb9194f8b92aecb533f6edfef'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:39.340319 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-d0644467-5d41-4246-9c0d-afe5aa21279c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a5b8c3eb9194f8b92aecb533f6edfef'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:39.341376 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-d0644467-5d41-4246-9c0d-afe5aa21279c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a5b8c3eb9194f8b92aecb533f6edfef'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:39.342179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-d0644467-5d41-4246-9c0d-afe5aa21279c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a5b8c3eb9194f8b92aecb533f6edfef'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:39.356729 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 855/1701] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:39.357100 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432db966-bb52-46e8-a4fe-79de51801a05 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:39.360203 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-d0644467-5d41-4246-9c0d-afe5aa21279c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a5b8c3eb9194f8b92aecb533f6edfef'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:39.367743 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-432db966-bb52-46e8-a4fe-79de51801a05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:39.389872 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 847/1702] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:15:38 2022] DELETE /identity/v3/users/3a5b8c3eb9194f8b92aecb533f6edfef => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:39.417942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432db966-bb52-46e8-a4fe-79de51801a05 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:39.446506 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0644467-5d41-4246-9c0d-afe5aa21279c admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:39.448963 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-d0644467-5d41-4246-9c0d-afe5aa21279c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:39.680841 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dfe76-ab0a-4dc2-a03e-0f3d1f3b672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:39.686150 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dfe76-ab0a-4dc2-a03e-0f3d1f3b672b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:39.687887 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dfe76-ab0a-4dc2-a03e-0f3d1f3b672b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:39.688217 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dfe76-ab0a-4dc2-a03e-0f3d1f3b672b admin admin] PATH_INFO: `/v3/projects/61361c86dc5348abb4755c5785b4bf8f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:39.693559 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752dfe76-ab0a-4dc2-a03e-0f3d1f3b672b admin admin] RBAC: Authorizing `identity:delete_project(project_id=61361c86dc5348abb4755c5785b4bf8f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:39.694596 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752dfe76-ab0a-4dc2-a03e-0f3d1f3b672b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:39.800111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0644467-5d41-4246-9c0d-afe5aa21279c admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:39.829253 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9a1b2-766e-422f-9482-8b76c002b7e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:39.830463 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9a1b2-766e-422f-9482-8b76c002b7e2 service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:39.830463 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9a1b2-766e-422f-9482-8b76c002b7e2 service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:39.830769 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9a1b2-766e-422f-9482-8b76c002b7e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:39.844543 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-03f9a1b2-766e-422f-9482-8b76c002b7e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:39.969762 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-752dfe76-ab0a-4dc2-a03e-0f3d1f3b672b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61361c86dc5348abb4755c5785b4bf8f', 'request_id': 'req-752dfe76-ab0a-4dc2-a03e-0f3d1f3b672b'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:39.993607 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-752dfe76-ab0a-4dc2-a03e-0f3d1f3b672b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61361c86dc5348abb4755c5785b4bf8f', 'request_id': 'req-752dfe76-ab0a-4dc2-a03e-0f3d1f3b672b'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:40.018726 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-752dfe76-ab0a-4dc2-a03e-0f3d1f3b672b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61361c86dc5348abb4755c5785b4bf8f', 'request_id': 'req-752dfe76-ab0a-4dc2-a03e-0f3d1f3b672b'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:40.060896 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-752dfe76-ab0a-4dc2-a03e-0f3d1f3b672b admin admin] The token cache is being invalidate because project 61361c86dc5348abb4755c5785b4bf8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:15:40.061197 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-752dfe76-ab0a-4dc2-a03e-0f3d1f3b672b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:40.062972 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-752dfe76-ab0a-4dc2-a03e-0f3d1f3b672b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:40.074455 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 856/1703] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:15:39 2022] DELETE /identity/v3/projects/61361c86dc5348abb4755c5785b4bf8f => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:40.089976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832a86f-b882-40b2-bc70-30846c1c8c69 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:40.090897 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832a86f-b882-40b2-bc70-30846c1c8c69 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:40.092600 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832a86f-b882-40b2-bc70-30846c1c8c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:40.142487 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-9832a86f-b882-40b2-bc70-30846c1c8c69 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:40.144068 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-9832a86f-b882-40b2-bc70-30846c1c8c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:40.154414 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9a1b2-766e-422f-9482-8b76c002b7e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:40.159260 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9a1b2-766e-422f-9482-8b76c002b7e2 service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:40.216095 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 848/1704] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 769 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:40.259700 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 857/1705] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:40.267312 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394bf67-f21b-44ef-a094-90b1d6b88341 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:40.267616 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394bf67-f21b-44ef-a094-90b1d6b88341 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:40.267891 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394bf67-f21b-44ef-a094-90b1d6b88341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:40.326298 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-1394bf67-f21b-44ef-a094-90b1d6b88341 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:40.327731 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-1394bf67-f21b-44ef-a094-90b1d6b88341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:40.361748 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832a86f-b882-40b2-bc70-30846c1c8c69 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:40.364071 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 849/1706] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:40.395097 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832a86f-b882-40b2-bc70-30846c1c8c69 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:40.407920 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff9bb1-0d35-4908-926f-e00eceea77fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:40.411928 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff9bb1-0d35-4908-926f-e00eceea77fe admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:40.412225 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff9bb1-0d35-4908-926f-e00eceea77fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:40.412508 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff9bb1-0d35-4908-926f-e00eceea77fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:40.413308 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff9bb1-0d35-4908-926f-e00eceea77fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:15:40.413683 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff9bb1-0d35-4908-926f-e00eceea77fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:40.418148 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff9bb1-0d35-4908-926f-e00eceea77fe admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:40.483090 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394bf67-f21b-44ef-a094-90b1d6b88341 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:40.485102 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 858/1707] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:15:40.497992 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394bf67-f21b-44ef-a094-90b1d6b88341 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:40.509674 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeab384-7c10-47e0-a000-54dc0a1f68ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:40.510357 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeab384-7c10-47e0-a000-54dc0a1f68ea admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:40.510646 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeab384-7c10-47e0-a000-54dc0a1f68ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:40.510920 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeab384-7c10-47e0-a000-54dc0a1f68ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:40.512182 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeab384-7c10-47e0-a000-54dc0a1f68ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:40.513596 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeab384-7c10-47e0-a000-54dc0a1f68ea admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:40.618834 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 850/1708] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:40 2022] POST /identity/v3/projects => generated 407 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:40.623155 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff9bb1-0d35-4908-926f-e00eceea77fe admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:40.650653 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff9bb1-0d35-4908-926f-e00eceea77fe admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:40.881819 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598df9c-1917-4f4e-824c-1efc670fe653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:40.882603 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598df9c-1917-4f4e-824c-1efc670fe653 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:40.883458 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598df9c-1917-4f4e-824c-1efc670fe653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:40.883741 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598df9c-1917-4f4e-824c-1efc670fe653 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:40.884496 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598df9c-1917-4f4e-824c-1efc670fe653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:40.886500 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598df9c-1917-4f4e-824c-1efc670fe653 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:40.965185 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 859/1709] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:40 2022] POST /identity/v3/users => generated 304 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:40.966579 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeab384-7c10-47e0-a000-54dc0a1f68ea admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:40.985987 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeab384-7c10-47e0-a000-54dc0a1f68ea admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:41.015399 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7749b2-50f2-4e1e-9815-1000824e44a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:41.016395 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7749b2-50f2-4e1e-9815-1000824e44a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:41.016695 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7749b2-50f2-4e1e-9815-1000824e44a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:41.016975 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7749b2-50f2-4e1e-9815-1000824e44a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:41.017731 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7749b2-50f2-4e1e-9815-1000824e44a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:41.033565 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7749b2-50f2-4e1e-9815-1000824e44a3 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:41.074797 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598df9c-1917-4f4e-824c-1efc670fe653 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:41.076203 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 851/1710] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:41.109496 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598df9c-1917-4f4e-824c-1efc670fe653 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:41.127942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a82558-1a39-482e-90e9-94d0e1e4a659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:41.133199 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a82558-1a39-482e-90e9-94d0e1e4a659 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:41.135976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a82558-1a39-482e-90e9-94d0e1e4a659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:41.136612 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a82558-1a39-482e-90e9-94d0e1e4a659 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:41.138040 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a82558-1a39-482e-90e9-94d0e1e4a659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:41.146649 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a82558-1a39-482e-90e9-94d0e1e4a659 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:41.190361 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 860/1711] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:15:41.191492 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7749b2-50f2-4e1e-9815-1000824e44a3 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:41.211798 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7749b2-50f2-4e1e-9815-1000824e44a3 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:41.248589 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587633ef-1cbc-4b17-a568-2d06accf5bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:41.249509 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587633ef-1cbc-4b17-a568-2d06accf5bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:41.249796 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587633ef-1cbc-4b17-a568-2d06accf5bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:41.250108 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587633ef-1cbc-4b17-a568-2d06accf5bcd admin admin] PATH_INFO: `/v3/projects/2b94a074b58e48e5a96a733de93a29ee/users/3f7d3221017949bdb7ab4911bcb32e21/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:41.294284 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587633ef-1cbc-4b17-a568-2d06accf5bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b94a074b58e48e5a96a733de93a29ee, user_id=3f7d3221017949bdb7ab4911bcb32e21, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:41.304459 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587633ef-1cbc-4b17-a568-2d06accf5bcd admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:41.354963 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 852/1712] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:41 2022] PUT /identity/v3/projects/2b94a074b58e48e5a96a733de93a29ee/users/3f7d3221017949bdb7ab4911bcb32e21/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:41.368602 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef73108-ab45-46bc-9072-77196886682e None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:41.370395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef73108-ab45-46bc-9072-77196886682e None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:41.371226 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef73108-ab45-46bc-9072-77196886682e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:41.461235 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-aef73108-ab45-46bc-9072-77196886682e None None] MFA Rules not processed for user `3f7d3221017949bdb7ab4911bcb32e21`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:41.463416 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-aef73108-ab45-46bc-9072-77196886682e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:41.665625 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 861/1713] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:41.666857 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587633ef-1cbc-4b17-a568-2d06accf5bcd admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:41.821271 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587633ef-1cbc-4b17-a568-2d06accf5bcd admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:41.832918 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21505624-f149-472c-bcce-44c412b5be3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:41.838232 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21505624-f149-472c-bcce-44c412b5be3b admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:41.839847 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21505624-f149-472c-bcce-44c412b5be3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:41.842464 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21505624-f149-472c-bcce-44c412b5be3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:41.844376 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21505624-f149-472c-bcce-44c412b5be3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:41.855839 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21505624-f149-472c-bcce-44c412b5be3b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:41.926036 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 853/1714] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:41 2022] POST /identity/v3/projects => generated 409 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:41.930344 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef73108-ab45-46bc-9072-77196886682e None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:41.953182 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef73108-ab45-46bc-9072-77196886682e None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:42.122120 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb46f0-9062-410b-ab95-b96d15986cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:42.123533 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb46f0-9062-410b-ab95-b96d15986cbe admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:42.123926 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb46f0-9062-410b-ab95-b96d15986cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:42.124205 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb46f0-9062-410b-ab95-b96d15986cbe admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:42.126920 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb46f0-9062-410b-ab95-b96d15986cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:42.131998 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb46f0-9062-410b-ab95-b96d15986cbe admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:42.159179 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 862/1715] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:41 2022] POST /identity/v3/users => generated 311 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:15:42.163554 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21505624-f149-472c-bcce-44c412b5be3b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:42.187130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21505624-f149-472c-bcce-44c412b5be3b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:42.197138 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa62b16-1ee8-4e35-bd7c-498981314b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:42.199550 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa62b16-1ee8-4e35-bd7c-498981314b0b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:42.200467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa62b16-1ee8-4e35-bd7c-498981314b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:42.201176 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa62b16-1ee8-4e35-bd7c-498981314b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:42.202387 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa62b16-1ee8-4e35-bd7c-498981314b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:42.205332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa62b16-1ee8-4e35-bd7c-498981314b0b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:42.233011 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 854/1716] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:42.233777 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb46f0-9062-410b-ab95-b96d15986cbe admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:42.251681 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb46f0-9062-410b-ab95-b96d15986cbe admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:42.260572 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934173f-0966-43c3-86ac-bc45dc79599e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:42.262401 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934173f-0966-43c3-86ac-bc45dc79599e admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:42.263103 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934173f-0966-43c3-86ac-bc45dc79599e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:42.264757 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934173f-0966-43c3-86ac-bc45dc79599e admin admin] PATH_INFO: `/v3/projects/024f1a25224949288ff256756d768cea/users/7b99379313cc48248c81448b089db735/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:42.300663 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934173f-0966-43c3-86ac-bc45dc79599e admin admin] RBAC: Authorizing `identity:create_grant(project_id=024f1a25224949288ff256756d768cea, user_id=7b99379313cc48248c81448b089db735, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:42.311555 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934173f-0966-43c3-86ac-bc45dc79599e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:42.339716 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 863/1717] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:42 2022] PUT /identity/v3/projects/024f1a25224949288ff256756d768cea/users/7b99379313cc48248c81448b089db735/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:42.344244 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa62b16-1ee8-4e35-bd7c-498981314b0b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:42.369872 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa62b16-1ee8-4e35-bd7c-498981314b0b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:42.536217 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1d065-f537-4ecb-9737-c9151b841dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:42.537252 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1d065-f537-4ecb-9737-c9151b841dcc admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:42.537512 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1d065-f537-4ecb-9737-c9151b841dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:42.537792 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1d065-f537-4ecb-9737-c9151b841dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:42.538544 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1d065-f537-4ecb-9737-c9151b841dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:42.555271 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1d065-f537-4ecb-9737-c9151b841dcc admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:42.575865 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 855/1718] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:42.579935 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934173f-0966-43c3-86ac-bc45dc79599e admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:42.598935 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934173f-0966-43c3-86ac-bc45dc79599e admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:42.612637 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01684e-06dc-462a-b00b-3ac0ed67796c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:42.613906 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01684e-06dc-462a-b00b-3ac0ed67796c admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:42.614258 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01684e-06dc-462a-b00b-3ac0ed67796c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:42.614653 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01684e-06dc-462a-b00b-3ac0ed67796c admin admin] PATH_INFO: `/v3/projects/024f1a25224949288ff256756d768cea/users/7b99379313cc48248c81448b089db735/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:42.616911 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01684e-06dc-462a-b00b-3ac0ed67796c admin admin] RBAC: Authorizing `identity:create_grant(project_id=024f1a25224949288ff256756d768cea, user_id=7b99379313cc48248c81448b089db735, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:42.620268 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01684e-06dc-462a-b00b-3ac0ed67796c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:42.662686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 864/1719] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:42 2022] PUT /identity/v3/projects/024f1a25224949288ff256756d768cea/users/7b99379313cc48248c81448b089db735/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:15:42.664248 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaa3c6-9626-430d-92dc-debf93745eeb None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:42.664850 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaa3c6-9626-430d-92dc-debf93745eeb None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:42.665205 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaa3c6-9626-430d-92dc-debf93745eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:42.762499 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-10aaa3c6-9626-430d-92dc-debf93745eeb None None] MFA Rules not processed for user `7b99379313cc48248c81448b089db735`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:42.763632 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-10aaa3c6-9626-430d-92dc-debf93745eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:42.993134 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 856/1720] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:42 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:15:43.015913 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01684e-06dc-462a-b00b-3ac0ed67796c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:43.018003 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-7c01684e-06dc-462a-b00b-3ac0ed67796c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:43.154353 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01684e-06dc-462a-b00b-3ac0ed67796c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:43.158481 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ae577-0fc0-48d4-877f-cd287df40f92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:43.159083 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ae577-0fc0-48d4-877f-cd287df40f92 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:43.159370 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ae577-0fc0-48d4-877f-cd287df40f92 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:43.159644 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ae577-0fc0-48d4-877f-cd287df40f92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:43.181173 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ae577-0fc0-48d4-877f-cd287df40f92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:43.182644 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ae577-0fc0-48d4-877f-cd287df40f92 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:43.205604 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 865/1721] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:43 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:43.452498 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aaa3c6-9626-430d-92dc-debf93745eeb None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:43.454831 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-10aaa3c6-9626-430d-92dc-debf93745eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:43.613887 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ae577-0fc0-48d4-877f-cd287df40f92 service cinder] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:43.634471 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ae577-0fc0-48d4-877f-cd287df40f92 service cinder] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:43.636321 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aaa3c6-9626-430d-92dc-debf93745eeb None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:43.644109 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad4794-111e-4b7d-a9ab-ad267cd86d84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:43.644790 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad4794-111e-4b7d-a9ab-ad267cd86d84 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:43.648170 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad4794-111e-4b7d-a9ab-ad267cd86d84 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:43.651052 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad4794-111e-4b7d-a9ab-ad267cd86d84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:43.660328 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b714a67-64c0-4c91-9dbd-99bf6fcb4044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:43.661490 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b714a67-64c0-4c91-9dbd-99bf6fcb4044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:43.661982 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b714a67-64c0-4c91-9dbd-99bf6fcb4044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:43.662494 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b714a67-64c0-4c91-9dbd-99bf6fcb4044 admin admin] PATH_INFO: `/v3/projects/87f8da83fdba4d7c915ebcfaff794d45` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:43.666772 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b714a67-64c0-4c91-9dbd-99bf6fcb4044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87f8da83fdba4d7c915ebcfaff794d45)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:43.669383 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b714a67-64c0-4c91-9dbd-99bf6fcb4044 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:43.781193 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0b714a67-64c0-4c91-9dbd-99bf6fcb4044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87f8da83fdba4d7c915ebcfaff794d45', 'request_id': 'req-0b714a67-64c0-4c91-9dbd-99bf6fcb4044'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:43.802520 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0b714a67-64c0-4c91-9dbd-99bf6fcb4044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87f8da83fdba4d7c915ebcfaff794d45', 'request_id': 'req-0b714a67-64c0-4c91-9dbd-99bf6fcb4044'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:43.823534 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0b714a67-64c0-4c91-9dbd-99bf6fcb4044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87f8da83fdba4d7c915ebcfaff794d45', 'request_id': 'req-0b714a67-64c0-4c91-9dbd-99bf6fcb4044'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:43.849083 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0b714a67-64c0-4c91-9dbd-99bf6fcb4044 admin admin] The token cache is being invalidate because project 87f8da83fdba4d7c915ebcfaff794d45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:15:43.849457 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0b714a67-64c0-4c91-9dbd-99bf6fcb4044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:43.855480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0b714a67-64c0-4c91-9dbd-99bf6fcb4044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:43.865694 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 857/1722] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:15:43 2022] DELETE /identity/v3/projects/87f8da83fdba4d7c915ebcfaff794d45 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:43.869024 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad4794-111e-4b7d-a9ab-ad267cd86d84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:43.870868 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad4794-111e-4b7d-a9ab-ad267cd86d84 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:43.871280 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18deb271-6539-430c-b423-600e15782bee None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:43.871666 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18deb271-6539-430c-b423-600e15782bee None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:43.872088 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18deb271-6539-430c-b423-600e15782bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:43.897683 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 866/1723] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:43 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:15:43.909989 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-18deb271-6539-430c-b423-600e15782bee None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:43.911415 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-18deb271-6539-430c-b423-600e15782bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:43.988464 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 858/1724] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:15:43.998854 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19482d-aed1-4f79-b4db-75336d6859ad None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:43.999449 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19482d-aed1-4f79-b4db-75336d6859ad None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:43.999976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19482d-aed1-4f79-b4db-75336d6859ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:44.045658 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18deb271-6539-430c-b423-600e15782bee None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:44.047662 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-18deb271-6539-430c-b423-600e15782bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:44.060282 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-4d19482d-aed1-4f79-b4db-75336d6859ad None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:44.066058 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-4d19482d-aed1-4f79-b4db-75336d6859ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:44.072647 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18deb271-6539-430c-b423-600e15782bee None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:44.088379 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be829db-5d26-4284-b10a-538081563d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:44.089511 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be829db-5d26-4284-b10a-538081563d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:44.089899 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be829db-5d26-4284-b10a-538081563d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:44.090282 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be829db-5d26-4284-b10a-538081563d7e admin admin] PATH_INFO: `/v3/users/5afc223ee14c4085b42620550fbb9876` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:44.094497 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be829db-5d26-4284-b10a-538081563d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5afc223ee14c4085b42620550fbb9876)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:44.102033 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 867/1725] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:44.102961 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be829db-5d26-4284-b10a-538081563d7e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:44.106399 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19482d-aed1-4f79-b4db-75336d6859ad None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:44.130197 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19482d-aed1-4f79-b4db-75336d6859ad None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:44.142831 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e288d-3fc7-43c7-a34f-836afe9c3668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:44.143558 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e288d-3fc7-43c7-a34f-836afe9c3668 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:44.143859 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e288d-3fc7-43c7-a34f-836afe9c3668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:44.144145 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e288d-3fc7-43c7-a34f-836afe9c3668 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:44.144967 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e288d-3fc7-43c7-a34f-836afe9c3668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:15:44.145291 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e288d-3fc7-43c7-a34f-836afe9c3668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:44.146913 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e288d-3fc7-43c7-a34f-836afe9c3668 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:44.207802 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4be829db-5d26-4284-b10a-538081563d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5afc223ee14c4085b42620550fbb9876'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:44.216924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 868/1726] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:15:44.223008 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e288d-3fc7-43c7-a34f-836afe9c3668 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:44.248511 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4be829db-5d26-4284-b10a-538081563d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5afc223ee14c4085b42620550fbb9876'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:44.253614 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4be829db-5d26-4284-b10a-538081563d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5afc223ee14c4085b42620550fbb9876'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:44.256495 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4be829db-5d26-4284-b10a-538081563d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5afc223ee14c4085b42620550fbb9876'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:44.284491 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e288d-3fc7-43c7-a34f-836afe9c3668 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:44.285156 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4be829db-5d26-4284-b10a-538081563d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5afc223ee14c4085b42620550fbb9876'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:44.298334 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9de76f-3fb9-486a-a317-406da3f7c025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:44.300233 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9de76f-3fb9-486a-a317-406da3f7c025 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:44.301204 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9de76f-3fb9-486a-a317-406da3f7c025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:44.303139 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9de76f-3fb9-486a-a317-406da3f7c025 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:44.305131 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9de76f-3fb9-486a-a317-406da3f7c025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:44.308980 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9de76f-3fb9-486a-a317-406da3f7c025 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:44.321293 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 859/1727] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:15:44 2022] DELETE /identity/v3/users/5afc223ee14c4085b42620550fbb9876 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:15:44.326981 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11307db9-15e4-4436-a86c-f7dcc6d05162 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:44.327320 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11307db9-15e4-4436-a86c-f7dcc6d05162 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:44.329295 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11307db9-15e4-4436-a86c-f7dcc6d05162 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:44.336495 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 860/1728] 10.222.0.77 () {54 vars in 921 bytes} [Thu Feb 10 23:15:44 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:15:44.339904 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dd438-9555-4a9d-9773-0bcda8d68c37 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:44.340283 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dd438-9555-4a9d-9773-0bcda8d68c37 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:44.340599 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dd438-9555-4a9d-9773-0bcda8d68c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:44.394576 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-5e4dd438-9555-4a9d-9773-0bcda8d68c37 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:44.401164 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-5e4dd438-9555-4a9d-9773-0bcda8d68c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:44.409722 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 869/1729] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:44 2022] POST /identity/v3/projects => generated 389 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:44.410892 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9de76f-3fb9-486a-a317-406da3f7c025 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:44.416641 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-7d9de76f-3fb9-486a-a317-406da3f7c025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:44.571078 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9de76f-3fb9-486a-a317-406da3f7c025 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:44.579611 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cee08-48c4-4286-90d7-3028a7440b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:44.580378 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cee08-48c4-4286-90d7-3028a7440b52 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:44.581155 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cee08-48c4-4286-90d7-3028a7440b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:44.581155 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cee08-48c4-4286-90d7-3028a7440b52 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:44.581787 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cee08-48c4-4286-90d7-3028a7440b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:44.583934 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cee08-48c4-4286-90d7-3028a7440b52 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:44.634221 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 870/1730] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:44 2022] POST /identity/v3/users => generated 295 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:44.635583 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cee08-48c4-4286-90d7-3028a7440b52 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:44.654023 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cee08-48c4-4286-90d7-3028a7440b52 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:44.665190 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b5ec2-1d89-4d78-a67b-20ed42ded084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:44.665420 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 861/1731] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:44.665935 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b5ec2-1d89-4d78-a67b-20ed42ded084 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:44.669359 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b5ec2-1d89-4d78-a67b-20ed42ded084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:44.669359 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b5ec2-1d89-4d78-a67b-20ed42ded084 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:44.669359 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b5ec2-1d89-4d78-a67b-20ed42ded084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:44.673248 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b5ec2-1d89-4d78-a67b-20ed42ded084 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:44.701170 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 871/1732] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:15:44.705314 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4dd438-9555-4a9d-9773-0bcda8d68c37 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:44.721320 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b636a-ba46-498f-96b5-bb3f76a87f90 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:44.721898 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b636a-ba46-498f-96b5-bb3f76a87f90 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:44.723889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b636a-ba46-498f-96b5-bb3f76a87f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:44.736062 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4dd438-9555-4a9d-9773-0bcda8d68c37 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:44.768711 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b446329-172c-4fae-97a7-5c06b7ca8158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:44.769835 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b446329-172c-4fae-97a7-5c06b7ca8158 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:44.770413 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b446329-172c-4fae-97a7-5c06b7ca8158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:44.771042 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b446329-172c-4fae-97a7-5c06b7ca8158 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:44.772364 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b446329-172c-4fae-97a7-5c06b7ca8158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:44.774602 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b446329-172c-4fae-97a7-5c06b7ca8158 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:44.800352 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-fe9b636a-ba46-498f-96b5-bb3f76a87f90 None None] MFA Rules not processed for user `551da2c9fab74cb8b14287a5634adb25`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:44.801928 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-fe9b636a-ba46-498f-96b5-bb3f76a87f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:44.809429 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 862/1733] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:44.813714 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b446329-172c-4fae-97a7-5c06b7ca8158 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:44.842413 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b446329-172c-4fae-97a7-5c06b7ca8158 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:44.856656 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed76a3-aa19-4bff-a0dd-51149d172a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:44.857841 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed76a3-aa19-4bff-a0dd-51149d172a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:44.858356 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed76a3-aa19-4bff-a0dd-51149d172a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:44.858802 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed76a3-aa19-4bff-a0dd-51149d172a3f admin admin] PATH_INFO: `/v3/projects/c5d21904ac234aba988b2986e68c228d/users/eec699d3356e4acaa465ce26ab61c471/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:44.888449 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed76a3-aa19-4bff-a0dd-51149d172a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d21904ac234aba988b2986e68c228d, user_id=eec699d3356e4acaa465ce26ab61c471, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:44.892090 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed76a3-aa19-4bff-a0dd-51149d172a3f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:44.921312 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 863/1734] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:44 2022] PUT /identity/v3/projects/c5d21904ac234aba988b2986e68c228d/users/eec699d3356e4acaa465ce26ab61c471/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:44.922164 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed76a3-aa19-4bff-a0dd-51149d172a3f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:44.927756 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-6fed76a3-aa19-4bff-a0dd-51149d172a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:45.050354 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 872/1735] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Feb 10 23:15:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:45.052225 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695667a-730f-405b-91a7-1ec16dd78d6f None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:45.052518 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695667a-730f-405b-91a7-1ec16dd78d6f None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:45.052798 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695667a-730f-405b-91a7-1ec16dd78d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:45.087556 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed76a3-aa19-4bff-a0dd-51149d172a3f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:45.102803 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3789e-779b-4e0c-9e22-eaa8685f19af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:45.103484 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3789e-779b-4e0c-9e22-eaa8685f19af service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:45.103914 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3789e-779b-4e0c-9e22-eaa8685f19af service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:45.104071 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3789e-779b-4e0c-9e22-eaa8685f19af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:45.126399 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-3695667a-730f-405b-91a7-1ec16dd78d6f None None] MFA Rules not processed for user `eec699d3356e4acaa465ce26ab61c471`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:45.129435 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-3695667a-730f-405b-91a7-1ec16dd78d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:45.272360 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 873/1736] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:45.277172 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695667a-730f-405b-91a7-1ec16dd78d6f None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:45.299937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3789e-779b-4e0c-9e22-eaa8685f19af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:45.301897 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3789e-779b-4e0c-9e22-eaa8685f19af service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:45.321070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 864/1737] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:45.377526 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695667a-730f-405b-91a7-1ec16dd78d6f None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:45.384164 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ef07a-8108-44ea-bd9f-179679bdafb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:45.385099 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ef07a-8108-44ea-bd9f-179679bdafb0 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:45.385461 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ef07a-8108-44ea-bd9f-179679bdafb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:45.385818 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ef07a-8108-44ea-bd9f-179679bdafb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:45.386976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ef07a-8108-44ea-bd9f-179679bdafb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:45.389270 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ef07a-8108-44ea-bd9f-179679bdafb0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:45.439857 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 874/1738] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:45 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:15:45.441113 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3789e-779b-4e0c-9e22-eaa8685f19af service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:45.451863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3789e-779b-4e0c-9e22-eaa8685f19af service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:45.583396 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5daa2b-f8cb-47e0-bb85-9256a024c9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:45.584138 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5daa2b-f8cb-47e0-bb85-9256a024c9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:45.584456 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5daa2b-f8cb-47e0-bb85-9256a024c9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:45.584708 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5daa2b-f8cb-47e0-bb85-9256a024c9f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:45.585430 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5daa2b-f8cb-47e0-bb85-9256a024c9f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:45.587880 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5daa2b-f8cb-47e0-bb85-9256a024c9f9 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:45.603046 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ef07a-8108-44ea-bd9f-179679bdafb0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:45.606198 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-3d0ef07a-8108-44ea-bd9f-179679bdafb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:45.628392 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 865/1739] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:45 2022] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:45.629547 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5daa2b-f8cb-47e0-bb85-9256a024c9f9 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:45.642760 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5daa2b-f8cb-47e0-bb85-9256a024c9f9 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:45.651136 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37e8a0-b4a3-4735-9e74-8cb4aa4d3c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:45.652781 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37e8a0-b4a3-4735-9e74-8cb4aa4d3c55 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:45.653519 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37e8a0-b4a3-4735-9e74-8cb4aa4d3c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:45.654130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37e8a0-b4a3-4735-9e74-8cb4aa4d3c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:45.655190 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37e8a0-b4a3-4735-9e74-8cb4aa4d3c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:45.657571 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37e8a0-b4a3-4735-9e74-8cb4aa4d3c55 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:45.673053 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 866/1740] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:45.674845 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37e8a0-b4a3-4735-9e74-8cb4aa4d3c55 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:45.687200 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37e8a0-b4a3-4735-9e74-8cb4aa4d3c55 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:45.692741 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa804b9e-5e46-4ab6-8cde-2f276596adac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:45.694001 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa804b9e-5e46-4ab6-8cde-2f276596adac admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:45.694438 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa804b9e-5e46-4ab6-8cde-2f276596adac admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:45.694866 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa804b9e-5e46-4ab6-8cde-2f276596adac admin admin] PATH_INFO: `/v3/projects/444072688a534ea3b4a510915e47d646/users/4261af3c606a4eae9b6578321d69b546/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:45.713444 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa804b9e-5e46-4ab6-8cde-2f276596adac admin admin] RBAC: Authorizing `identity:create_grant(project_id=444072688a534ea3b4a510915e47d646, user_id=4261af3c606a4eae9b6578321d69b546, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:45.717116 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa804b9e-5e46-4ab6-8cde-2f276596adac admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:45.736876 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 867/1741] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:45 2022] PUT /identity/v3/projects/444072688a534ea3b4a510915e47d646/users/4261af3c606a4eae9b6578321d69b546/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:45.738056 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa804b9e-5e46-4ab6-8cde-2f276596adac admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:45.819589 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa804b9e-5e46-4ab6-8cde-2f276596adac admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:45.823072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ef07a-8108-44ea-bd9f-179679bdafb0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:45.825275 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918f581-7363-4da3-bf50-bf664405b907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:45.826140 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918f581-7363-4da3-bf50-bf664405b907 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:45.826854 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918f581-7363-4da3-bf50-bf664405b907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:45.827137 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918f581-7363-4da3-bf50-bf664405b907 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:45.827936 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918f581-7363-4da3-bf50-bf664405b907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:45.830576 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918f581-7363-4da3-bf50-bf664405b907 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:45.848321 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 868/1742] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:45.849425 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918f581-7363-4da3-bf50-bf664405b907 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:45.874273 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918f581-7363-4da3-bf50-bf664405b907 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:45.899121 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21da0e0-255b-4502-a6d2-e234daccef54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:45.900434 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21da0e0-255b-4502-a6d2-e234daccef54 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:45.900725 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21da0e0-255b-4502-a6d2-e234daccef54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:45.901054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21da0e0-255b-4502-a6d2-e234daccef54 admin admin] PATH_INFO: `/v3/projects/444072688a534ea3b4a510915e47d646/users/4261af3c606a4eae9b6578321d69b546/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:45.903593 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21da0e0-255b-4502-a6d2-e234daccef54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=444072688a534ea3b4a510915e47d646, user_id=4261af3c606a4eae9b6578321d69b546, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:45.907684 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21da0e0-255b-4502-a6d2-e234daccef54 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:45.926852 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 869/1743] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:45 2022] PUT /identity/v3/projects/444072688a534ea3b4a510915e47d646/users/4261af3c606a4eae9b6578321d69b546/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:45.939429 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac646-d8e4-4d69-8917-7b6504958908 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:45.939731 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac646-d8e4-4d69-8917-7b6504958908 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:45.940116 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac646-d8e4-4d69-8917-7b6504958908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:45.974971 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-bf7ac646-d8e4-4d69-8917-7b6504958908 None None] MFA Rules not processed for user `4261af3c606a4eae9b6578321d69b546`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:45.976312 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-bf7ac646-d8e4-4d69-8917-7b6504958908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:46.017491 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbf054-f592-4592-bd25-992ce760992d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:46.018244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbf054-f592-4592-bd25-992ce760992d service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:46.018935 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbf054-f592-4592-bd25-992ce760992d service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:46.019285 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbf054-f592-4592-bd25-992ce760992d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:46.051029 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbf054-f592-4592-bd25-992ce760992d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:46.052850 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbf054-f592-4592-bd25-992ce760992d service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:46.066090 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 870/1744] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:46.089763 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ac646-d8e4-4d69-8917-7b6504958908 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:46.092203 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 875/1745] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:46.104982 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-bf7ac646-d8e4-4d69-8917-7b6504958908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:46.305637 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ac646-d8e4-4d69-8917-7b6504958908 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:46.325704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f833bc5-d877-4fd9-8b5c-50c4d3e5f966 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:46.326297 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f833bc5-d877-4fd9-8b5c-50c4d3e5f966 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:46.333648 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f833bc5-d877-4fd9-8b5c-50c4d3e5f966 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:46.334017 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f833bc5-d877-4fd9-8b5c-50c4d3e5f966 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:46.375425 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f833bc5-d877-4fd9-8b5c-50c4d3e5f966 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:46.378766 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f833bc5-d877-4fd9-8b5c-50c4d3e5f966 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:46.451645 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 871/1746] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:46.629058 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbf054-f592-4592-bd25-992ce760992d service nova] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:46.631049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-23bbf054-f592-4592-bd25-992ce760992d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:46.678373 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbf054-f592-4592-bd25-992ce760992d service nova] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:46.802717 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f833bc5-d877-4fd9-8b5c-50c4d3e5f966 service cinder] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:47.029931 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ef668-1ccf-4179-83de-371eba6c927e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:47.031472 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ef668-1ccf-4179-83de-371eba6c927e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:47.032100 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ef668-1ccf-4179-83de-371eba6c927e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:47.032780 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ef668-1ccf-4179-83de-371eba6c927e admin admin] PATH_INFO: `/v3/projects/c0d9b982ac8c4b46af07aca069fe8328` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:47.039524 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ef668-1ccf-4179-83de-371eba6c927e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d9b982ac8c4b46af07aca069fe8328)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:47.053813 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ef668-1ccf-4179-83de-371eba6c927e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:47.127219 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-416ef668-1ccf-4179-83de-371eba6c927e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d9b982ac8c4b46af07aca069fe8328', 'request_id': 'req-416ef668-1ccf-4179-83de-371eba6c927e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:47.134597 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-416ef668-1ccf-4179-83de-371eba6c927e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d9b982ac8c4b46af07aca069fe8328', 'request_id': 'req-416ef668-1ccf-4179-83de-371eba6c927e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:47.140170 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f833bc5-d877-4fd9-8b5c-50c4d3e5f966 service cinder] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:47.142280 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-416ef668-1ccf-4179-83de-371eba6c927e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d9b982ac8c4b46af07aca069fe8328', 'request_id': 'req-416ef668-1ccf-4179-83de-371eba6c927e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:47.163648 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-416ef668-1ccf-4179-83de-371eba6c927e admin admin] The token cache is being invalidate because project c0d9b982ac8c4b46af07aca069fe8328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:15:47.163648 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-416ef668-1ccf-4179-83de-371eba6c927e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:47.166566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-416ef668-1ccf-4179-83de-371eba6c927e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:47.173207 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 876/1747] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:15:46 2022] DELETE /identity/v3/projects/c0d9b982ac8c4b46af07aca069fe8328 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:47.175969 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b6088-d087-4015-a768-a4b45f2bb433 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:47.176577 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b6088-d087-4015-a768-a4b45f2bb433 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:47.177687 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b6088-d087-4015-a768-a4b45f2bb433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:47.237804 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-861b6088-d087-4015-a768-a4b45f2bb433 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:47.240968 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-861b6088-d087-4015-a768-a4b45f2bb433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:47.310346 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ea153-c664-4425-bcd4-153614fcd454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:47.311341 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ea153-c664-4425-bcd4-153614fcd454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:47.311728 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ea153-c664-4425-bcd4-153614fcd454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:47.312135 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ea153-c664-4425-bcd4-153614fcd454 admin admin] PATH_INFO: `/v3/users/eec699d3356e4acaa465ce26ab61c471` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:47.318184 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ea153-c664-4425-bcd4-153614fcd454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eec699d3356e4acaa465ce26ab61c471)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:47.322252 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ea153-c664-4425-bcd4-153614fcd454 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:47.372265 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 877/1748] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:47.376546 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a044f0-8f4e-4ca1-81c1-f34d7e4a59e1 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:47.377496 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a044f0-8f4e-4ca1-81c1-f34d7e4a59e1 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:47.378138 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a044f0-8f4e-4ca1-81c1-f34d7e4a59e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:47.404355 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-57a044f0-8f4e-4ca1-81c1-f34d7e4a59e1 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:47.405653 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-57a044f0-8f4e-4ca1-81c1-f34d7e4a59e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:47.409834 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f60ea153-c664-4425-bcd4-153614fcd454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eec699d3356e4acaa465ce26ab61c471'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:47.419789 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 878/1749] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:47.424102 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a044f0-8f4e-4ca1-81c1-f34d7e4a59e1 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:47.430569 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f60ea153-c664-4425-bcd4-153614fcd454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eec699d3356e4acaa465ce26ab61c471'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:47.432191 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f60ea153-c664-4425-bcd4-153614fcd454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eec699d3356e4acaa465ce26ab61c471'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:47.433252 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f60ea153-c664-4425-bcd4-153614fcd454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eec699d3356e4acaa465ce26ab61c471'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:47.446168 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f60ea153-c664-4425-bcd4-153614fcd454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eec699d3356e4acaa465ce26ab61c471'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:47.449468 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a044f0-8f4e-4ca1-81c1-f34d7e4a59e1 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:47.454096 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209fe36-09fe-4c87-bcc4-3ab948e6c227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:47.454757 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209fe36-09fe-4c87-bcc4-3ab948e6c227 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:47.455043 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209fe36-09fe-4c87-bcc4-3ab948e6c227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:47.455306 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209fe36-09fe-4c87-bcc4-3ab948e6c227 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:47.456074 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209fe36-09fe-4c87-bcc4-3ab948e6c227 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:15:47.456380 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209fe36-09fe-4c87-bcc4-3ab948e6c227 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:47.457988 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209fe36-09fe-4c87-bcc4-3ab948e6c227 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:47.470161 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 872/1750] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:15:46 2022] DELETE /identity/v3/users/eec699d3356e4acaa465ce26ab61c471 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:15:47.472423 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 879/1751] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:15:47.474494 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504252fd-fd10-40a0-ab5f-f9c0a3dd2cbd None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:47.474851 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504252fd-fd10-40a0-ab5f-f9c0a3dd2cbd None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:47.475129 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504252fd-fd10-40a0-ab5f-f9c0a3dd2cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:47.477288 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209fe36-09fe-4c87-bcc4-3ab948e6c227 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:47.478934 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d209fe36-09fe-4c87-bcc4-3ab948e6c227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:47.492969 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209fe36-09fe-4c87-bcc4-3ab948e6c227 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:47.499986 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-504252fd-fd10-40a0-ab5f-f9c0a3dd2cbd None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:47.501964 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-504252fd-fd10-40a0-ab5f-f9c0a3dd2cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:47.557301 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9e0f5-ebea-41b0-be47-c3821cb21555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:47.558061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9e0f5-ebea-41b0-be47-c3821cb21555 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:47.558339 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9e0f5-ebea-41b0-be47-c3821cb21555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:47.558758 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9e0f5-ebea-41b0-be47-c3821cb21555 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:47.559319 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9e0f5-ebea-41b0-be47-c3821cb21555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:47.561402 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9e0f5-ebea-41b0-be47-c3821cb21555 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:47.575925 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 873/1752] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:15:47.589315 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504252fd-fd10-40a0-ab5f-f9c0a3dd2cbd None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:47.591303 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-504252fd-fd10-40a0-ab5f-f9c0a3dd2cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:47.605821 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 880/1753] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:47 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:47.609851 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9e0f5-ebea-41b0-be47-c3821cb21555 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:47.684923 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9e0f5-ebea-41b0-be47-c3821cb21555 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:47.693533 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d2372-486b-4926-9513-ad04f71c05ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:47.693787 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504252fd-fd10-40a0-ab5f-f9c0a3dd2cbd None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:47.694029 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d2372-486b-4926-9513-ad04f71c05ae admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:47.694293 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d2372-486b-4926-9513-ad04f71c05ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:47.694588 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d2372-486b-4926-9513-ad04f71c05ae admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:47.696099 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d2372-486b-4926-9513-ad04f71c05ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:47.698602 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d2372-486b-4926-9513-ad04f71c05ae admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:47.724617 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 881/1754] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:47 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:15:47.728909 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d2372-486b-4926-9513-ad04f71c05ae admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:47.745113 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d2372-486b-4926-9513-ad04f71c05ae admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:47.752305 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2882b4-6f4a-4857-a431-880fb470028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:47.753004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2882b4-6f4a-4857-a431-880fb470028a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:47.753283 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2882b4-6f4a-4857-a431-880fb470028a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:47.753555 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2882b4-6f4a-4857-a431-880fb470028a admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:47.754376 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2882b4-6f4a-4857-a431-880fb470028a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:47.756250 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2882b4-6f4a-4857-a431-880fb470028a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:47.772574 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 882/1755] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:47.774081 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ad170-9332-4173-80f3-19f43726e80a None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:47.774371 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ad170-9332-4173-80f3-19f43726e80a None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:47.774653 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ad170-9332-4173-80f3-19f43726e80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:47.793888 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757b34e-50a2-4542-8855-eba938147e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:47.794893 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757b34e-50a2-4542-8855-eba938147e9c service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:47.795360 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757b34e-50a2-4542-8855-eba938147e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:47.795644 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757b34e-50a2-4542-8855-eba938147e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:47.812463 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-371ad170-9332-4173-80f3-19f43726e80a None None] MFA Rules not processed for user `a1190ab3568d40ac81b172012b78d18c`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:47.812661 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757b34e-50a2-4542-8855-eba938147e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:47.814110 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757b34e-50a2-4542-8855-eba938147e9c service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:47.814230 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-371ad170-9332-4173-80f3-19f43726e80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:47.827008 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 874/1756] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:47.828185 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757b34e-50a2-4542-8855-eba938147e9c service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:47.838080 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757b34e-50a2-4542-8855-eba938147e9c service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:47.842991 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1273bf-4c97-4325-9c3d-83f294daefbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:47.843658 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1273bf-4c97-4325-9c3d-83f294daefbd admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:47.843975 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1273bf-4c97-4325-9c3d-83f294daefbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:47.844249 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1273bf-4c97-4325-9c3d-83f294daefbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:47.844982 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1273bf-4c97-4325-9c3d-83f294daefbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:47.846590 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1273bf-4c97-4325-9c3d-83f294daefbd admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:47.858133 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 875/1757] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:47.862712 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1273bf-4c97-4325-9c3d-83f294daefbd admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:47.882389 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1273bf-4c97-4325-9c3d-83f294daefbd admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:47.893872 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa229d-08c9-447b-ab9f-09aa08a7eebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:47.894668 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa229d-08c9-447b-ab9f-09aa08a7eebe admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:47.894950 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa229d-08c9-447b-ab9f-09aa08a7eebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:47.895299 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa229d-08c9-447b-ab9f-09aa08a7eebe admin admin] PATH_INFO: `/v3/projects/72243082bac4486d8b6dbab9b9b76efd/users/e1495c5b0e054eaa96cdcd3b1b1caf65/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:47.918290 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 883/1758] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:47.924582 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa229d-08c9-447b-ab9f-09aa08a7eebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=72243082bac4486d8b6dbab9b9b76efd, user_id=e1495c5b0e054eaa96cdcd3b1b1caf65, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:47.928474 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa229d-08c9-447b-ab9f-09aa08a7eebe admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:47.933171 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ad170-9332-4173-80f3-19f43726e80a None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:47.935044 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-371ad170-9332-4173-80f3-19f43726e80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:47.949630 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 876/1759] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:47 2022] PUT /identity/v3/projects/72243082bac4486d8b6dbab9b9b76efd/users/e1495c5b0e054eaa96cdcd3b1b1caf65/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:47.962482 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda0825-b1ab-40d7-999d-77568a19e190 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:47.962921 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda0825-b1ab-40d7-999d-77568a19e190 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:47.963335 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda0825-b1ab-40d7-999d-77568a19e190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:48.007409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-ccda0825-b1ab-40d7-999d-77568a19e190 None None] MFA Rules not processed for user `e1495c5b0e054eaa96cdcd3b1b1caf65`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:48.009648 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-ccda0825-b1ab-40d7-999d-77568a19e190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:48.099894 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ad170-9332-4173-80f3-19f43726e80a None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:48.157134 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 877/1760] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:48.159482 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ae2cb-eb20-47e7-8528-c30cf27656d1 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:48.159797 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ae2cb-eb20-47e7-8528-c30cf27656d1 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:48.160045 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ae2cb-eb20-47e7-8528-c30cf27656d1 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:48.167097 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 878/1761] 10.222.0.77 () {54 vars in 921 bytes} [Thu Feb 10 23:15:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:15:48.167966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ae2cb-eb20-47e7-8528-c30cf27656d1 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:48.204071 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6db011-c5ab-4238-8a07-19e631f3ecb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:48.204733 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6db011-c5ab-4238-8a07-19e631f3ecb0 service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:48.205021 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6db011-c5ab-4238-8a07-19e631f3ecb0 service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:48.205297 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6db011-c5ab-4238-8a07-19e631f3ecb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:48.285240 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ae2cb-eb20-47e7-8528-c30cf27656d1 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:48.296928 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f27274-ae20-4e32-ac93-2aeca1ecf377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:48.297610 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f27274-ae20-4e32-ac93-2aeca1ecf377 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:48.298769 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f27274-ae20-4e32-ac93-2aeca1ecf377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:48.299061 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f27274-ae20-4e32-ac93-2aeca1ecf377 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:48.299932 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f27274-ae20-4e32-ac93-2aeca1ecf377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:48.304816 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f27274-ae20-4e32-ac93-2aeca1ecf377 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:48.317152 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6db011-c5ab-4238-8a07-19e631f3ecb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:48.319334 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6db011-c5ab-4238-8a07-19e631f3ecb0 service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:48.331020 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 884/1762] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:15:48.332788 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555dcbb-d860-4220-82ca-fc3c83cd712d None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:48.333289 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555dcbb-d860-4220-82ca-fc3c83cd712d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:48.333766 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555dcbb-d860-4220-82ca-fc3c83cd712d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:48.379785 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-0555dcbb-d860-4220-82ca-fc3c83cd712d None None] MFA Rules not processed for user `551da2c9fab74cb8b14287a5634adb25`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:48.381011 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-0555dcbb-d860-4220-82ca-fc3c83cd712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:48.407159 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 885/1763] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Feb 10 23:15:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:48.408156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555dcbb-d860-4220-82ca-fc3c83cd712d None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:48.409795 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-0555dcbb-d860-4220-82ca-fc3c83cd712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:48.414328 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 879/1764] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:48 2022] POST /identity/v3/projects => generated 381 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:48.415698 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f27274-ae20-4e32-ac93-2aeca1ecf377 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:48.435486 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555dcbb-d860-4220-82ca-fc3c83cd712d None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:48.553125 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f27274-ae20-4e32-ac93-2aeca1ecf377 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:48.567771 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3af82-bd26-46ea-becd-114b4e74420d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:48.568593 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3af82-bd26-46ea-becd-114b4e74420d admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:48.568978 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3af82-bd26-46ea-becd-114b4e74420d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:48.569439 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3af82-bd26-46ea-becd-114b4e74420d admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:48.571145 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3af82-bd26-46ea-becd-114b4e74420d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:48.573395 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3af82-bd26-46ea-becd-114b4e74420d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:48.578687 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5768aa-3846-4297-b535-b4f487cc29be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:48.579554 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5768aa-3846-4297-b535-b4f487cc29be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:48.579857 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5768aa-3846-4297-b535-b4f487cc29be admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:48.580136 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5768aa-3846-4297-b535-b4f487cc29be admin admin] PATH_INFO: `/v3/projects/c5d21904ac234aba988b2986e68c228d` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:48.583418 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5768aa-3846-4297-b535-b4f487cc29be admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5d21904ac234aba988b2986e68c228d)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:48.585519 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5768aa-3846-4297-b535-b4f487cc29be admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:48.597429 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 880/1765] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:48 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:48.598720 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3af82-bd26-46ea-becd-114b4e74420d admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:48.601063 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-79b3af82-bd26-46ea-becd-114b4e74420d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:48.661970 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5a5768aa-3846-4297-b535-b4f487cc29be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5d21904ac234aba988b2986e68c228d', 'request_id': 'req-5a5768aa-3846-4297-b535-b4f487cc29be'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:48.690563 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5a5768aa-3846-4297-b535-b4f487cc29be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5d21904ac234aba988b2986e68c228d', 'request_id': 'req-5a5768aa-3846-4297-b535-b4f487cc29be'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:48.701721 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5a5768aa-3846-4297-b535-b4f487cc29be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5d21904ac234aba988b2986e68c228d', 'request_id': 'req-5a5768aa-3846-4297-b535-b4f487cc29be'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:48.717866 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3af82-bd26-46ea-becd-114b4e74420d admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:48.722817 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5a5768aa-3846-4297-b535-b4f487cc29be admin admin] The token cache is being invalidate because project c5d21904ac234aba988b2986e68c228d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:15:48.723108 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5a5768aa-3846-4297-b535-b4f487cc29be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:48.723938 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5a5768aa-3846-4297-b535-b4f487cc29be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:48.725945 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 886/1766] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:15:48 2022] DELETE /identity/v3/projects/c5d21904ac234aba988b2986e68c228d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:48.729385 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5768aa-3846-4297-b535-b4f487cc29be admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:48.731695 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-5a5768aa-3846-4297-b535-b4f487cc29be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:48.848545 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5768aa-3846-4297-b535-b4f487cc29be admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:48.862376 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c26d4-00ec-4dc0-908c-43dc4415f364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:48.863662 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c26d4-00ec-4dc0-908c-43dc4415f364 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:48.863662 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c26d4-00ec-4dc0-908c-43dc4415f364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:48.863662 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c26d4-00ec-4dc0-908c-43dc4415f364 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:48.864389 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c26d4-00ec-4dc0-908c-43dc4415f364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:48.868978 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c26d4-00ec-4dc0-908c-43dc4415f364 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:48.871384 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7aa3f-44df-45f9-a78b-bd67c34835f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:48.872345 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7aa3f-44df-45f9-a78b-bd67c34835f6 service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:48.876527 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7aa3f-44df-45f9-a78b-bd67c34835f6 service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:48.876905 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7aa3f-44df-45f9-a78b-bd67c34835f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:48.879567 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-d6f7aa3f-44df-45f9-a78b-bd67c34835f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:48.887138 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 887/1767] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:48.896649 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7aa3f-44df-45f9-a78b-bd67c34835f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:48.898780 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c26d4-00ec-4dc0-908c-43dc4415f364 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:48.899237 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7aa3f-44df-45f9-a78b-bd67c34835f6 service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:48.902117 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-1a5c26d4-00ec-4dc0-908c-43dc4415f364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:48.919392 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 881/1768] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:48.919392 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7aa3f-44df-45f9-a78b-bd67c34835f6 service nova] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:48.931291 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7aa3f-44df-45f9-a78b-bd67c34835f6 service nova] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:48.936698 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a49b35-cd6f-4d96-a7d2-9083c2b3e265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:48.937089 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c26d4-00ec-4dc0-908c-43dc4415f364 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:48.937827 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a49b35-cd6f-4d96-a7d2-9083c2b3e265 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:48.938062 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a49b35-cd6f-4d96-a7d2-9083c2b3e265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:48.938368 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a49b35-cd6f-4d96-a7d2-9083c2b3e265 admin admin] PATH_INFO: `/v3/projects/6dd15de646904533a30fe86e962363d0/users/24c2638315bf4afdb36ec38236ffabdd/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:48.962025 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a49b35-cd6f-4d96-a7d2-9083c2b3e265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dd15de646904533a30fe86e962363d0, user_id=24c2638315bf4afdb36ec38236ffabdd, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:48.965449 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a49b35-cd6f-4d96-a7d2-9083c2b3e265 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:48.972063 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d501a-ea82-440c-a680-7b07342c7654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:48.974521 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d501a-ea82-440c-a680-7b07342c7654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:48.974809 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d501a-ea82-440c-a680-7b07342c7654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:48.975085 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d501a-ea82-440c-a680-7b07342c7654 admin admin] PATH_INFO: `/v3/users/4261af3c606a4eae9b6578321d69b546` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:48.982700 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d501a-ea82-440c-a680-7b07342c7654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4261af3c606a4eae9b6578321d69b546)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:48.985189 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d501a-ea82-440c-a680-7b07342c7654 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:48.987367 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 882/1769] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:48 2022] PUT /identity/v3/projects/6dd15de646904533a30fe86e962363d0/users/24c2638315bf4afdb36ec38236ffabdd/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:48.995220 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a49b35-cd6f-4d96-a7d2-9083c2b3e265 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:49.092309 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-953d501a-ea82-440c-a680-7b07342c7654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4261af3c606a4eae9b6578321d69b546'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:49.122778 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-953d501a-ea82-440c-a680-7b07342c7654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4261af3c606a4eae9b6578321d69b546'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:49.124542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-953d501a-ea82-440c-a680-7b07342c7654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4261af3c606a4eae9b6578321d69b546'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:49.140526 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-953d501a-ea82-440c-a680-7b07342c7654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4261af3c606a4eae9b6578321d69b546'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:49.147952 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-953d501a-ea82-440c-a680-7b07342c7654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4261af3c606a4eae9b6578321d69b546'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:49.151081 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a49b35-cd6f-4d96-a7d2-9083c2b3e265 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:49.158071 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fad28d-0ba3-4ac7-bb16-d3cc51a2b8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:49.158845 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fad28d-0ba3-4ac7-bb16-d3cc51a2b8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:49.159209 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fad28d-0ba3-4ac7-bb16-d3cc51a2b8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:49.159547 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fad28d-0ba3-4ac7-bb16-d3cc51a2b8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:49.160278 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fad28d-0ba3-4ac7-bb16-d3cc51a2b8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:49.161884 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fad28d-0ba3-4ac7-bb16-d3cc51a2b8e1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:49.176557 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 883/1770] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:49.176732 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 888/1771] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:15:48 2022] DELETE /identity/v3/users/4261af3c606a4eae9b6578321d69b546 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:49.180729 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fad28d-0ba3-4ac7-bb16-d3cc51a2b8e1 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:49.183317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e4fad28d-0ba3-4ac7-bb16-d3cc51a2b8e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:49.210972 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fad28d-0ba3-4ac7-bb16-d3cc51a2b8e1 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:49.353147 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91638c19-0161-4e01-aa37-e6c98af2d92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:49.354134 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91638c19-0161-4e01-aa37-e6c98af2d92b admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:49.354413 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91638c19-0161-4e01-aa37-e6c98af2d92b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:49.355903 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91638c19-0161-4e01-aa37-e6c98af2d92b admin admin] PATH_INFO: `/v3/projects/6dd15de646904533a30fe86e962363d0/users/24c2638315bf4afdb36ec38236ffabdd/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:49.357973 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91638c19-0161-4e01-aa37-e6c98af2d92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dd15de646904533a30fe86e962363d0, user_id=24c2638315bf4afdb36ec38236ffabdd, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:49.361445 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91638c19-0161-4e01-aa37-e6c98af2d92b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:49.381025 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 884/1772] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:49 2022] PUT /identity/v3/projects/6dd15de646904533a30fe86e962363d0/users/24c2638315bf4afdb36ec38236ffabdd/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:49.394515 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee38e4d-fa97-4538-b90b-4c9eb072793b None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:49.394893 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee38e4d-fa97-4538-b90b-4c9eb072793b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:49.395141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee38e4d-fa97-4538-b90b-4c9eb072793b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:49.469652 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-fee38e4d-fa97-4538-b90b-4c9eb072793b None None] MFA Rules not processed for user `24c2638315bf4afdb36ec38236ffabdd`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:49.471036 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-fee38e4d-fa97-4538-b90b-4c9eb072793b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:49.579117 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 889/1773] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:49.584750 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91638c19-0161-4e01-aa37-e6c98af2d92b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:49.587051 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-91638c19-0161-4e01-aa37-e6c98af2d92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:49.673064 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91638c19-0161-4e01-aa37-e6c98af2d92b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:49.678683 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff2b36-5776-4eb9-a687-c04e74c6c186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:49.680080 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff2b36-5776-4eb9-a687-c04e74c6c186 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:49.680363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff2b36-5776-4eb9-a687-c04e74c6c186 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:49.680640 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff2b36-5776-4eb9-a687-c04e74c6c186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:49.691022 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff2b36-5776-4eb9-a687-c04e74c6c186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:49.692663 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff2b36-5776-4eb9-a687-c04e74c6c186 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:49.707181 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 885/1774] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:49.710764 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee38e4d-fa97-4538-b90b-4c9eb072793b None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:49.713233 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-fee38e4d-fa97-4538-b90b-4c9eb072793b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:49.821752 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee38e4d-fa97-4538-b90b-4c9eb072793b None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:49.822514 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff2b36-5776-4eb9-a687-c04e74c6c186 service cinder] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:49.824107 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-b4ff2b36-5776-4eb9-a687-c04e74c6c186 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:49.829140 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29ffd9-2cc2-4898-8b4c-e3d8726de19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:49.830031 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29ffd9-2cc2-4898-8b4c-e3d8726de19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:49.830389 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29ffd9-2cc2-4898-8b4c-e3d8726de19e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:49.831070 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29ffd9-2cc2-4898-8b4c-e3d8726de19e admin admin] PATH_INFO: `/v3/projects/444072688a534ea3b4a510915e47d646` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:49.832681 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29ffd9-2cc2-4898-8b4c-e3d8726de19e admin admin] RBAC: Authorizing `identity:delete_project(project_id=444072688a534ea3b4a510915e47d646)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:49.835155 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29ffd9-2cc2-4898-8b4c-e3d8726de19e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:49.844211 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff2b36-5776-4eb9-a687-c04e74c6c186 service cinder] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:49.857542 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf8509-6065-47d1-afeb-e9cbab8ae8c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:49.858751 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf8509-6065-47d1-afeb-e9cbab8ae8c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:49.859049 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf8509-6065-47d1-afeb-e9cbab8ae8c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:49.859381 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf8509-6065-47d1-afeb-e9cbab8ae8c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:49.864459 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-35cf8509-6065-47d1-afeb-e9cbab8ae8c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:49.912327 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5c29ffd9-2cc2-4898-8b4c-e3d8726de19e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '444072688a534ea3b4a510915e47d646', 'request_id': 'req-5c29ffd9-2cc2-4898-8b4c-e3d8726de19e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:49.923616 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5c29ffd9-2cc2-4898-8b4c-e3d8726de19e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '444072688a534ea3b4a510915e47d646', 'request_id': 'req-5c29ffd9-2cc2-4898-8b4c-e3d8726de19e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:49.936494 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5c29ffd9-2cc2-4898-8b4c-e3d8726de19e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '444072688a534ea3b4a510915e47d646', 'request_id': 'req-5c29ffd9-2cc2-4898-8b4c-e3d8726de19e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:49.955662 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf8509-6065-47d1-afeb-e9cbab8ae8c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:49.957332 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5c29ffd9-2cc2-4898-8b4c-e3d8726de19e admin admin] The token cache is being invalidate because project 444072688a534ea3b4a510915e47d646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:15:49.958881 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf8509-6065-47d1-afeb-e9cbab8ae8c9 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:49.959204 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5c29ffd9-2cc2-4898-8b4c-e3d8726de19e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:49.960113 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5c29ffd9-2cc2-4898-8b4c-e3d8726de19e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:49.967009 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 890/1775] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:15:49 2022] DELETE /identity/v3/projects/444072688a534ea3b4a510915e47d646 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:49.968604 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ec06e-eb09-4677-9474-5ab39c9701bb None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:49.969048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ec06e-eb09-4677-9474-5ab39c9701bb None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:49.969384 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ec06e-eb09-4677-9474-5ab39c9701bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:49.977061 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 886/1776] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:50.023687 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-a63ec06e-eb09-4677-9474-5ab39c9701bb None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:50.025686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a63ec06e-eb09-4677-9474-5ab39c9701bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:50.133941 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738006e2-ef39-4760-a799-1cde1ab345ab None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:50.134497 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738006e2-ef39-4760-a799-1cde1ab345ab None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:50.134608 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 891/1777] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:15:50.135426 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738006e2-ef39-4760-a799-1cde1ab345ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:50.191183 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-738006e2-ef39-4760-a799-1cde1ab345ab None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:50.194347 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-738006e2-ef39-4760-a799-1cde1ab345ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:50.216784 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 887/1778] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:15:50.221188 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ec06e-eb09-4677-9474-5ab39c9701bb None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:50.234190 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ec06e-eb09-4677-9474-5ab39c9701bb None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:50.239286 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49459941-27e4-4af2-bc76-e910852b1069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:50.239986 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49459941-27e4-4af2-bc76-e910852b1069 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:50.240272 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49459941-27e4-4af2-bc76-e910852b1069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:50.240553 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49459941-27e4-4af2-bc76-e910852b1069 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:50.241301 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49459941-27e4-4af2-bc76-e910852b1069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:15:50.241599 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49459941-27e4-4af2-bc76-e910852b1069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:50.244268 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49459941-27e4-4af2-bc76-e910852b1069 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:50.270843 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 892/1779] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:15:50.275344 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738006e2-ef39-4760-a799-1cde1ab345ab None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:50.302347 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738006e2-ef39-4760-a799-1cde1ab345ab None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:50.314340 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67977dc2-7b0a-4633-be72-31b6d9df071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:50.314946 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67977dc2-7b0a-4633-be72-31b6d9df071a admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:50.315230 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67977dc2-7b0a-4633-be72-31b6d9df071a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:50.315638 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67977dc2-7b0a-4633-be72-31b6d9df071a admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:50.316286 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67977dc2-7b0a-4633-be72-31b6d9df071a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:50.318185 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67977dc2-7b0a-4633-be72-31b6d9df071a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:50.359989 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 888/1780] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:50 2022] POST /identity/v3/projects => generated 387 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:50.362017 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49459941-27e4-4af2-bc76-e910852b1069 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:50.374588 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49459941-27e4-4af2-bc76-e910852b1069 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:50.454931 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d6d09-d112-4dc1-82b6-ef87c39fb8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:50.455766 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d6d09-d112-4dc1-82b6-ef87c39fb8d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:50.456107 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d6d09-d112-4dc1-82b6-ef87c39fb8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:50.456386 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d6d09-d112-4dc1-82b6-ef87c39fb8d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:50.457260 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d6d09-d112-4dc1-82b6-ef87c39fb8d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:50.459316 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d6d09-d112-4dc1-82b6-ef87c39fb8d2 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:50.495384 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 893/1781] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:50 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:50.496882 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67977dc2-7b0a-4633-be72-31b6d9df071a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:50.511656 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67977dc2-7b0a-4633-be72-31b6d9df071a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:50.517803 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfa899-e403-45aa-8ab8-50fcf3544476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:50.518500 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa899-e403-45aa-8ab8-50fcf3544476 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:50.519145 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa899-e403-45aa-8ab8-50fcf3544476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:50.519262 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa899-e403-45aa-8ab8-50fcf3544476 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:50.520293 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfa899-e403-45aa-8ab8-50fcf3544476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:50.521857 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfa899-e403-45aa-8ab8-50fcf3544476 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:50.534354 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 889/1782] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:50.538052 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d6d09-d112-4dc1-82b6-ef87c39fb8d2 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:50.549985 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d6d09-d112-4dc1-82b6-ef87c39fb8d2 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:50.556219 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5de831-e74a-4d3b-b45c-d5796c17b5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:50.557085 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5de831-e74a-4d3b-b45c-d5796c17b5ad admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:50.557577 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5de831-e74a-4d3b-b45c-d5796c17b5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:50.557993 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5de831-e74a-4d3b-b45c-d5796c17b5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:50.558866 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5de831-e74a-4d3b-b45c-d5796c17b5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:50.560635 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5de831-e74a-4d3b-b45c-d5796c17b5ad admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:50.572936 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 894/1783] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:50.577338 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfa899-e403-45aa-8ab8-50fcf3544476 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:50.588121 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfa899-e403-45aa-8ab8-50fcf3544476 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:50.592999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58e691-af55-4667-8392-380cab82978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:50.593899 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58e691-af55-4667-8392-380cab82978e admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:50.594187 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58e691-af55-4667-8392-380cab82978e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:50.594456 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58e691-af55-4667-8392-380cab82978e admin admin] PATH_INFO: `/v3/projects/9ccad5f402374577b512a2593620a5be/users/4c0ed48a532f4ba99d41bec05c453cb1/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:50.614091 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58e691-af55-4667-8392-380cab82978e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ccad5f402374577b512a2593620a5be, user_id=4c0ed48a532f4ba99d41bec05c453cb1, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:50.617817 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58e691-af55-4667-8392-380cab82978e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:50.633191 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 890/1784] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:50 2022] PUT /identity/v3/projects/9ccad5f402374577b512a2593620a5be/users/4c0ed48a532f4ba99d41bec05c453cb1/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:50.647954 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e36912-7d63-49ec-b6f1-5e362ad67e54 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:50.647954 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e36912-7d63-49ec-b6f1-5e362ad67e54 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:50.647954 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e36912-7d63-49ec-b6f1-5e362ad67e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:50.681133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-b9e36912-7d63-49ec-b6f1-5e362ad67e54 None None] MFA Rules not processed for user `4c0ed48a532f4ba99d41bec05c453cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:50.682347 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-b9e36912-7d63-49ec-b6f1-5e362ad67e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:50.768829 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec878a-a50b-4945-a5ad-c4441a8dd531 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:50.769214 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec878a-a50b-4945-a5ad-c4441a8dd531 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:50.769593 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec878a-a50b-4945-a5ad-c4441a8dd531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:50.779353 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 895/1785] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:50.780327 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e36912-7d63-49ec-b6f1-5e362ad67e54 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:50.790547 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-4cec878a-a50b-4945-a5ad-c4441a8dd531 None None] MFA Rules not processed for user `a1190ab3568d40ac81b172012b78d18c`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:50.792109 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-4cec878a-a50b-4945-a5ad-c4441a8dd531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:50.850107 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e36912-7d63-49ec-b6f1-5e362ad67e54 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:50.856382 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db055ce2-f693-490b-8910-86ae46565661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:50.857212 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db055ce2-f693-490b-8910-86ae46565661 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:50.857583 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db055ce2-f693-490b-8910-86ae46565661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:50.857868 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db055ce2-f693-490b-8910-86ae46565661 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:50.858583 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db055ce2-f693-490b-8910-86ae46565661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:50.860876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db055ce2-f693-490b-8910-86ae46565661 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:50.870106 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 891/1786] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:50.918932 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 896/1787] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:50 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:50.923478 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec878a-a50b-4945-a5ad-c4441a8dd531 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:50.951232 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec878a-a50b-4945-a5ad-c4441a8dd531 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:51.126182 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172bab3-dd06-49ed-8107-a0273bed6e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:51.127457 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172bab3-dd06-49ed-8107-a0273bed6e92 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:51.127457 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172bab3-dd06-49ed-8107-a0273bed6e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:51.127457 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172bab3-dd06-49ed-8107-a0273bed6e92 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:51.129136 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172bab3-dd06-49ed-8107-a0273bed6e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:51.135310 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172bab3-dd06-49ed-8107-a0273bed6e92 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:51.181455 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db055ce2-f693-490b-8910-86ae46565661 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:51.189084 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 892/1788] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:50 2022] POST /identity/v3/users => generated 300 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:51.200208 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db055ce2-f693-490b-8910-86ae46565661 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:51.214216 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ed210-458f-4964-9a27-d1b1a237c39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:51.215033 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ed210-458f-4964-9a27-d1b1a237c39f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:51.215333 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ed210-458f-4964-9a27-d1b1a237c39f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:51.215615 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ed210-458f-4964-9a27-d1b1a237c39f admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:51.216522 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ed210-458f-4964-9a27-d1b1a237c39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:51.218444 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ed210-458f-4964-9a27-d1b1a237c39f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:51.247346 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 897/1789] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:15:51.253022 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172bab3-dd06-49ed-8107-a0273bed6e92 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:51.275180 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172bab3-dd06-49ed-8107-a0273bed6e92 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:51.287575 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf63dab-667b-4e06-9c31-79c8eb734ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:51.294305 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf63dab-667b-4e06-9c31-79c8eb734ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:51.294638 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf63dab-667b-4e06-9c31-79c8eb734ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:51.294940 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf63dab-667b-4e06-9c31-79c8eb734ce5 admin admin] PATH_INFO: `/v3/projects/a4370e71658b4d62a34af9e3621fe0e0/users/933cadb1bbd44c028e055581a9a9ec5c/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:51.337391 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf63dab-667b-4e06-9c31-79c8eb734ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4370e71658b4d62a34af9e3621fe0e0, user_id=933cadb1bbd44c028e055581a9a9ec5c, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:51.340503 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf63dab-667b-4e06-9c31-79c8eb734ce5 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:51.368449 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 893/1790] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:51 2022] PUT /identity/v3/projects/a4370e71658b4d62a34af9e3621fe0e0/users/933cadb1bbd44c028e055581a9a9ec5c/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:51.368912 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ed210-458f-4964-9a27-d1b1a237c39f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:51.385746 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ed210-458f-4964-9a27-d1b1a237c39f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:51.509739 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5c8ca-3609-460e-91b1-4ba0bc0a45c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:51.510769 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5c8ca-3609-460e-91b1-4ba0bc0a45c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:51.511249 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5c8ca-3609-460e-91b1-4ba0bc0a45c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:51.511737 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5c8ca-3609-460e-91b1-4ba0bc0a45c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:51.512891 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5c8ca-3609-460e-91b1-4ba0bc0a45c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:51.515130 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5c8ca-3609-460e-91b1-4ba0bc0a45c6 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:51.528403 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 898/1791] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:15:51.532256 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf63dab-667b-4e06-9c31-79c8eb734ce5 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:51.559325 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf63dab-667b-4e06-9c31-79c8eb734ce5 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:51.565928 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbf6be-d13f-420b-8841-c887c1079220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:51.566834 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbf6be-d13f-420b-8841-c887c1079220 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:51.567113 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbf6be-d13f-420b-8841-c887c1079220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:51.567383 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbf6be-d13f-420b-8841-c887c1079220 admin admin] PATH_INFO: `/v3/projects/a4370e71658b4d62a34af9e3621fe0e0/users/933cadb1bbd44c028e055581a9a9ec5c/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:51.569577 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbf6be-d13f-420b-8841-c887c1079220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4370e71658b4d62a34af9e3621fe0e0, user_id=933cadb1bbd44c028e055581a9a9ec5c, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:51.573406 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbf6be-d13f-420b-8841-c887c1079220 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:51.584394 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 894/1792] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:51 2022] PUT /identity/v3/projects/a4370e71658b4d62a34af9e3621fe0e0/users/933cadb1bbd44c028e055581a9a9ec5c/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:15:51.596202 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfecee-11f1-48a4-98c8-7c25a59dbe43 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:51.596418 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfecee-11f1-48a4-98c8-7c25a59dbe43 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:51.596704 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfecee-11f1-48a4-98c8-7c25a59dbe43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:51.625469 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-f8dfecee-11f1-48a4-98c8-7c25a59dbe43 None None] MFA Rules not processed for user `933cadb1bbd44c028e055581a9a9ec5c`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:51.626846 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-f8dfecee-11f1-48a4-98c8-7c25a59dbe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:51.732559 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 899/1793] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:51.740253 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbf6be-d13f-420b-8841-c887c1079220 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:51.744258 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-37fbf6be-d13f-420b-8841-c887c1079220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:51.817999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbf6be-d13f-420b-8841-c887c1079220 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:51.824385 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0cf8e-ba94-499f-9aa7-c9bd9022ea59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:51.825280 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0cf8e-ba94-499f-9aa7-c9bd9022ea59 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:51.825660 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0cf8e-ba94-499f-9aa7-c9bd9022ea59 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:51.826414 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0cf8e-ba94-499f-9aa7-c9bd9022ea59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:51.837173 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0cf8e-ba94-499f-9aa7-c9bd9022ea59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:51.838629 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0cf8e-ba94-499f-9aa7-c9bd9022ea59 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:51.859396 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 895/1794] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:52.475547 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfecee-11f1-48a4-98c8-7c25a59dbe43 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:52.544863 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfecee-11f1-48a4-98c8-7c25a59dbe43 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:52.549117 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fed03-04b4-4061-ae0b-6b3c3cc1a024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:52.550237 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fed03-04b4-4061-ae0b-6b3c3cc1a024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:52.550525 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fed03-04b4-4061-ae0b-6b3c3cc1a024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:52.550800 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fed03-04b4-4061-ae0b-6b3c3cc1a024 admin admin] PATH_INFO: `/v3/users/4c0ed48a532f4ba99d41bec05c453cb1` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:52.552166 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6fed03-04b4-4061-ae0b-6b3c3cc1a024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c0ed48a532f4ba99d41bec05c453cb1)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:52.554414 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6fed03-04b4-4061-ae0b-6b3c3cc1a024 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:52.641021 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ea6fed03-04b4-4061-ae0b-6b3c3cc1a024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c0ed48a532f4ba99d41bec05c453cb1'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:52.662940 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ea6fed03-04b4-4061-ae0b-6b3c3cc1a024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c0ed48a532f4ba99d41bec05c453cb1'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:52.664478 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ea6fed03-04b4-4061-ae0b-6b3c3cc1a024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c0ed48a532f4ba99d41bec05c453cb1'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:52.674558 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ea6fed03-04b4-4061-ae0b-6b3c3cc1a024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c0ed48a532f4ba99d41bec05c453cb1'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:52.675562 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ea6fed03-04b4-4061-ae0b-6b3c3cc1a024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c0ed48a532f4ba99d41bec05c453cb1'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:52.691231 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 900/1795] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:15:52 2022] DELETE /identity/v3/users/4c0ed48a532f4ba99d41bec05c453cb1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:52.695535 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15cbc6-f9a6-493a-b0c7-a2e561391ad3 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:52.696079 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15cbc6-f9a6-493a-b0c7-a2e561391ad3 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:52.696212 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15cbc6-f9a6-493a-b0c7-a2e561391ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:52.722523 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-9e15cbc6-f9a6-493a-b0c7-a2e561391ad3 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:52.723948 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-9e15cbc6-f9a6-493a-b0c7-a2e561391ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:52.800096 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 896/1796] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:15:52.813141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fed03-04b4-4061-ae0b-6b3c3cc1a024 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:52.815374 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-ea6fed03-04b4-4061-ae0b-6b3c3cc1a024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:52.879220 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fed03-04b4-4061-ae0b-6b3c3cc1a024 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:52.885139 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc7c52-5f16-40e3-a369-0bd841cb4d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:52.887049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc7c52-5f16-40e3-a369-0bd841cb4d61 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:52.887934 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc7c52-5f16-40e3-a369-0bd841cb4d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:52.888906 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc7c52-5f16-40e3-a369-0bd841cb4d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:52.900457 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc7c52-5f16-40e3-a369-0bd841cb4d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:52.901877 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc7c52-5f16-40e3-a369-0bd841cb4d61 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:52.911685 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 901/1797] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:53.256215 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15cbc6-f9a6-493a-b0c7-a2e561391ad3 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:53.258363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-9e15cbc6-f9a6-493a-b0c7-a2e561391ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:53.271949 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15cbc6-f9a6-493a-b0c7-a2e561391ad3 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:53.276907 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb3e93-a3ed-4127-824a-1510f8a46745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:53.277741 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb3e93-a3ed-4127-824a-1510f8a46745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:53.278135 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb3e93-a3ed-4127-824a-1510f8a46745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:53.278295 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb3e93-a3ed-4127-824a-1510f8a46745 admin admin] PATH_INFO: `/v3/projects/9ccad5f402374577b512a2593620a5be` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:53.279521 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb3e93-a3ed-4127-824a-1510f8a46745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ccad5f402374577b512a2593620a5be)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:53.281510 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb3e93-a3ed-4127-824a-1510f8a46745 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:53.329682 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-74bb3e93-a3ed-4127-824a-1510f8a46745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ccad5f402374577b512a2593620a5be', 'request_id': 'req-74bb3e93-a3ed-4127-824a-1510f8a46745'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:53.336955 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-74bb3e93-a3ed-4127-824a-1510f8a46745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ccad5f402374577b512a2593620a5be', 'request_id': 'req-74bb3e93-a3ed-4127-824a-1510f8a46745'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:53.342504 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-74bb3e93-a3ed-4127-824a-1510f8a46745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ccad5f402374577b512a2593620a5be', 'request_id': 'req-74bb3e93-a3ed-4127-824a-1510f8a46745'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:53.355045 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-74bb3e93-a3ed-4127-824a-1510f8a46745 admin admin] The token cache is being invalidate because project 9ccad5f402374577b512a2593620a5be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:15:53.355329 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-74bb3e93-a3ed-4127-824a-1510f8a46745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:53.356020 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-74bb3e93-a3ed-4127-824a-1510f8a46745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:53.357549 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 897/1798] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:15:53 2022] DELETE /identity/v3/projects/9ccad5f402374577b512a2593620a5be => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:53.362320 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc7c52-5f16-40e3-a369-0bd841cb4d61 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:53.373244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc7c52-5f16-40e3-a369-0bd841cb4d61 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:53.432063 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196c6f8-cabb-4ae5-a1b7-a81a40f78a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:53.433410 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196c6f8-cabb-4ae5-a1b7-a81a40f78a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:53.433896 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196c6f8-cabb-4ae5-a1b7-a81a40f78a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:53.434373 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196c6f8-cabb-4ae5-a1b7-a81a40f78a5a admin admin] PATH_INFO: `/v3/users/933cadb1bbd44c028e055581a9a9ec5c` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:53.436081 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196c6f8-cabb-4ae5-a1b7-a81a40f78a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=933cadb1bbd44c028e055581a9a9ec5c)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:53.438010 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196c6f8-cabb-4ae5-a1b7-a81a40f78a5a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:53.535926 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6196c6f8-cabb-4ae5-a1b7-a81a40f78a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '933cadb1bbd44c028e055581a9a9ec5c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:53.549448 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6196c6f8-cabb-4ae5-a1b7-a81a40f78a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '933cadb1bbd44c028e055581a9a9ec5c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:53.550201 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6196c6f8-cabb-4ae5-a1b7-a81a40f78a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '933cadb1bbd44c028e055581a9a9ec5c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:53.559427 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6196c6f8-cabb-4ae5-a1b7-a81a40f78a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '933cadb1bbd44c028e055581a9a9ec5c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:53.560199 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6196c6f8-cabb-4ae5-a1b7-a81a40f78a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '933cadb1bbd44c028e055581a9a9ec5c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:53.575795 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 902/1799] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:15:53 2022] DELETE /identity/v3/users/933cadb1bbd44c028e055581a9a9ec5c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:53.919373 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb3e93-a3ed-4127-824a-1510f8a46745 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:53.926424 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-74bb3e93-a3ed-4127-824a-1510f8a46745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:53.958595 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb3e93-a3ed-4127-824a-1510f8a46745 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:54.081289 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03447d-88a9-4a5f-995e-29011d401393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:54.082236 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03447d-88a9-4a5f-995e-29011d401393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:54.082520 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03447d-88a9-4a5f-995e-29011d401393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:54.082796 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03447d-88a9-4a5f-995e-29011d401393 admin admin] PATH_INFO: `/v3/projects/a4370e71658b4d62a34af9e3621fe0e0` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:54.084072 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03447d-88a9-4a5f-995e-29011d401393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4370e71658b4d62a34af9e3621fe0e0)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:54.086944 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03447d-88a9-4a5f-995e-29011d401393 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:54.173015 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0b03447d-88a9-4a5f-995e-29011d401393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4370e71658b4d62a34af9e3621fe0e0', 'request_id': 'req-0b03447d-88a9-4a5f-995e-29011d401393'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:54.187389 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0b03447d-88a9-4a5f-995e-29011d401393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4370e71658b4d62a34af9e3621fe0e0', 'request_id': 'req-0b03447d-88a9-4a5f-995e-29011d401393'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:54.203429 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0b03447d-88a9-4a5f-995e-29011d401393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4370e71658b4d62a34af9e3621fe0e0', 'request_id': 'req-0b03447d-88a9-4a5f-995e-29011d401393'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:54.244515 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0b03447d-88a9-4a5f-995e-29011d401393 admin admin] The token cache is being invalidate because project a4370e71658b4d62a34af9e3621fe0e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:15:54.244810 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0b03447d-88a9-4a5f-995e-29011d401393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:54.245498 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0b03447d-88a9-4a5f-995e-29011d401393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:54.247061 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 898/1800] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:15:53 2022] DELETE /identity/v3/projects/a4370e71658b4d62a34af9e3621fe0e0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:54.253542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d453cf-76f9-430b-8510-89486187ba3d None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:54.254018 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d453cf-76f9-430b-8510-89486187ba3d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:54.254442 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d453cf-76f9-430b-8510-89486187ba3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:54.277621 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-26d453cf-76f9-430b-8510-89486187ba3d None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:54.278822 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-26d453cf-76f9-430b-8510-89486187ba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:54.352998 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 903/1801] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:54.360702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ac447-3a62-4ab2-bac9-6f0c07bfb545 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:54.360995 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ac447-3a62-4ab2-bac9-6f0c07bfb545 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:54.361278 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ac447-3a62-4ab2-bac9-6f0c07bfb545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:54.380432 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-5f8ac447-3a62-4ab2-bac9-6f0c07bfb545 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:54.381666 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-5f8ac447-3a62-4ab2-bac9-6f0c07bfb545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:54.390353 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 899/1802] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:54.394848 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d453cf-76f9-430b-8510-89486187ba3d None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:54.406341 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d453cf-76f9-430b-8510-89486187ba3d None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:54.410990 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae9768-63b3-4072-a8a5-615438414b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:54.411672 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae9768-63b3-4072-a8a5-615438414b30 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:54.411998 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae9768-63b3-4072-a8a5-615438414b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:54.412251 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae9768-63b3-4072-a8a5-615438414b30 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:54.412991 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae9768-63b3-4072-a8a5-615438414b30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:15:54.413297 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae9768-63b3-4072-a8a5-615438414b30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:54.415388 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae9768-63b3-4072-a8a5-615438414b30 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:54.428175 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 904/1803] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:15:54.431976 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ac447-3a62-4ab2-bac9-6f0c07bfb545 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:54.442095 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ac447-3a62-4ab2-bac9-6f0c07bfb545 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:54.448259 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8580a-1ab0-4755-ba5c-b40ee2528182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:54.448929 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8580a-1ab0-4755-ba5c-b40ee2528182 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:54.452153 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8580a-1ab0-4755-ba5c-b40ee2528182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:54.452448 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8580a-1ab0-4755-ba5c-b40ee2528182 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:54.453179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8580a-1ab0-4755-ba5c-b40ee2528182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:54.455163 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8580a-1ab0-4755-ba5c-b40ee2528182 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:54.483368 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 900/1804] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:54 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:54.487706 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae9768-63b3-4072-a8a5-615438414b30 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:54.498399 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae9768-63b3-4072-a8a5-615438414b30 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:54.572645 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec4d5f-e774-42c6-83a4-2de813f56bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:54.573355 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec4d5f-e774-42c6-83a4-2de813f56bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:54.573613 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec4d5f-e774-42c6-83a4-2de813f56bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:54.573893 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec4d5f-e774-42c6-83a4-2de813f56bd9 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:54.574613 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec4d5f-e774-42c6-83a4-2de813f56bd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:54.576579 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec4d5f-e774-42c6-83a4-2de813f56bd9 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:54.599862 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 905/1805] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:54 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:54.605103 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8580a-1ab0-4755-ba5c-b40ee2528182 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:54.624921 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8580a-1ab0-4755-ba5c-b40ee2528182 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:54.632908 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1838aee-a4e5-4861-a4c7-e9576c482734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:54.633624 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1838aee-a4e5-4861-a4c7-e9576c482734 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:54.634585 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1838aee-a4e5-4861-a4c7-e9576c482734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:54.634585 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1838aee-a4e5-4861-a4c7-e9576c482734 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:54.635060 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1838aee-a4e5-4861-a4c7-e9576c482734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:54.636715 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1838aee-a4e5-4861-a4c7-e9576c482734 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:54.649401 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 901/1806] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:54.657441 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec4d5f-e774-42c6-83a4-2de813f56bd9 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:54.668311 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec4d5f-e774-42c6-83a4-2de813f56bd9 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:54.673578 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83b974-7c42-417a-997d-5acac9d3f9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:54.674377 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83b974-7c42-417a-997d-5acac9d3f9dd admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:54.674820 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83b974-7c42-417a-997d-5acac9d3f9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:54.675256 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83b974-7c42-417a-997d-5acac9d3f9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:54.676156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83b974-7c42-417a-997d-5acac9d3f9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:54.678228 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83b974-7c42-417a-997d-5acac9d3f9dd admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:54.694351 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1838aee-a4e5-4861-a4c7-e9576c482734 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:54.704504 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 906/1807] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:54.706089 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1838aee-a4e5-4861-a4c7-e9576c482734 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:54.714525 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a795568-d984-4b6d-a66f-0183e6917170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:54.715613 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a795568-d984-4b6d-a66f-0183e6917170 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:54.715732 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a795568-d984-4b6d-a66f-0183e6917170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:54.716163 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a795568-d984-4b6d-a66f-0183e6917170 admin admin] PATH_INFO: `/v3/projects/da6d6a3d1e10439ba6d9019074c43427/users/91ce6914e3bb4ffda309017f091b904f/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:54.731923 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a795568-d984-4b6d-a66f-0183e6917170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6d6a3d1e10439ba6d9019074c43427, user_id=91ce6914e3bb4ffda309017f091b904f, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:54.734694 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a795568-d984-4b6d-a66f-0183e6917170 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:54.751230 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 902/1808] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:54 2022] PUT /identity/v3/projects/da6d6a3d1e10439ba6d9019074c43427/users/91ce6914e3bb4ffda309017f091b904f/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:15:54.762455 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0f279-4fae-4a8c-9504-f092fae6dc1f None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:54.762824 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0f279-4fae-4a8c-9504-f092fae6dc1f None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:54.763123 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0f279-4fae-4a8c-9504-f092fae6dc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:54.802959 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-aee0f279-4fae-4a8c-9504-f092fae6dc1f None None] MFA Rules not processed for user `91ce6914e3bb4ffda309017f091b904f`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:54.806098 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-aee0f279-4fae-4a8c-9504-f092fae6dc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:54.920106 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 907/1809] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:54.923115 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a795568-d984-4b6d-a66f-0183e6917170 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:55.020321 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a795568-d984-4b6d-a66f-0183e6917170 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:55.042690 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd1a98-bdac-4dae-870d-3d1d66a59272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:55.043389 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd1a98-bdac-4dae-870d-3d1d66a59272 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:55.043677 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd1a98-bdac-4dae-870d-3d1d66a59272 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:55.043987 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd1a98-bdac-4dae-870d-3d1d66a59272 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:55.046162 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd1a98-bdac-4dae-870d-3d1d66a59272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:55.049933 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd1a98-bdac-4dae-870d-3d1d66a59272 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:55.086167 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 903/1810] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:54 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:55.087433 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0f279-4fae-4a8c-9504-f092fae6dc1f None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:55.109143 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0f279-4fae-4a8c-9504-f092fae6dc1f None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:55.224333 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a6d04-dd7c-4d18-9c2f-850ddd530e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:55.225219 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a6d04-dd7c-4d18-9c2f-850ddd530e22 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:55.225362 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a6d04-dd7c-4d18-9c2f-850ddd530e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:55.225640 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a6d04-dd7c-4d18-9c2f-850ddd530e22 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:55.226439 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a6d04-dd7c-4d18-9c2f-850ddd530e22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:55.228661 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a6d04-dd7c-4d18-9c2f-850ddd530e22 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:55.258306 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 908/1811] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:55 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:55.258886 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd1a98-bdac-4dae-870d-3d1d66a59272 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:55.292200 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd1a98-bdac-4dae-870d-3d1d66a59272 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:55.301955 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248acb35-18ca-49fb-8638-344bc5323b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:55.302649 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248acb35-18ca-49fb-8638-344bc5323b49 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:55.302936 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248acb35-18ca-49fb-8638-344bc5323b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:55.303284 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248acb35-18ca-49fb-8638-344bc5323b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:55.304106 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248acb35-18ca-49fb-8638-344bc5323b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:55.306769 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248acb35-18ca-49fb-8638-344bc5323b49 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:55.322883 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 904/1812] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:55.327695 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a6d04-dd7c-4d18-9c2f-850ddd530e22 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:55.338708 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a6d04-dd7c-4d18-9c2f-850ddd530e22 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:55.343788 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6a5ff-e99e-4f66-9265-bf600f482373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:55.344836 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6a5ff-e99e-4f66-9265-bf600f482373 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:55.345172 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6a5ff-e99e-4f66-9265-bf600f482373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:55.345643 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6a5ff-e99e-4f66-9265-bf600f482373 admin admin] PATH_INFO: `/v3/projects/82031c8832f143048c5928a837f84309/users/084638e7a6fc49d3840dec3c0f9bd83f/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:55.379367 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6a5ff-e99e-4f66-9265-bf600f482373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82031c8832f143048c5928a837f84309, user_id=084638e7a6fc49d3840dec3c0f9bd83f, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:55.382022 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6a5ff-e99e-4f66-9265-bf600f482373 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:55.397760 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 909/1813] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:55 2022] PUT /identity/v3/projects/82031c8832f143048c5928a837f84309/users/084638e7a6fc49d3840dec3c0f9bd83f/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:55.403783 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248acb35-18ca-49fb-8638-344bc5323b49 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:55.415111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248acb35-18ca-49fb-8638-344bc5323b49 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:55.480581 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24807f6-ceb4-41fc-a442-7ce5558be0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:55.481298 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24807f6-ceb4-41fc-a442-7ce5558be0ef admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:55.481583 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24807f6-ceb4-41fc-a442-7ce5558be0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:55.482235 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24807f6-ceb4-41fc-a442-7ce5558be0ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:55.482952 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24807f6-ceb4-41fc-a442-7ce5558be0ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:55.485114 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24807f6-ceb4-41fc-a442-7ce5558be0ef admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:55.503496 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 905/1814] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:55.508467 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6a5ff-e99e-4f66-9265-bf600f482373 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:55.519017 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6a5ff-e99e-4f66-9265-bf600f482373 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:55.524364 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34aebd-a4f2-4604-8d73-ea14bcf9b619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:55.525250 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34aebd-a4f2-4604-8d73-ea14bcf9b619 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:55.525584 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34aebd-a4f2-4604-8d73-ea14bcf9b619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:55.525886 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34aebd-a4f2-4604-8d73-ea14bcf9b619 admin admin] PATH_INFO: `/v3/projects/82031c8832f143048c5928a837f84309/users/084638e7a6fc49d3840dec3c0f9bd83f/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:55.527897 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34aebd-a4f2-4604-8d73-ea14bcf9b619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82031c8832f143048c5928a837f84309, user_id=084638e7a6fc49d3840dec3c0f9bd83f, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:55.530558 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34aebd-a4f2-4604-8d73-ea14bcf9b619 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:55.541047 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 910/1815] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:55 2022] PUT /identity/v3/projects/82031c8832f143048c5928a837f84309/users/084638e7a6fc49d3840dec3c0f9bd83f/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:15:55.552696 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5339a0-40e2-4d60-9c57-2fa0ccc0a8ce None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:55.552986 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5339a0-40e2-4d60-9c57-2fa0ccc0a8ce None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:55.553268 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5339a0-40e2-4d60-9c57-2fa0ccc0a8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:55.585612 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-4b5339a0-40e2-4d60-9c57-2fa0ccc0a8ce None None] MFA Rules not processed for user `084638e7a6fc49d3840dec3c0f9bd83f`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:55.586999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-4b5339a0-40e2-4d60-9c57-2fa0ccc0a8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:55.656421 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 906/1816] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:55.665892 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34aebd-a4f2-4604-8d73-ea14bcf9b619 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:55.667545 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-4d34aebd-a4f2-4604-8d73-ea14bcf9b619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:55.724097 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34aebd-a4f2-4604-8d73-ea14bcf9b619 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:55.728308 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04723158-7b02-482f-be6a-3e7bc0cf645a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:55.729099 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04723158-7b02-482f-be6a-3e7bc0cf645a service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:55.729384 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04723158-7b02-482f-be6a-3e7bc0cf645a service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:55.729659 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04723158-7b02-482f-be6a-3e7bc0cf645a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:55.785021 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04723158-7b02-482f-be6a-3e7bc0cf645a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:55.786444 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04723158-7b02-482f-be6a-3e7bc0cf645a service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:55.795851 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 911/1817] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:56.690804 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5339a0-40e2-4d60-9c57-2fa0ccc0a8ce None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:56.692307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-4b5339a0-40e2-4d60-9c57-2fa0ccc0a8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:56.769109 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5339a0-40e2-4d60-9c57-2fa0ccc0a8ce None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:56.774225 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb435df-3e94-4437-90be-6b87237a18aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:56.775334 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb435df-3e94-4437-90be-6b87237a18aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:56.775670 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb435df-3e94-4437-90be-6b87237a18aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:56.776148 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb435df-3e94-4437-90be-6b87237a18aa admin admin] PATH_INFO: `/v3/users/06f9f3ad3cfa414d884e017b0376c27e` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:56.777541 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb435df-3e94-4437-90be-6b87237a18aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f9f3ad3cfa414d884e017b0376c27e)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:56.780084 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb435df-3e94-4437-90be-6b87237a18aa admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:56.835265 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5cb435df-3e94-4437-90be-6b87237a18aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f9f3ad3cfa414d884e017b0376c27e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:56.847257 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5cb435df-3e94-4437-90be-6b87237a18aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f9f3ad3cfa414d884e017b0376c27e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:56.847992 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5cb435df-3e94-4437-90be-6b87237a18aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f9f3ad3cfa414d884e017b0376c27e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:56.848600 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5cb435df-3e94-4437-90be-6b87237a18aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f9f3ad3cfa414d884e017b0376c27e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:56.856140 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5cb435df-3e94-4437-90be-6b87237a18aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f9f3ad3cfa414d884e017b0376c27e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:56.869244 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 907/1818] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:15:56 2022] DELETE /identity/v3/users/06f9f3ad3cfa414d884e017b0376c27e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:56.874376 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507e5bb-34b7-4333-a1d4-fa79a2654e5e None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:56.874888 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507e5bb-34b7-4333-a1d4-fa79a2654e5e None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:56.875048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507e5bb-34b7-4333-a1d4-fa79a2654e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:56.898494 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-7507e5bb-34b7-4333-a1d4-fa79a2654e5e None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:56.899865 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-7507e5bb-34b7-4333-a1d4-fa79a2654e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:56.973023 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 912/1819] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:56.980974 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb435df-3e94-4437-90be-6b87237a18aa admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:56.982468 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-5cb435df-3e94-4437-90be-6b87237a18aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:57.056010 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb435df-3e94-4437-90be-6b87237a18aa admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:57.059566 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e59cd2-adda-49c8-a640-9247cec354e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:57.060307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e59cd2-adda-49c8-a640-9247cec354e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:57.060554 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e59cd2-adda-49c8-a640-9247cec354e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:57.060877 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e59cd2-adda-49c8-a640-9247cec354e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:57.071225 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e59cd2-adda-49c8-a640-9247cec354e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:57.072666 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e59cd2-adda-49c8-a640-9247cec354e5 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:57.084369 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 908/1820] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:57.503979 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507e5bb-34b7-4333-a1d4-fa79a2654e5e None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:57.506458 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-7507e5bb-34b7-4333-a1d4-fa79a2654e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:57.540450 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507e5bb-34b7-4333-a1d4-fa79a2654e5e None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:57.546154 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06c2a7-7898-4680-bc81-cc2e2cab6afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:57.547286 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c2a7-7898-4680-bc81-cc2e2cab6afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:57.547764 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c2a7-7898-4680-bc81-cc2e2cab6afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:57.548166 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c2a7-7898-4680-bc81-cc2e2cab6afb admin admin] PATH_INFO: `/v3/projects/7717da15265145e3854616825c2b1d4c` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:57.549488 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06c2a7-7898-4680-bc81-cc2e2cab6afb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7717da15265145e3854616825c2b1d4c)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:57.553412 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06c2a7-7898-4680-bc81-cc2e2cab6afb admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:57.608708 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-fb06c2a7-7898-4680-bc81-cc2e2cab6afb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7717da15265145e3854616825c2b1d4c', 'request_id': 'req-fb06c2a7-7898-4680-bc81-cc2e2cab6afb'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:57.614411 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-fb06c2a7-7898-4680-bc81-cc2e2cab6afb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7717da15265145e3854616825c2b1d4c', 'request_id': 'req-fb06c2a7-7898-4680-bc81-cc2e2cab6afb'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:57.621694 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-fb06c2a7-7898-4680-bc81-cc2e2cab6afb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7717da15265145e3854616825c2b1d4c', 'request_id': 'req-fb06c2a7-7898-4680-bc81-cc2e2cab6afb'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:57.634282 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-fb06c2a7-7898-4680-bc81-cc2e2cab6afb admin admin] The token cache is being invalidate because project 7717da15265145e3854616825c2b1d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:15:57.634575 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-fb06c2a7-7898-4680-bc81-cc2e2cab6afb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:57.635275 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-fb06c2a7-7898-4680-bc81-cc2e2cab6afb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:57.637492 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 913/1821] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:15:57 2022] DELETE /identity/v3/projects/7717da15265145e3854616825c2b1d4c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:57.641511 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e59cd2-adda-49c8-a640-9247cec354e5 service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:57.651381 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e59cd2-adda-49c8-a640-9247cec354e5 service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:57.704878 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2290a-bd8c-4957-a1fa-999aa812c07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:57.705732 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2290a-bd8c-4957-a1fa-999aa812c07f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:57.706029 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2290a-bd8c-4957-a1fa-999aa812c07f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:57.706284 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2290a-bd8c-4957-a1fa-999aa812c07f admin admin] PATH_INFO: `/v3/users/f259c487e9b04b7794c73735f1097d6e` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:57.707463 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2290a-bd8c-4957-a1fa-999aa812c07f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f259c487e9b04b7794c73735f1097d6e)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:57.709420 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2290a-bd8c-4957-a1fa-999aa812c07f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:57.755306 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f4a2290a-bd8c-4957-a1fa-999aa812c07f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f259c487e9b04b7794c73735f1097d6e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:57.767270 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f4a2290a-bd8c-4957-a1fa-999aa812c07f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f259c487e9b04b7794c73735f1097d6e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:57.767978 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f4a2290a-bd8c-4957-a1fa-999aa812c07f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f259c487e9b04b7794c73735f1097d6e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:57.768587 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f4a2290a-bd8c-4957-a1fa-999aa812c07f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f259c487e9b04b7794c73735f1097d6e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:57.776657 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f4a2290a-bd8c-4957-a1fa-999aa812c07f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f259c487e9b04b7794c73735f1097d6e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:57.792156 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 909/1822] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:15:57 2022] DELETE /identity/v3/users/f259c487e9b04b7794c73735f1097d6e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:58.056171 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06c2a7-7898-4680-bc81-cc2e2cab6afb admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:58.057607 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-fb06c2a7-7898-4680-bc81-cc2e2cab6afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:58.072202 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06c2a7-7898-4680-bc81-cc2e2cab6afb admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:58.142473 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fc9f8-1cab-4895-b596-b80c9a9e87b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:58.143499 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fc9f8-1cab-4895-b596-b80c9a9e87b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:58.143943 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fc9f8-1cab-4895-b596-b80c9a9e87b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:58.144242 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fc9f8-1cab-4895-b596-b80c9a9e87b4 admin admin] PATH_INFO: `/v3/projects/fee7b0f91c59456180625364ad763114` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:58.145418 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fc9f8-1cab-4895-b596-b80c9a9e87b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee7b0f91c59456180625364ad763114)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:58.147326 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fc9f8-1cab-4895-b596-b80c9a9e87b4 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:58.194090 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f49fc9f8-1cab-4895-b596-b80c9a9e87b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee7b0f91c59456180625364ad763114', 'request_id': 'req-f49fc9f8-1cab-4895-b596-b80c9a9e87b4'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:58.200312 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f49fc9f8-1cab-4895-b596-b80c9a9e87b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee7b0f91c59456180625364ad763114', 'request_id': 'req-f49fc9f8-1cab-4895-b596-b80c9a9e87b4'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:58.207047 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f49fc9f8-1cab-4895-b596-b80c9a9e87b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee7b0f91c59456180625364ad763114', 'request_id': 'req-f49fc9f8-1cab-4895-b596-b80c9a9e87b4'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:58.222870 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f49fc9f8-1cab-4895-b596-b80c9a9e87b4 admin admin] The token cache is being invalidate because project fee7b0f91c59456180625364ad763114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:15:58.222870 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f49fc9f8-1cab-4895-b596-b80c9a9e87b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:58.222870 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f49fc9f8-1cab-4895-b596-b80c9a9e87b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:15:58.224225 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 914/1823] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:15:58 2022] DELETE /identity/v3/projects/fee7b0f91c59456180625364ad763114 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:58.229237 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30bc79-c692-47c5-9384-ac742f64ffa8 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:58.229581 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30bc79-c692-47c5-9384-ac742f64ffa8 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:58.229887 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30bc79-c692-47c5-9384-ac742f64ffa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:58.248255 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-7d30bc79-c692-47c5-9384-ac742f64ffa8 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:58.249473 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-7d30bc79-c692-47c5-9384-ac742f64ffa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:58.307581 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 910/1824] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:15:58.316356 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f104a-2c99-4b1b-bd97-d51b0f8e79ce None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:58.316639 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f104a-2c99-4b1b-bd97-d51b0f8e79ce None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:58.316945 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f104a-2c99-4b1b-bd97-d51b0f8e79ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:58.336168 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-5f6f104a-2c99-4b1b-bd97-d51b0f8e79ce None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:58.337534 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-5f6f104a-2c99-4b1b-bd97-d51b0f8e79ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:58.345713 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 915/1825] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:15:58.350356 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30bc79-c692-47c5-9384-ac742f64ffa8 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:58.360729 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30bc79-c692-47c5-9384-ac742f64ffa8 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:58.365202 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71167bc0-ed35-44a4-bb74-a091817f6165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:58.365846 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71167bc0-ed35-44a4-bb74-a091817f6165 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:58.366120 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71167bc0-ed35-44a4-bb74-a091817f6165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:58.366388 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71167bc0-ed35-44a4-bb74-a091817f6165 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:58.367196 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71167bc0-ed35-44a4-bb74-a091817f6165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:15:58.367783 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71167bc0-ed35-44a4-bb74-a091817f6165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:58.369391 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71167bc0-ed35-44a4-bb74-a091817f6165 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:58.380441 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 911/1826] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:15:58.385266 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f104a-2c99-4b1b-bd97-d51b0f8e79ce None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:58.394078 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f104a-2c99-4b1b-bd97-d51b0f8e79ce None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:58.399326 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4f7e7-3dad-4f45-ad12-9fb15fba17aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:58.400001 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4f7e7-3dad-4f45-ad12-9fb15fba17aa admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:58.400284 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4f7e7-3dad-4f45-ad12-9fb15fba17aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:58.400557 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4f7e7-3dad-4f45-ad12-9fb15fba17aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:58.401260 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4f7e7-3dad-4f45-ad12-9fb15fba17aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:58.403109 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4f7e7-3dad-4f45-ad12-9fb15fba17aa admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:58.427875 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 916/1827] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:58 2022] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:58.432199 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71167bc0-ed35-44a4-bb74-a091817f6165 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:58.441684 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71167bc0-ed35-44a4-bb74-a091817f6165 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:58.496961 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf650071-d0b2-467e-8ddc-e2773c10eb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:58.497633 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf650071-d0b2-467e-8ddc-e2773c10eb51 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:58.497907 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf650071-d0b2-467e-8ddc-e2773c10eb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:58.498176 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf650071-d0b2-467e-8ddc-e2773c10eb51 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:58.498875 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf650071-d0b2-467e-8ddc-e2773c10eb51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:58.500773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf650071-d0b2-467e-8ddc-e2773c10eb51 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:58.521688 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 912/1828] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:58 2022] POST /identity/v3/users => generated 281 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:58.525143 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4f7e7-3dad-4f45-ad12-9fb15fba17aa admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:58.534978 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4f7e7-3dad-4f45-ad12-9fb15fba17aa admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:58.539507 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c19760-bb16-43e3-ae12-e53df99151e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:58.540192 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c19760-bb16-43e3-ae12-e53df99151e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:58.540476 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c19760-bb16-43e3-ae12-e53df99151e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:58.540751 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c19760-bb16-43e3-ae12-e53df99151e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:58.541489 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c19760-bb16-43e3-ae12-e53df99151e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:58.543061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c19760-bb16-43e3-ae12-e53df99151e7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:58.553185 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 917/1829] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:58.557848 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf650071-d0b2-467e-8ddc-e2773c10eb51 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:58.567327 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf650071-d0b2-467e-8ddc-e2773c10eb51 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:58.572539 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb3444-b8d7-4a41-8bff-a646a8ac82c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:58.573179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb3444-b8d7-4a41-8bff-a646a8ac82c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:58.573462 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb3444-b8d7-4a41-8bff-a646a8ac82c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:58.573737 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb3444-b8d7-4a41-8bff-a646a8ac82c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:58.574460 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb3444-b8d7-4a41-8bff-a646a8ac82c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:58.576053 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb3444-b8d7-4a41-8bff-a646a8ac82c1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:58.585607 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 913/1830] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:58.589787 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c19760-bb16-43e3-ae12-e53df99151e7 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:58.599914 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c19760-bb16-43e3-ae12-e53df99151e7 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:58.604294 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149a621-da22-414d-a60a-e64c9e1cb300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:58.605167 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149a621-da22-414d-a60a-e64c9e1cb300 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:58.605445 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149a621-da22-414d-a60a-e64c9e1cb300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:58.605718 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149a621-da22-414d-a60a-e64c9e1cb300 admin admin] PATH_INFO: `/v3/projects/29180dfc8f55440cb23403b6a9cb9bda/users/d34bad94bab04d0fb0e9dcdeef3ab4a8/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:58.621818 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149a621-da22-414d-a60a-e64c9e1cb300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29180dfc8f55440cb23403b6a9cb9bda, user_id=d34bad94bab04d0fb0e9dcdeef3ab4a8, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:58.624627 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149a621-da22-414d-a60a-e64c9e1cb300 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:58.638178 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 918/1831] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:58 2022] PUT /identity/v3/projects/29180dfc8f55440cb23403b6a9cb9bda/users/d34bad94bab04d0fb0e9dcdeef3ab4a8/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:58.648762 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45775d01-1c4a-469a-bfd3-66ad518dffac None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:58.649064 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45775d01-1c4a-469a-bfd3-66ad518dffac None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:58.649349 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45775d01-1c4a-469a-bfd3-66ad518dffac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:58.685238 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-45775d01-1c4a-469a-bfd3-66ad518dffac None None] MFA Rules not processed for user `d34bad94bab04d0fb0e9dcdeef3ab4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:58.686533 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-45775d01-1c4a-469a-bfd3-66ad518dffac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:58.752169 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 914/1832] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:15:58.756591 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149a621-da22-414d-a60a-e64c9e1cb300 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:58.821690 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149a621-da22-414d-a60a-e64c9e1cb300 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:58.826325 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e299177-3c0d-48cd-b192-a4494e63d05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:58.826976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e299177-3c0d-48cd-b192-a4494e63d05d admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:58.827260 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e299177-3c0d-48cd-b192-a4494e63d05d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:58.827536 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e299177-3c0d-48cd-b192-a4494e63d05d admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:58.828284 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e299177-3c0d-48cd-b192-a4494e63d05d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:58.830176 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e299177-3c0d-48cd-b192-a4494e63d05d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:58.854818 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 919/1833] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:15:58 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:15:58.858833 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45775d01-1c4a-469a-bfd3-66ad518dffac None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:58.870685 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45775d01-1c4a-469a-bfd3-66ad518dffac None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:58.924907 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adf934-5b2b-4f0f-9cbf-bdf6a17bb2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:58.925655 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adf934-5b2b-4f0f-9cbf-bdf6a17bb2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:58.925947 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adf934-5b2b-4f0f-9cbf-bdf6a17bb2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:58.926207 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adf934-5b2b-4f0f-9cbf-bdf6a17bb2b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:58.926913 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adf934-5b2b-4f0f-9cbf-bdf6a17bb2b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:58.928838 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adf934-5b2b-4f0f-9cbf-bdf6a17bb2b8 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:58.950874 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 915/1834] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:15:58 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:15:58.954829 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e299177-3c0d-48cd-b192-a4494e63d05d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:58.965104 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e299177-3c0d-48cd-b192-a4494e63d05d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:58.969821 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7138c-fd68-4903-9cce-65386792538f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:58.970474 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7138c-fd68-4903-9cce-65386792538f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:58.970761 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7138c-fd68-4903-9cce-65386792538f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:58.971040 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7138c-fd68-4903-9cce-65386792538f admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:58.971781 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7138c-fd68-4903-9cce-65386792538f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:58.973379 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7138c-fd68-4903-9cce-65386792538f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:58.984346 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 920/1835] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:15:58.988444 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adf934-5b2b-4f0f-9cbf-bdf6a17bb2b8 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:58.999653 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adf934-5b2b-4f0f-9cbf-bdf6a17bb2b8 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:59.004411 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba47ed4-d539-4ac5-9e39-1a4cc113b244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:59.005230 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba47ed4-d539-4ac5-9e39-1a4cc113b244 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:59.005513 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba47ed4-d539-4ac5-9e39-1a4cc113b244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:59.005791 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba47ed4-d539-4ac5-9e39-1a4cc113b244 admin admin] PATH_INFO: `/v3/projects/bec3998b37144e0b8881fe4962e522d8/users/4f11314b47184d6f897eb1a900c82b9a/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:59.020823 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba47ed4-d539-4ac5-9e39-1a4cc113b244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec3998b37144e0b8881fe4962e522d8, user_id=4f11314b47184d6f897eb1a900c82b9a, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:59.023637 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba47ed4-d539-4ac5-9e39-1a4cc113b244 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:59.036068 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 916/1836] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:58 2022] PUT /identity/v3/projects/bec3998b37144e0b8881fe4962e522d8/users/4f11314b47184d6f897eb1a900c82b9a/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:59.040680 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7138c-fd68-4903-9cce-65386792538f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:59.050857 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7138c-fd68-4903-9cce-65386792538f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:59.105960 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ddcd1-c56b-4cf4-b792-bdfbfa2db7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:59.106628 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ddcd1-c56b-4cf4-b792-bdfbfa2db7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:59.106911 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ddcd1-c56b-4cf4-b792-bdfbfa2db7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:59.107187 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ddcd1-c56b-4cf4-b792-bdfbfa2db7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:59.107963 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ddcd1-c56b-4cf4-b792-bdfbfa2db7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:59.109567 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ddcd1-c56b-4cf4-b792-bdfbfa2db7e1 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:59.119950 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 921/1837] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:15:59.124163 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba47ed4-d539-4ac5-9e39-1a4cc113b244 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:59.134519 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba47ed4-d539-4ac5-9e39-1a4cc113b244 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:59.139128 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57eebe-8243-4b53-831d-66604027c12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:59.140044 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57eebe-8243-4b53-831d-66604027c12f admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:59.140332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57eebe-8243-4b53-831d-66604027c12f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:59.140612 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57eebe-8243-4b53-831d-66604027c12f admin admin] PATH_INFO: `/v3/projects/bec3998b37144e0b8881fe4962e522d8/users/4f11314b47184d6f897eb1a900c82b9a/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:59.142587 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57eebe-8243-4b53-831d-66604027c12f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec3998b37144e0b8881fe4962e522d8, user_id=4f11314b47184d6f897eb1a900c82b9a, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:59.145253 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57eebe-8243-4b53-831d-66604027c12f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:59.156612 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 917/1838] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:15:59 2022] PUT /identity/v3/projects/bec3998b37144e0b8881fe4962e522d8/users/4f11314b47184d6f897eb1a900c82b9a/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:15:59.168400 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f577f-4aa7-418f-a495-a72eaf5024ce None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:59.168725 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f577f-4aa7-418f-a495-a72eaf5024ce None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:59.169004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f577f-4aa7-418f-a495-a72eaf5024ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:59.194285 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-e39f577f-4aa7-418f-a495-a72eaf5024ce None None] MFA Rules not processed for user `4f11314b47184d6f897eb1a900c82b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:15:59.195647 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e39f577f-4aa7-418f-a495-a72eaf5024ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:59.267602 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 922/1839] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:15:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:15:59.278459 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57eebe-8243-4b53-831d-66604027c12f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:59.280541 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-2e57eebe-8243-4b53-831d-66604027c12f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:15:59.339340 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57eebe-8243-4b53-831d-66604027c12f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:59.343033 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cfbfc-2a27-49cc-9d47-84c0d1c811dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:59.343681 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cfbfc-2a27-49cc-9d47-84c0d1c811dd service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:59.343998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cfbfc-2a27-49cc-9d47-84c0d1c811dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:59.344278 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cfbfc-2a27-49cc-9d47-84c0d1c811dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:59.356265 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cfbfc-2a27-49cc-9d47-84c0d1c811dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:59.357721 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cfbfc-2a27-49cc-9d47-84c0d1c811dd service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:59.368329 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 918/1840] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:15:59.435962 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f577f-4aa7-418f-a495-a72eaf5024ce None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:15:59.445630 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f577f-4aa7-418f-a495-a72eaf5024ce None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:15:59.449197 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a1594-38f2-449a-9d86-1258c748fac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:15:59.449820 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a1594-38f2-449a-9d86-1258c748fac5 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:15:59.450099 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a1594-38f2-449a-9d86-1258c748fac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:15:59.450374 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a1594-38f2-449a-9d86-1258c748fac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:15:59.510667 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a1594-38f2-449a-9d86-1258c748fac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:15:59.512383 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a1594-38f2-449a-9d86-1258c748fac5 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:15:59.521651 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 923/1841] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:15:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:02.369692 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cfbfc-2a27-49cc-9d47-84c0d1c811dd service cinder] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:02.468737 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cfbfc-2a27-49cc-9d47-84c0d1c811dd service cinder] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:02.481483 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6852c8c-d5b9-4fc6-8cc3-5e731158751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:02.482951 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6852c8c-d5b9-4fc6-8cc3-5e731158751e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:02.483420 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6852c8c-d5b9-4fc6-8cc3-5e731158751e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:02.484024 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6852c8c-d5b9-4fc6-8cc3-5e731158751e admin admin] PATH_INFO: `/v3/users/d34bad94bab04d0fb0e9dcdeef3ab4a8` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:02.485835 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6852c8c-d5b9-4fc6-8cc3-5e731158751e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d34bad94bab04d0fb0e9dcdeef3ab4a8)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:02.489654 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6852c8c-d5b9-4fc6-8cc3-5e731158751e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:02.553164 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-d6852c8c-d5b9-4fc6-8cc3-5e731158751e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd34bad94bab04d0fb0e9dcdeef3ab4a8'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:02.576024 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-d6852c8c-d5b9-4fc6-8cc3-5e731158751e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd34bad94bab04d0fb0e9dcdeef3ab4a8'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:02.576024 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-d6852c8c-d5b9-4fc6-8cc3-5e731158751e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd34bad94bab04d0fb0e9dcdeef3ab4a8'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:02.576024 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-d6852c8c-d5b9-4fc6-8cc3-5e731158751e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd34bad94bab04d0fb0e9dcdeef3ab4a8'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:02.588287 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-d6852c8c-d5b9-4fc6-8cc3-5e731158751e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd34bad94bab04d0fb0e9dcdeef3ab4a8'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:02.609312 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 919/1842] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:02 2022] DELETE /identity/v3/users/d34bad94bab04d0fb0e9dcdeef3ab4a8 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:02.610595 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059233e-8178-48d2-b584-469fe098ae9a None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:02.611047 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059233e-8178-48d2-b584-469fe098ae9a None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:02.611210 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059233e-8178-48d2-b584-469fe098ae9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:02.630807 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-1059233e-8178-48d2-b584-469fe098ae9a None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:02.633666 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-1059233e-8178-48d2-b584-469fe098ae9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:02.707243 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 924/1843] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:16:02.727347 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6852c8c-d5b9-4fc6-8cc3-5e731158751e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:02.729838 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-d6852c8c-d5b9-4fc6-8cc3-5e731158751e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:02.890342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6852c8c-d5b9-4fc6-8cc3-5e731158751e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:02.907703 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc676e-4087-4f6f-b9f7-a425919b88e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:02.908271 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc676e-4087-4f6f-b9f7-a425919b88e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:02.910262 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc676e-4087-4f6f-b9f7-a425919b88e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:02.910497 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc676e-4087-4f6f-b9f7-a425919b88e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:02.962013 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc676e-4087-4f6f-b9f7-a425919b88e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:02.965003 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc676e-4087-4f6f-b9f7-a425919b88e4 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:02.997045 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 920/1844] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:03.016575 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059233e-8178-48d2-b584-469fe098ae9a None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:03.018178 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-1059233e-8178-48d2-b584-469fe098ae9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:03.033046 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059233e-8178-48d2-b584-469fe098ae9a None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:03.039844 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1b21d-dcec-420a-b203-bcf66012d9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:03.041044 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1b21d-dcec-420a-b203-bcf66012d9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:03.041656 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1b21d-dcec-420a-b203-bcf66012d9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:03.042065 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1b21d-dcec-420a-b203-bcf66012d9d0 admin admin] PATH_INFO: `/v3/users/3f7d3221017949bdb7ab4911bcb32e21` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:03.043740 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1b21d-dcec-420a-b203-bcf66012d9d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f7d3221017949bdb7ab4911bcb32e21)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:03.046039 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1b21d-dcec-420a-b203-bcf66012d9d0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:03.150523 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-b0b1b21d-dcec-420a-b203-bcf66012d9d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f7d3221017949bdb7ab4911bcb32e21'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:03.170492 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-b0b1b21d-dcec-420a-b203-bcf66012d9d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f7d3221017949bdb7ab4911bcb32e21'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:03.171321 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-b0b1b21d-dcec-420a-b203-bcf66012d9d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f7d3221017949bdb7ab4911bcb32e21'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:03.185489 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-b0b1b21d-dcec-420a-b203-bcf66012d9d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f7d3221017949bdb7ab4911bcb32e21'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:03.186392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-b0b1b21d-dcec-420a-b203-bcf66012d9d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f7d3221017949bdb7ab4911bcb32e21'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:03.205731 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 925/1845] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:03 2022] DELETE /identity/v3/users/3f7d3221017949bdb7ab4911bcb32e21 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:03.210430 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12fe94-44c3-4b42-b23e-4e4bec1fec8a None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:03.210720 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12fe94-44c3-4b42-b23e-4e4bec1fec8a None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:03.211692 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12fe94-44c3-4b42-b23e-4e4bec1fec8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:03.246852 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-1c12fe94-44c3-4b42-b23e-4e4bec1fec8a None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:03.248165 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-1c12fe94-44c3-4b42-b23e-4e4bec1fec8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:03.344485 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 921/1846] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:03.382241 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1b21d-dcec-420a-b203-bcf66012d9d0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:03.384319 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-b0b1b21d-dcec-420a-b203-bcf66012d9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:03.461496 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1b21d-dcec-420a-b203-bcf66012d9d0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:03.467032 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543e66b-4f8e-4a5c-938e-30a67a3f399b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:03.467948 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543e66b-4f8e-4a5c-938e-30a67a3f399b service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:03.468245 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543e66b-4f8e-4a5c-938e-30a67a3f399b service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:03.468973 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543e66b-4f8e-4a5c-938e-30a67a3f399b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:03.482073 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543e66b-4f8e-4a5c-938e-30a67a3f399b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:03.483681 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543e66b-4f8e-4a5c-938e-30a67a3f399b service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:03.496719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 926/1847] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:03.750760 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12fe94-44c3-4b42-b23e-4e4bec1fec8a None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:03.752355 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-1c12fe94-44c3-4b42-b23e-4e4bec1fec8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:03.764897 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12fe94-44c3-4b42-b23e-4e4bec1fec8a None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:03.771108 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce2b7a-8b8a-46fe-8f21-c33505ea7e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:03.772119 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce2b7a-8b8a-46fe-8f21-c33505ea7e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:03.772409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce2b7a-8b8a-46fe-8f21-c33505ea7e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:03.773241 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce2b7a-8b8a-46fe-8f21-c33505ea7e7b admin admin] PATH_INFO: `/v3/projects/29180dfc8f55440cb23403b6a9cb9bda` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:03.774495 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce2b7a-8b8a-46fe-8f21-c33505ea7e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=29180dfc8f55440cb23403b6a9cb9bda)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:03.776657 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce2b7a-8b8a-46fe-8f21-c33505ea7e7b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:03.843402 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-69ce2b7a-8b8a-46fe-8f21-c33505ea7e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29180dfc8f55440cb23403b6a9cb9bda', 'request_id': 'req-69ce2b7a-8b8a-46fe-8f21-c33505ea7e7b'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:03.852359 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-69ce2b7a-8b8a-46fe-8f21-c33505ea7e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29180dfc8f55440cb23403b6a9cb9bda', 'request_id': 'req-69ce2b7a-8b8a-46fe-8f21-c33505ea7e7b'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:03.862243 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-69ce2b7a-8b8a-46fe-8f21-c33505ea7e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29180dfc8f55440cb23403b6a9cb9bda', 'request_id': 'req-69ce2b7a-8b8a-46fe-8f21-c33505ea7e7b'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:03.875609 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-69ce2b7a-8b8a-46fe-8f21-c33505ea7e7b admin admin] The token cache is being invalidate because project 29180dfc8f55440cb23403b6a9cb9bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:03.876191 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-69ce2b7a-8b8a-46fe-8f21-c33505ea7e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:03.876691 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-69ce2b7a-8b8a-46fe-8f21-c33505ea7e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:03.878970 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 922/1848] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:03 2022] DELETE /identity/v3/projects/29180dfc8f55440cb23403b6a9cb9bda => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:03.883096 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543e66b-4f8e-4a5c-938e-30a67a3f399b service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:03.897589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543e66b-4f8e-4a5c-938e-30a67a3f399b service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:03.970575 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff6931-c330-4779-ad1d-071bd8b24b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:03.971527 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff6931-c330-4779-ad1d-071bd8b24b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:03.972046 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff6931-c330-4779-ad1d-071bd8b24b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:03.972661 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff6931-c330-4779-ad1d-071bd8b24b73 admin admin] PATH_INFO: `/v3/users/4f11314b47184d6f897eb1a900c82b9a` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:03.974959 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff6931-c330-4779-ad1d-071bd8b24b73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f11314b47184d6f897eb1a900c82b9a)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:03.978881 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff6931-c330-4779-ad1d-071bd8b24b73 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:04.070351 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce2b7a-8b8a-46fe-8f21-c33505ea7e7b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:04.072678 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-69ce2b7a-8b8a-46fe-8f21-c33505ea7e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:04.106162 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce2b7a-8b8a-46fe-8f21-c33505ea7e7b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:04.106589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-19ff6931-c330-4779-ad1d-071bd8b24b73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f11314b47184d6f897eb1a900c82b9a'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:04.119333 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626893c2-3217-4ea5-af9c-fc72e8b5e092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:04.122908 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626893c2-3217-4ea5-af9c-fc72e8b5e092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:04.123198 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626893c2-3217-4ea5-af9c-fc72e8b5e092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:04.123625 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626893c2-3217-4ea5-af9c-fc72e8b5e092 admin admin] PATH_INFO: `/v3/projects/2b94a074b58e48e5a96a733de93a29ee` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:04.126750 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-19ff6931-c330-4779-ad1d-071bd8b24b73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f11314b47184d6f897eb1a900c82b9a'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:04.127606 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-19ff6931-c330-4779-ad1d-071bd8b24b73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f11314b47184d6f897eb1a900c82b9a'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:04.127732 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626893c2-3217-4ea5-af9c-fc72e8b5e092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b94a074b58e48e5a96a733de93a29ee)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:04.134788 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626893c2-3217-4ea5-af9c-fc72e8b5e092 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:04.164107 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-19ff6931-c330-4779-ad1d-071bd8b24b73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f11314b47184d6f897eb1a900c82b9a'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:04.164949 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-19ff6931-c330-4779-ad1d-071bd8b24b73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f11314b47184d6f897eb1a900c82b9a'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:04.187385 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 927/1849] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:03 2022] DELETE /identity/v3/users/4f11314b47184d6f897eb1a900c82b9a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:04.251233 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-626893c2-3217-4ea5-af9c-fc72e8b5e092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b94a074b58e48e5a96a733de93a29ee', 'request_id': 'req-626893c2-3217-4ea5-af9c-fc72e8b5e092'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:04.266924 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-626893c2-3217-4ea5-af9c-fc72e8b5e092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b94a074b58e48e5a96a733de93a29ee', 'request_id': 'req-626893c2-3217-4ea5-af9c-fc72e8b5e092'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:04.275641 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-626893c2-3217-4ea5-af9c-fc72e8b5e092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b94a074b58e48e5a96a733de93a29ee', 'request_id': 'req-626893c2-3217-4ea5-af9c-fc72e8b5e092'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:04.290633 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-626893c2-3217-4ea5-af9c-fc72e8b5e092 admin admin] The token cache is being invalidate because project 2b94a074b58e48e5a96a733de93a29ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:04.291106 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-626893c2-3217-4ea5-af9c-fc72e8b5e092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:04.292389 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-626893c2-3217-4ea5-af9c-fc72e8b5e092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:04.301729 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff6931-c330-4779-ad1d-071bd8b24b73 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:04.306274 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 923/1850] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:04 2022] DELETE /identity/v3/projects/2b94a074b58e48e5a96a733de93a29ee => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:04.307762 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-19ff6931-c330-4779-ad1d-071bd8b24b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:04.436961 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff6931-c330-4779-ad1d-071bd8b24b73 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:04.606629 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959cfaf-59ed-451b-bb74-75f66b7f5594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:04.607912 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959cfaf-59ed-451b-bb74-75f66b7f5594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:04.608471 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959cfaf-59ed-451b-bb74-75f66b7f5594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:04.609166 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959cfaf-59ed-451b-bb74-75f66b7f5594 admin admin] PATH_INFO: `/v3/users/7b99379313cc48248c81448b089db735` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:04.611140 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959cfaf-59ed-451b-bb74-75f66b7f5594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b99379313cc48248c81448b089db735)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:04.613409 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959cfaf-59ed-451b-bb74-75f66b7f5594 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:04.699029 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626893c2-3217-4ea5-af9c-fc72e8b5e092 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:04.701016 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-626893c2-3217-4ea5-af9c-fc72e8b5e092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:04.705526 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-9959cfaf-59ed-451b-bb74-75f66b7f5594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b99379313cc48248c81448b089db735'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:04.726418 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-9959cfaf-59ed-451b-bb74-75f66b7f5594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b99379313cc48248c81448b089db735'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:04.727440 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-9959cfaf-59ed-451b-bb74-75f66b7f5594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b99379313cc48248c81448b089db735'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:04.737933 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-9959cfaf-59ed-451b-bb74-75f66b7f5594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b99379313cc48248c81448b089db735'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:04.738916 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-9959cfaf-59ed-451b-bb74-75f66b7f5594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b99379313cc48248c81448b089db735'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:04.746260 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626893c2-3217-4ea5-af9c-fc72e8b5e092 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:04.754264 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a65be-7fb4-49ba-a8fb-493147d5c250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:04.756500 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a65be-7fb4-49ba-a8fb-493147d5c250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:04.757916 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a65be-7fb4-49ba-a8fb-493147d5c250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:04.758588 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a65be-7fb4-49ba-a8fb-493147d5c250 admin admin] PATH_INFO: `/v3/users/e1495c5b0e054eaa96cdcd3b1b1caf65` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:04.760727 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a65be-7fb4-49ba-a8fb-493147d5c250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1495c5b0e054eaa96cdcd3b1b1caf65)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:04.763298 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 928/1851] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:04 2022] DELETE /identity/v3/users/7b99379313cc48248c81448b089db735 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:04.764101 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a65be-7fb4-49ba-a8fb-493147d5c250 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:04.836231 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-b69a65be-7fb4-49ba-a8fb-493147d5c250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1495c5b0e054eaa96cdcd3b1b1caf65'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:04.853380 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-b69a65be-7fb4-49ba-a8fb-493147d5c250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1495c5b0e054eaa96cdcd3b1b1caf65'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:04.854155 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-b69a65be-7fb4-49ba-a8fb-493147d5c250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1495c5b0e054eaa96cdcd3b1b1caf65'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:04.854921 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-b69a65be-7fb4-49ba-a8fb-493147d5c250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1495c5b0e054eaa96cdcd3b1b1caf65'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:04.866019 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-b69a65be-7fb4-49ba-a8fb-493147d5c250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1495c5b0e054eaa96cdcd3b1b1caf65'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:04.885922 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 924/1852] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:04 2022] DELETE /identity/v3/users/e1495c5b0e054eaa96cdcd3b1b1caf65 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:04.887835 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99b80f-0f05-44a9-9658-c4406d2cfaa6 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:04.888293 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99b80f-0f05-44a9-9658-c4406d2cfaa6 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:04.888378 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99b80f-0f05-44a9-9658-c4406d2cfaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:04.914739 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-2b99b80f-0f05-44a9-9658-c4406d2cfaa6 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:04.916036 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2b99b80f-0f05-44a9-9658-c4406d2cfaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:05.022458 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 929/1853] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:05.032170 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a65be-7fb4-49ba-a8fb-493147d5c250 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:05.033710 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-b69a65be-7fb4-49ba-a8fb-493147d5c250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:05.050808 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99b80f-0f05-44a9-9658-c4406d2cfaa6 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:05.053091 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2b99b80f-0f05-44a9-9658-c4406d2cfaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:05.082857 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99b80f-0f05-44a9-9658-c4406d2cfaa6 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:05.092029 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853986a1-3d4b-4d79-ad9a-377b934c2023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:05.093257 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853986a1-3d4b-4d79-ad9a-377b934c2023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:05.093785 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853986a1-3d4b-4d79-ad9a-377b934c2023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:05.094401 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853986a1-3d4b-4d79-ad9a-377b934c2023 admin admin] PATH_INFO: `/v3/projects/bec3998b37144e0b8881fe4962e522d8` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:05.096016 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853986a1-3d4b-4d79-ad9a-377b934c2023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec3998b37144e0b8881fe4962e522d8)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:05.100184 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853986a1-3d4b-4d79-ad9a-377b934c2023 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:05.155269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a65be-7fb4-49ba-a8fb-493147d5c250 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:05.166834 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843a4f2-9c2a-4494-b9da-9aa7550ab0bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:05.167942 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843a4f2-9c2a-4494-b9da-9aa7550ab0bb service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:05.168130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843a4f2-9c2a-4494-b9da-9aa7550ab0bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:05.168556 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843a4f2-9c2a-4494-b9da-9aa7550ab0bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:05.179348 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843a4f2-9c2a-4494-b9da-9aa7550ab0bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:05.181243 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843a4f2-9c2a-4494-b9da-9aa7550ab0bb service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:05.194467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 925/1854] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:16:05.195750 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843a4f2-9c2a-4494-b9da-9aa7550ab0bb service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:05.196459 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-853986a1-3d4b-4d79-ad9a-377b934c2023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec3998b37144e0b8881fe4962e522d8', 'request_id': 'req-853986a1-3d4b-4d79-ad9a-377b934c2023'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:05.197344 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a843a4f2-9c2a-4494-b9da-9aa7550ab0bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:05.209684 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-853986a1-3d4b-4d79-ad9a-377b934c2023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec3998b37144e0b8881fe4962e522d8', 'request_id': 'req-853986a1-3d4b-4d79-ad9a-377b934c2023'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:05.211795 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843a4f2-9c2a-4494-b9da-9aa7550ab0bb service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:05.219216 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-853986a1-3d4b-4d79-ad9a-377b934c2023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec3998b37144e0b8881fe4962e522d8', 'request_id': 'req-853986a1-3d4b-4d79-ad9a-377b934c2023'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:05.234790 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-853986a1-3d4b-4d79-ad9a-377b934c2023 admin admin] The token cache is being invalidate because project bec3998b37144e0b8881fe4962e522d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:05.235737 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-853986a1-3d4b-4d79-ad9a-377b934c2023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:05.236684 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-853986a1-3d4b-4d79-ad9a-377b934c2023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:05.239685 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 930/1855] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:05 2022] DELETE /identity/v3/projects/bec3998b37144e0b8881fe4962e522d8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:05.245910 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed7e19-7e5a-4496-a698-0918578e598e None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:05.247202 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed7e19-7e5a-4496-a698-0918578e598e None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:05.247719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed7e19-7e5a-4496-a698-0918578e598e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:05.271504 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-50ed7e19-7e5a-4496-a698-0918578e598e None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:05.275502 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-50ed7e19-7e5a-4496-a698-0918578e598e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:05.313030 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc284515-01e9-4420-9a70-7334b03ac636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:05.314307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc284515-01e9-4420-9a70-7334b03ac636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:05.314896 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc284515-01e9-4420-9a70-7334b03ac636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:05.315427 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc284515-01e9-4420-9a70-7334b03ac636 admin admin] PATH_INFO: `/v3/projects/024f1a25224949288ff256756d768cea` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:05.317430 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc284515-01e9-4420-9a70-7334b03ac636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=024f1a25224949288ff256756d768cea)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:05.321930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc284515-01e9-4420-9a70-7334b03ac636 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:05.371324 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 931/1856] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:05.376222 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8fe5f-c148-400e-a54d-9bcda61260c9 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:05.376514 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8fe5f-c148-400e-a54d-9bcda61260c9 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:05.376999 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8fe5f-c148-400e-a54d-9bcda61260c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:05.409261 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-6fd8fe5f-c148-400e-a54d-9bcda61260c9 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:05.413225 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-6fd8fe5f-c148-400e-a54d-9bcda61260c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:05.419209 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-dc284515-01e9-4420-9a70-7334b03ac636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '024f1a25224949288ff256756d768cea', 'request_id': 'req-dc284515-01e9-4420-9a70-7334b03ac636'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:05.450466 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-dc284515-01e9-4420-9a70-7334b03ac636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '024f1a25224949288ff256756d768cea', 'request_id': 'req-dc284515-01e9-4420-9a70-7334b03ac636'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:05.474596 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-dc284515-01e9-4420-9a70-7334b03ac636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '024f1a25224949288ff256756d768cea', 'request_id': 'req-dc284515-01e9-4420-9a70-7334b03ac636'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:05.553005 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-dc284515-01e9-4420-9a70-7334b03ac636 admin admin] The token cache is being invalidate because project 024f1a25224949288ff256756d768cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:05.553298 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-dc284515-01e9-4420-9a70-7334b03ac636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:05.554165 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-dc284515-01e9-4420-9a70-7334b03ac636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:05.556414 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 926/1857] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:05 2022] DELETE /identity/v3/projects/024f1a25224949288ff256756d768cea => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:05.564766 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c8648-725f-4b64-aa07-3481bb48b14f None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:05.564766 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c8648-725f-4b64-aa07-3481bb48b14f None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:05.564766 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c8648-725f-4b64-aa07-3481bb48b14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:05.570075 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 932/1858] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:05.574360 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8fe5f-c148-400e-a54d-9bcda61260c9 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:05.602896 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8fe5f-c148-400e-a54d-9bcda61260c9 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:05.609562 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-2f0c8648-725f-4b64-aa07-3481bb48b14f None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:05.610636 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-2f0c8648-725f-4b64-aa07-3481bb48b14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:05.615426 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2412e-7b9a-4b7b-9765-8d26ea887f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:05.616188 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2412e-7b9a-4b7b-9765-8d26ea887f91 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:05.616602 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2412e-7b9a-4b7b-9765-8d26ea887f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:05.616933 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2412e-7b9a-4b7b-9765-8d26ea887f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:05.618042 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2412e-7b9a-4b7b-9765-8d26ea887f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:16:05.618347 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2412e-7b9a-4b7b-9765-8d26ea887f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:05.620383 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2412e-7b9a-4b7b-9765-8d26ea887f91 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:05.636164 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 927/1859] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:05.644647 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 933/1860] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:16:05.645753 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d91da-e3e3-47b0-9b12-8a6f9c211244 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:05.646038 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d91da-e3e3-47b0-9b12-8a6f9c211244 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:05.646582 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d91da-e3e3-47b0-9b12-8a6f9c211244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:05.650396 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2412e-7b9a-4b7b-9765-8d26ea887f91 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:05.660303 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2412e-7b9a-4b7b-9765-8d26ea887f91 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:05.667626 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2ed6e-6113-4612-aeaf-715ece71993e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:05.668933 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2ed6e-6113-4612-aeaf-715ece71993e admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:05.669682 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2ed6e-6113-4612-aeaf-715ece71993e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:05.669968 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2ed6e-6113-4612-aeaf-715ece71993e admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:05.671776 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2ed6e-6113-4612-aeaf-715ece71993e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:05.673637 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2ed6e-6113-4612-aeaf-715ece71993e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:05.703118 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-d35d91da-e3e3-47b0-9b12-8a6f9c211244 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:05.706931 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-d35d91da-e3e3-47b0-9b12-8a6f9c211244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:05.714329 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 934/1861] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:05 2022] POST /identity/v3/projects => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:05.719304 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2ed6e-6113-4612-aeaf-715ece71993e admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:05.813795 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 928/1862] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:16:05.815462 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d91da-e3e3-47b0-9b12-8a6f9c211244 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:05.827214 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d91da-e3e3-47b0-9b12-8a6f9c211244 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:05.833465 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd28dba-c390-49cb-acbc-cf4d3cd594f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:05.835950 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd28dba-c390-49cb-acbc-cf4d3cd594f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:05.836721 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd28dba-c390-49cb-acbc-cf4d3cd594f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:05.837516 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd28dba-c390-49cb-acbc-cf4d3cd594f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:05.838648 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd28dba-c390-49cb-acbc-cf4d3cd594f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:16:05.839216 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd28dba-c390-49cb-acbc-cf4d3cd594f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:05.841098 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd28dba-c390-49cb-acbc-cf4d3cd594f3 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:05.860352 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 929/1863] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:16:05.861489 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd28dba-c390-49cb-acbc-cf4d3cd594f3 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:05.873974 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd28dba-c390-49cb-acbc-cf4d3cd594f3 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:05.879656 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec435b1-d745-4d94-9826-3a102a373666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:05.880716 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec435b1-d745-4d94-9826-3a102a373666 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:05.881282 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec435b1-d745-4d94-9826-3a102a373666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:05.881773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec435b1-d745-4d94-9826-3a102a373666 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:05.882784 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec435b1-d745-4d94-9826-3a102a373666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:05.885225 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec435b1-d745-4d94-9826-3a102a373666 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:05.895397 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2ed6e-6113-4612-aeaf-715ece71993e admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:05.905104 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c053c-e249-4f14-bc0a-59164a2ebb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:05.905808 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c053c-e249-4f14-bc0a-59164a2ebb2d admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:05.906072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c053c-e249-4f14-bc0a-59164a2ebb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:05.906346 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c053c-e249-4f14-bc0a-59164a2ebb2d admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:05.907063 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c053c-e249-4f14-bc0a-59164a2ebb2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:05.910479 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c053c-e249-4f14-bc0a-59164a2ebb2d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:05.923977 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 930/1864] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:05 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:05.925602 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec435b1-d745-4d94-9826-3a102a373666 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:05.942726 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 935/1865] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:05 2022] POST /identity/v3/users => generated 284 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:05.945926 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c053c-e249-4f14-bc0a-59164a2ebb2d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:05.958779 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c053c-e249-4f14-bc0a-59164a2ebb2d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:06.040602 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec435b1-d745-4d94-9826-3a102a373666 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:06.046794 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20f07a-5db4-4534-a9b3-f3822ec22b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:06.047795 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20f07a-5db4-4534-a9b3-f3822ec22b85 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:06.048118 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20f07a-5db4-4534-a9b3-f3822ec22b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:06.048401 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20f07a-5db4-4534-a9b3-f3822ec22b85 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:06.049703 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20f07a-5db4-4534-a9b3-f3822ec22b85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:06.051201 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20f07a-5db4-4534-a9b3-f3822ec22b85 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:06.080064 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0353e-3311-403f-bb59-e04a324c5e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:06.080064 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0353e-3311-403f-bb59-e04a324c5e32 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:06.080064 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0353e-3311-403f-bb59-e04a324c5e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:06.080064 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0353e-3311-403f-bb59-e04a324c5e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:06.080535 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0353e-3311-403f-bb59-e04a324c5e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:06.080535 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0353e-3311-403f-bb59-e04a324c5e32 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:06.094755 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 936/1866] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:06.095839 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0353e-3311-403f-bb59-e04a324c5e32 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:06.097899 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e8a0353e-3311-403f-bb59-e04a324c5e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:06.099289 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 931/1867] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:05 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:06.103950 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20f07a-5db4-4534-a9b3-f3822ec22b85 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:06.116049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0353e-3311-403f-bb59-e04a324c5e32 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:06.123308 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20f07a-5db4-4534-a9b3-f3822ec22b85 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:06.129009 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54286ef6-96b4-483a-86e3-d15f3c895cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:06.129727 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54286ef6-96b4-483a-86e3-d15f3c895cba admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:06.130013 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54286ef6-96b4-483a-86e3-d15f3c895cba admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:06.130289 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54286ef6-96b4-483a-86e3-d15f3c895cba admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:06.131079 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54286ef6-96b4-483a-86e3-d15f3c895cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:06.133344 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54286ef6-96b4-483a-86e3-d15f3c895cba admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:06.136595 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c8c0e-f0d1-4826-8794-0e464c8e62f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:06.137472 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c8c0e-f0d1-4826-8794-0e464c8e62f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:06.137760 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c8c0e-f0d1-4826-8794-0e464c8e62f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:06.138087 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c8c0e-f0d1-4826-8794-0e464c8e62f3 admin admin] PATH_INFO: `/v3/projects/72243082bac4486d8b6dbab9b9b76efd` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:06.140741 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c8c0e-f0d1-4826-8794-0e464c8e62f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72243082bac4486d8b6dbab9b9b76efd)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:06.144507 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 932/1868] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:06.145429 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54286ef6-96b4-483a-86e3-d15f3c895cba admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:06.146901 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c8c0e-f0d1-4826-8794-0e464c8e62f3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:06.163055 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54286ef6-96b4-483a-86e3-d15f3c895cba admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:06.173137 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e513b18-6383-4b87-a94b-e1250eafa33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:06.174453 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e513b18-6383-4b87-a94b-e1250eafa33b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:06.174751 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e513b18-6383-4b87-a94b-e1250eafa33b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:06.175032 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e513b18-6383-4b87-a94b-e1250eafa33b admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:06.175962 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e513b18-6383-4b87-a94b-e1250eafa33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:06.177718 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e513b18-6383-4b87-a94b-e1250eafa33b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:06.194400 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 933/1869] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:06.197961 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e513b18-6383-4b87-a94b-e1250eafa33b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:06.214061 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e513b18-6383-4b87-a94b-e1250eafa33b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:06.229488 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-323c8c0e-f0d1-4826-8794-0e464c8e62f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72243082bac4486d8b6dbab9b9b76efd', 'request_id': 'req-323c8c0e-f0d1-4826-8794-0e464c8e62f3'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:06.237498 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-323c8c0e-f0d1-4826-8794-0e464c8e62f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72243082bac4486d8b6dbab9b9b76efd', 'request_id': 'req-323c8c0e-f0d1-4826-8794-0e464c8e62f3'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:06.244425 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-323c8c0e-f0d1-4826-8794-0e464c8e62f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72243082bac4486d8b6dbab9b9b76efd', 'request_id': 'req-323c8c0e-f0d1-4826-8794-0e464c8e62f3'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:06.259599 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-323c8c0e-f0d1-4826-8794-0e464c8e62f3 admin admin] The token cache is being invalidate because project 72243082bac4486d8b6dbab9b9b76efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:06.259850 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-323c8c0e-f0d1-4826-8794-0e464c8e62f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:06.260549 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-323c8c0e-f0d1-4826-8794-0e464c8e62f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:06.262582 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 937/1870] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:06 2022] DELETE /identity/v3/projects/72243082bac4486d8b6dbab9b9b76efd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:06.263342 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c8c0e-f0d1-4826-8794-0e464c8e62f3 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:06.264716 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-323c8c0e-f0d1-4826-8794-0e464c8e62f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:06.286308 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c0fb9-2d5e-4b4e-a662-18098bfe5b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:06.287487 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c0fb9-2d5e-4b4e-a662-18098bfe5b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:06.287793 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c0fb9-2d5e-4b4e-a662-18098bfe5b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:06.288115 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c0fb9-2d5e-4b4e-a662-18098bfe5b52 admin admin] PATH_INFO: `/v3/projects/588f181c017b445e98d7d6521762e04f/users/e63b14e138844d4789ec63f5f4af1c69/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:06.305218 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c0fb9-2d5e-4b4e-a662-18098bfe5b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=588f181c017b445e98d7d6521762e04f, user_id=e63b14e138844d4789ec63f5f4af1c69, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:06.313692 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c0fb9-2d5e-4b4e-a662-18098bfe5b52 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:06.330195 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 934/1871] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:06 2022] PUT /identity/v3/projects/588f181c017b445e98d7d6521762e04f/users/e63b14e138844d4789ec63f5f4af1c69/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:06.331483 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c0fb9-2d5e-4b4e-a662-18098bfe5b52 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:06.333428 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-f04c0fb9-2d5e-4b4e-a662-18098bfe5b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:06.366206 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c8c0e-f0d1-4826-8794-0e464c8e62f3 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:06.405991 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c0fb9-2d5e-4b4e-a662-18098bfe5b52 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:06.412425 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44c963-ef20-4e3e-855d-bf53285d3a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:06.413871 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44c963-ef20-4e3e-855d-bf53285d3a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:06.414324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44c963-ef20-4e3e-855d-bf53285d3a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:06.414732 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44c963-ef20-4e3e-855d-bf53285d3a6b admin admin] PATH_INFO: `/v3/users/24c2638315bf4afdb36ec38236ffabdd` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:06.415999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44c963-ef20-4e3e-855d-bf53285d3a6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c2638315bf4afdb36ec38236ffabdd)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:06.417898 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44c963-ef20-4e3e-855d-bf53285d3a6b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:06.425689 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3798d8-43fc-4305-a5ba-e929bf4a306b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:06.426372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3798d8-43fc-4305-a5ba-e929bf4a306b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:06.427049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3798d8-43fc-4305-a5ba-e929bf4a306b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:06.427049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3798d8-43fc-4305-a5ba-e929bf4a306b admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:06.427663 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3798d8-43fc-4305-a5ba-e929bf4a306b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:06.429985 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3798d8-43fc-4305-a5ba-e929bf4a306b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:06.444149 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 938/1872] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:06.449045 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4eb31-af9c-4d37-8fe2-4d6693cc4295 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:06.449340 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4eb31-af9c-4d37-8fe2-4d6693cc4295 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:06.449620 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4eb31-af9c-4d37-8fe2-4d6693cc4295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:06.476957 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ba44c963-ef20-4e3e-855d-bf53285d3a6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c2638315bf4afdb36ec38236ffabdd'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:06.481340 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-0ea4eb31-af9c-4d37-8fe2-4d6693cc4295 None None] MFA Rules not processed for user `e63b14e138844d4789ec63f5f4af1c69`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:06.486544 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-0ea4eb31-af9c-4d37-8fe2-4d6693cc4295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:06.493791 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ba44c963-ef20-4e3e-855d-bf53285d3a6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c2638315bf4afdb36ec38236ffabdd'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:06.494530 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ba44c963-ef20-4e3e-855d-bf53285d3a6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c2638315bf4afdb36ec38236ffabdd'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:06.495164 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ba44c963-ef20-4e3e-855d-bf53285d3a6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c2638315bf4afdb36ec38236ffabdd'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:06.502598 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ba44c963-ef20-4e3e-855d-bf53285d3a6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c2638315bf4afdb36ec38236ffabdd'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:06.516062 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 935/1873] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:06 2022] DELETE /identity/v3/users/24c2638315bf4afdb36ec38236ffabdd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:06.517653 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44c963-ef20-4e3e-855d-bf53285d3a6b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:06.519289 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-ba44c963-ef20-4e3e-855d-bf53285d3a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:06.576483 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 939/1874] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:06.580853 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4eb31-af9c-4d37-8fe2-4d6693cc4295 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:06.582465 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-0ea4eb31-af9c-4d37-8fe2-4d6693cc4295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:06.604929 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4eb31-af9c-4d37-8fe2-4d6693cc4295 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:06.612015 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44c963-ef20-4e3e-855d-bf53285d3a6b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:06.614447 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bf9cc-a8c2-46e7-9291-1efa130e865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:06.615152 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bf9cc-a8c2-46e7-9291-1efa130e865b admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:06.615436 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bf9cc-a8c2-46e7-9291-1efa130e865b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:06.615776 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bf9cc-a8c2-46e7-9291-1efa130e865b admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:06.616568 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bf9cc-a8c2-46e7-9291-1efa130e865b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:06.617342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d610fa-a464-4ad3-b0c0-57754ae74322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:06.618396 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d610fa-a464-4ad3-b0c0-57754ae74322 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:06.618746 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d610fa-a464-4ad3-b0c0-57754ae74322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:06.619262 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d610fa-a464-4ad3-b0c0-57754ae74322 admin admin] PATH_INFO: `/v3/projects/3aab5ab8953544f98ea5cc72b9e2dda0/users/285da87794bf4c0a8336b80abfc2a47d/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:06.620636 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bf9cc-a8c2-46e7-9291-1efa130e865b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:06.636814 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d610fa-a464-4ad3-b0c0-57754ae74322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aab5ab8953544f98ea5cc72b9e2dda0, user_id=285da87794bf4c0a8336b80abfc2a47d, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:06.640006 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d610fa-a464-4ad3-b0c0-57754ae74322 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:06.658310 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 940/1875] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:06 2022] POST /identity/v3/projects => generated 367 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:16:06.659946 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 936/1876] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:06 2022] PUT /identity/v3/projects/3aab5ab8953544f98ea5cc72b9e2dda0/users/285da87794bf4c0a8336b80abfc2a47d/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:06.662646 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bf9cc-a8c2-46e7-9291-1efa130e865b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:06.671197 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8972fb-268e-4ee7-8c30-b55c3d720120 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:06.671539 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8972fb-268e-4ee7-8c30-b55c3d720120 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:06.671858 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8972fb-268e-4ee7-8c30-b55c3d720120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:06.718640 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-2f8972fb-268e-4ee7-8c30-b55c3d720120 None None] MFA Rules not processed for user `285da87794bf4c0a8336b80abfc2a47d`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:06.720443 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-2f8972fb-268e-4ee7-8c30-b55c3d720120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:06.755945 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bf9cc-a8c2-46e7-9291-1efa130e865b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:06.768672 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375760ac-835f-40e2-b3ab-504d35943772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:06.769830 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375760ac-835f-40e2-b3ab-504d35943772 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:06.769830 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375760ac-835f-40e2-b3ab-504d35943772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:06.770092 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375760ac-835f-40e2-b3ab-504d35943772 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:06.770721 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375760ac-835f-40e2-b3ab-504d35943772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:06.772729 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375760ac-835f-40e2-b3ab-504d35943772 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:06.802151 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 941/1877] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:06 2022] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:06.806837 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375760ac-835f-40e2-b3ab-504d35943772 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:06.829276 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375760ac-835f-40e2-b3ab-504d35943772 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:06.831733 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 937/1878] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:16:06.833790 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8972fb-268e-4ee7-8c30-b55c3d720120 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:06.841052 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-2f8972fb-268e-4ee7-8c30-b55c3d720120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:06.852088 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb0a93-9ef6-4034-b398-c4dc74d2bc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:06.852885 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb0a93-9ef6-4034-b398-c4dc74d2bc20 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:06.853172 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb0a93-9ef6-4034-b398-c4dc74d2bc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:06.853451 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb0a93-9ef6-4034-b398-c4dc74d2bc20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:06.854220 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb0a93-9ef6-4034-b398-c4dc74d2bc20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:06.855859 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb0a93-9ef6-4034-b398-c4dc74d2bc20 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:06.862527 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8972fb-268e-4ee7-8c30-b55c3d720120 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:06.870023 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9ff4c-4a7f-4862-9c9d-dd5fb1e6206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:06.871027 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ff4c-4a7f-4862-9c9d-dd5fb1e6206a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:06.871945 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ff4c-4a7f-4862-9c9d-dd5fb1e6206a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:06.872351 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ff4c-4a7f-4862-9c9d-dd5fb1e6206a admin admin] PATH_INFO: `/v3/projects/6dd15de646904533a30fe86e962363d0` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:06.873680 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9ff4c-4a7f-4862-9c9d-dd5fb1e6206a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dd15de646904533a30fe86e962363d0)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:06.874639 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 942/1879] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:06.875664 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb0a93-9ef6-4034-b398-c4dc74d2bc20 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:06.880464 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9ff4c-4a7f-4862-9c9d-dd5fb1e6206a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:06.891212 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb0a93-9ef6-4034-b398-c4dc74d2bc20 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:06.897086 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16110813-c7d2-491e-8964-2d784b195373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:06.898807 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16110813-c7d2-491e-8964-2d784b195373 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:06.899231 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16110813-c7d2-491e-8964-2d784b195373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:06.899572 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16110813-c7d2-491e-8964-2d784b195373 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:06.900505 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16110813-c7d2-491e-8964-2d784b195373 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:06.903522 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16110813-c7d2-491e-8964-2d784b195373 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:06.946804 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 943/1880] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:06 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:06.948929 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16110813-c7d2-491e-8964-2d784b195373 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:06.964960 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-8dd9ff4c-4a7f-4862-9c9d-dd5fb1e6206a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dd15de646904533a30fe86e962363d0', 'request_id': 'req-8dd9ff4c-4a7f-4862-9c9d-dd5fb1e6206a'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:06.977557 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-8dd9ff4c-4a7f-4862-9c9d-dd5fb1e6206a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dd15de646904533a30fe86e962363d0', 'request_id': 'req-8dd9ff4c-4a7f-4862-9c9d-dd5fb1e6206a'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:06.988783 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-8dd9ff4c-4a7f-4862-9c9d-dd5fb1e6206a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dd15de646904533a30fe86e962363d0', 'request_id': 'req-8dd9ff4c-4a7f-4862-9c9d-dd5fb1e6206a'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:07.019317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-8dd9ff4c-4a7f-4862-9c9d-dd5fb1e6206a admin admin] The token cache is being invalidate because project 6dd15de646904533a30fe86e962363d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:07.019920 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-8dd9ff4c-4a7f-4862-9c9d-dd5fb1e6206a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:07.020853 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-8dd9ff4c-4a7f-4862-9c9d-dd5fb1e6206a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:07.024788 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 938/1881] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:06 2022] DELETE /identity/v3/projects/6dd15de646904533a30fe86e962363d0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:07.026022 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9ff4c-4a7f-4862-9c9d-dd5fb1e6206a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:07.027602 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-8dd9ff4c-4a7f-4862-9c9d-dd5fb1e6206a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:07.050021 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16110813-c7d2-491e-8964-2d784b195373 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:07.055188 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dee4be-022b-4bf1-a4ff-5e287986bbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:07.056126 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dee4be-022b-4bf1-a4ff-5e287986bbaf admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:07.056466 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dee4be-022b-4bf1-a4ff-5e287986bbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:07.056674 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dee4be-022b-4bf1-a4ff-5e287986bbaf admin admin] PATH_INFO: `/v3/projects/a2138fda827d43fcb679afcd670868b9/users/4b1c633c9f2249738fecbc9bb741452e/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:07.074096 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dee4be-022b-4bf1-a4ff-5e287986bbaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2138fda827d43fcb679afcd670868b9, user_id=4b1c633c9f2249738fecbc9bb741452e, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:07.091848 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dee4be-022b-4bf1-a4ff-5e287986bbaf admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:07.100524 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9ff4c-4a7f-4862-9c9d-dd5fb1e6206a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:07.112128 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 944/1882] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:06 2022] PUT /identity/v3/projects/a2138fda827d43fcb679afcd670868b9/users/4b1c633c9f2249738fecbc9bb741452e/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:07.112128 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dee4be-022b-4bf1-a4ff-5e287986bbaf admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:07.112908 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d9dee4be-022b-4bf1-a4ff-5e287986bbaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:07.161514 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e14b7-ffc4-43da-9b20-50bc152f0753 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:07.162278 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e14b7-ffc4-43da-9b20-50bc152f0753 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:07.163061 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e14b7-ffc4-43da-9b20-50bc152f0753 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:07.163957 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e14b7-ffc4-43da-9b20-50bc152f0753 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:07.166337 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-af7e14b7-ffc4-43da-9b20-50bc152f0753 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:07.190759 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dee4be-022b-4bf1-a4ff-5e287986bbaf admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:07.195812 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d4da0-20b4-495e-b0e6-c3700f5d70dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:07.196838 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d4da0-20b4-495e-b0e6-c3700f5d70dd admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:07.197406 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d4da0-20b4-495e-b0e6-c3700f5d70dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:07.197789 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d4da0-20b4-495e-b0e6-c3700f5d70dd admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:07.198759 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d4da0-20b4-495e-b0e6-c3700f5d70dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:07.200995 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d4da0-20b4-495e-b0e6-c3700f5d70dd admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:07.224847 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 945/1883] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:07 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:07.231313 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbb943-aea5-4eb4-be1d-68f79c35ce11 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:07.232222 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbb943-aea5-4eb4-be1d-68f79c35ce11 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:07.232222 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbb943-aea5-4eb4-be1d-68f79c35ce11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:07.256749 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-f3bbb943-aea5-4eb4-be1d-68f79c35ce11 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:07.259173 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-f3bbb943-aea5-4eb4-be1d-68f79c35ce11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:07.268136 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e14b7-ffc4-43da-9b20-50bc152f0753 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:07.270382 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e14b7-ffc4-43da-9b20-50bc152f0753 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:07.271675 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 946/1884] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:07.273318 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbb943-aea5-4eb4-be1d-68f79c35ce11 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:07.276530 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-f3bbb943-aea5-4eb4-be1d-68f79c35ce11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:07.291888 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbb943-aea5-4eb4-be1d-68f79c35ce11 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:07.293771 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 939/1885] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:07.297102 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c5f9a-e497-459e-8340-b57215eeaee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:07.297774 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c5f9a-e497-459e-8340-b57215eeaee7 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:07.298056 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c5f9a-e497-459e-8340-b57215eeaee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:07.298333 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c5f9a-e497-459e-8340-b57215eeaee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:07.299083 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c5f9a-e497-459e-8340-b57215eeaee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:07.300850 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c5f9a-e497-459e-8340-b57215eeaee7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:07.313264 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e14b7-ffc4-43da-9b20-50bc152f0753 service cinder] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:07.313516 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 947/1886] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:07.316797 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325a4fe-b1cf-4cac-825e-cf2e48dd223c None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:07.316797 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325a4fe-b1cf-4cac-825e-cf2e48dd223c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:07.316797 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325a4fe-b1cf-4cac-825e-cf2e48dd223c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:07.335947 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-e325a4fe-b1cf-4cac-825e-cf2e48dd223c None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:07.337846 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e325a4fe-b1cf-4cac-825e-cf2e48dd223c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:07.350212 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e14b7-ffc4-43da-9b20-50bc152f0753 service cinder] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:07.367747 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec7ddd-9f89-4e86-b7b9-6065c00d9074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:07.368601 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec7ddd-9f89-4e86-b7b9-6065c00d9074 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:07.368900 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec7ddd-9f89-4e86-b7b9-6065c00d9074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:07.369290 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec7ddd-9f89-4e86-b7b9-6065c00d9074 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:07.369903 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec7ddd-9f89-4e86-b7b9-6065c00d9074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:07.371533 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec7ddd-9f89-4e86-b7b9-6065c00d9074 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:07.386280 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 940/1887] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:07.386945 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec7ddd-9f89-4e86-b7b9-6065c00d9074 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:07.390863 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 948/1888] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:07.397110 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325a4fe-b1cf-4cac-825e-cf2e48dd223c None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:07.398442 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec7ddd-9f89-4e86-b7b9-6065c00d9074 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:07.404103 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2dadc-b709-4921-95c0-79b761e348b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:07.405137 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2dadc-b709-4921-95c0-79b761e348b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:07.405425 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2dadc-b709-4921-95c0-79b761e348b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:07.405701 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2dadc-b709-4921-95c0-79b761e348b2 admin admin] PATH_INFO: `/v3/projects/a2138fda827d43fcb679afcd670868b9/users/4b1c633c9f2249738fecbc9bb741452e/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:07.407725 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2dadc-b709-4921-95c0-79b761e348b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2138fda827d43fcb679afcd670868b9, user_id=4b1c633c9f2249738fecbc9bb741452e, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:07.414518 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2dadc-b709-4921-95c0-79b761e348b2 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:07.417198 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325a4fe-b1cf-4cac-825e-cf2e48dd223c None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:07.423382 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091902d-8c85-492c-9be6-ff611d76cf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:07.424152 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091902d-8c85-492c-9be6-ff611d76cf5a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:07.424445 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091902d-8c85-492c-9be6-ff611d76cf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:07.424845 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091902d-8c85-492c-9be6-ff611d76cf5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:07.425943 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091902d-8c85-492c-9be6-ff611d76cf5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:07.429951 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091902d-8c85-492c-9be6-ff611d76cf5a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:07.445201 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 949/1889] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:07.445386 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 941/1890] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:07 2022] PUT /identity/v3/projects/a2138fda827d43fcb679afcd670868b9/users/4b1c633c9f2249738fecbc9bb741452e/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:07.446830 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2dadc-b709-4921-95c0-79b761e348b2 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:07.448667 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091902d-8c85-492c-9be6-ff611d76cf5a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:07.469846 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091902d-8c85-492c-9be6-ff611d76cf5a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:07.540766 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2dadc-b709-4921-95c0-79b761e348b2 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:07.550593 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e48ab-525c-4aaa-bbe0-69c54121abdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:07.555529 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e48ab-525c-4aaa-bbe0-69c54121abdb admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:07.556198 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e48ab-525c-4aaa-bbe0-69c54121abdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:07.556636 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e48ab-525c-4aaa-bbe0-69c54121abdb admin admin] PATH_INFO: `/v3/projects/9878e05da5a149029682d0775f4e2dd8/users/c918241a927f45b3a7ab95df56c45114/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:07.579806 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e48ab-525c-4aaa-bbe0-69c54121abdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9878e05da5a149029682d0775f4e2dd8, user_id=c918241a927f45b3a7ab95df56c45114, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:07.585652 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e48ab-525c-4aaa-bbe0-69c54121abdb admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:07.606411 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 942/1891] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:07 2022] PUT /identity/v3/projects/9878e05da5a149029682d0775f4e2dd8/users/c918241a927f45b3a7ab95df56c45114/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:07.618366 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c85f5-0d2c-49a3-84b0-c454509fd99b None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:07.618366 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c85f5-0d2c-49a3-84b0-c454509fd99b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:07.618366 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c85f5-0d2c-49a3-84b0-c454509fd99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:07.624519 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8101d6b-b75c-477c-a0af-ed0eb9cc1509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:07.625024 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8101d6b-b75c-477c-a0af-ed0eb9cc1509 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:07.625309 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8101d6b-b75c-477c-a0af-ed0eb9cc1509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:07.625996 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8101d6b-b75c-477c-a0af-ed0eb9cc1509 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:07.626755 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8101d6b-b75c-477c-a0af-ed0eb9cc1509 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:16:07.627108 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8101d6b-b75c-477c-a0af-ed0eb9cc1509 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:07.628920 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8101d6b-b75c-477c-a0af-ed0eb9cc1509 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:07.648328 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 950/1892] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:16:07.648328 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7c117-b852-4ab9-9d2a-d5a05e79ba62 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:07.648328 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7c117-b852-4ab9-9d2a-d5a05e79ba62 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:07.648328 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7c117-b852-4ab9-9d2a-d5a05e79ba62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:07.677468 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-0e0c85f5-0d2c-49a3-84b0-c454509fd99b None None] MFA Rules not processed for user `4b1c633c9f2249738fecbc9bb741452e`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:07.679370 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-0e0c85f5-0d2c-49a3-84b0-c454509fd99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:07.697409 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-efe7c117-b852-4ab9-9d2a-d5a05e79ba62 None None] MFA Rules not processed for user `c918241a927f45b3a7ab95df56c45114`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:07.698748 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-efe7c117-b852-4ab9-9d2a-d5a05e79ba62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:07.778219 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 951/1893] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:07.778219 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7c117-b852-4ab9-9d2a-d5a05e79ba62 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:07.778476 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 943/1894] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:07 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:07.779311 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c85f5-0d2c-49a3-84b0-c454509fd99b None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:07.850938 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7c117-b852-4ab9-9d2a-d5a05e79ba62 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:07.854218 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c85f5-0d2c-49a3-84b0-c454509fd99b None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:07.856852 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ce9cd-bb3d-42b9-bb95-48eba494ab05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:07.857683 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ce9cd-bb3d-42b9-bb95-48eba494ab05 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:07.858217 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ce9cd-bb3d-42b9-bb95-48eba494ab05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:07.858656 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ce9cd-bb3d-42b9-bb95-48eba494ab05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:07.858776 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ed914-990d-4c99-921a-c7620761d381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:07.859372 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ed914-990d-4c99-921a-c7620761d381 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:07.859659 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ed914-990d-4c99-921a-c7620761d381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:07.859960 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ed914-990d-4c99-921a-c7620761d381 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:07.860136 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ce9cd-bb3d-42b9-bb95-48eba494ab05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:07.860659 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ed914-990d-4c99-921a-c7620761d381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:07.862504 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ed914-990d-4c99-921a-c7620761d381 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:07.862627 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ce9cd-bb3d-42b9-bb95-48eba494ab05 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:07.892549 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 952/1895] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:07 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:07.892549 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ce9cd-bb3d-42b9-bb95-48eba494ab05 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:07.894466 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 944/1896] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:07 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:16:07.895269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ed914-990d-4c99-921a-c7620761d381 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:07.950205 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ce9cd-bb3d-42b9-bb95-48eba494ab05 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:07.962256 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ed914-990d-4c99-921a-c7620761d381 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:07.968405 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902550f-22bb-440c-a272-1bb8e1f77e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:07.969322 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902550f-22bb-440c-a272-1bb8e1f77e0e admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:07.969607 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902550f-22bb-440c-a272-1bb8e1f77e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:07.969882 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902550f-22bb-440c-a272-1bb8e1f77e0e admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:07.970588 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902550f-22bb-440c-a272-1bb8e1f77e0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:07.972507 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902550f-22bb-440c-a272-1bb8e1f77e0e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:07.995779 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 945/1897] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:07 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:07.995779 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902550f-22bb-440c-a272-1bb8e1f77e0e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:08.003602 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902550f-22bb-440c-a272-1bb8e1f77e0e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:08.003769 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaf042-6d82-454e-b149-d4938c8ce55c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:08.004330 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaf042-6d82-454e-b149-d4938c8ce55c service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:08.004616 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaf042-6d82-454e-b149-d4938c8ce55c service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:08.004890 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaf042-6d82-454e-b149-d4938c8ce55c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:08.009265 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2d794-8017-4311-ba32-9111381d933b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:08.009904 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2d794-8017-4311-ba32-9111381d933b admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:08.010188 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2d794-8017-4311-ba32-9111381d933b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:08.010461 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2d794-8017-4311-ba32-9111381d933b admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:08.011155 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2d794-8017-4311-ba32-9111381d933b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:08.013377 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2d794-8017-4311-ba32-9111381d933b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:08.033471 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 946/1898] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:07 2022] POST /identity/v3/users => generated 295 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:08.034267 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2d794-8017-4311-ba32-9111381d933b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:08.043617 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2d794-8017-4311-ba32-9111381d933b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:08.048182 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d844671-7594-4f91-b2c6-ec18c96d2d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:08.048807 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d844671-7594-4f91-b2c6-ec18c96d2d03 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:08.049184 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d844671-7594-4f91-b2c6-ec18c96d2d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:08.049466 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d844671-7594-4f91-b2c6-ec18c96d2d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:08.050185 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d844671-7594-4f91-b2c6-ec18c96d2d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:08.051740 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d844671-7594-4f91-b2c6-ec18c96d2d03 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:08.062074 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 947/1899] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:08.062865 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d844671-7594-4f91-b2c6-ec18c96d2d03 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:08.069105 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eaf042-6d82-454e-b149-d4938c8ce55c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:08.071555 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eaf042-6d82-454e-b149-d4938c8ce55c service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:08.072754 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d844671-7594-4f91-b2c6-ec18c96d2d03 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:08.078040 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590f3b4-9b58-4189-adfc-96da4bc27278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:08.078698 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590f3b4-9b58-4189-adfc-96da4bc27278 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:08.078979 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590f3b4-9b58-4189-adfc-96da4bc27278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:08.079312 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590f3b4-9b58-4189-adfc-96da4bc27278 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:08.080165 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590f3b4-9b58-4189-adfc-96da4bc27278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:08.081346 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 953/1900] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:07 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:08.082023 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaf042-6d82-454e-b149-d4938c8ce55c service cinder] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:08.088708 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590f3b4-9b58-4189-adfc-96da4bc27278 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:08.094646 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaf042-6d82-454e-b149-d4938c8ce55c service cinder] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:08.099211 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb634aef-f878-480e-8552-ce350c3666a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:08.099927 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb634aef-f878-480e-8552-ce350c3666a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:08.100210 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb634aef-f878-480e-8552-ce350c3666a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:08.100481 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb634aef-f878-480e-8552-ce350c3666a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:08.101153 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 948/1901] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:08.101633 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb634aef-f878-480e-8552-ce350c3666a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:08.103647 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb634aef-f878-480e-8552-ce350c3666a7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:08.105582 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590f3b4-9b58-4189-adfc-96da4bc27278 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:08.118183 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 954/1902] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:08.118307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590f3b4-9b58-4189-adfc-96da4bc27278 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:08.118998 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb634aef-f878-480e-8552-ce350c3666a7 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:08.122788 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda53e9-60e8-4b9f-9560-3774019268c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:08.123674 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda53e9-60e8-4b9f-9560-3774019268c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:08.124020 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda53e9-60e8-4b9f-9560-3774019268c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:08.124294 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda53e9-60e8-4b9f-9560-3774019268c1 admin admin] PATH_INFO: `/v3/projects/7442f50404fb4f4f9905d7e53b451582/users/95b9632d901042f7b4a0f1d0ab0285d4/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:08.129516 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb634aef-f878-480e-8552-ce350c3666a7 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:08.134907 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adf606-18af-4a4e-b7d3-1525aaf47022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:08.135781 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adf606-18af-4a4e-b7d3-1525aaf47022 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:08.136101 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adf606-18af-4a4e-b7d3-1525aaf47022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:08.136374 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adf606-18af-4a4e-b7d3-1525aaf47022 admin admin] PATH_INFO: `/v3/projects/773b5df79e9d4c93be774e4ba003574b/users/40d5966e6b9f49adaa9150522bda4edd/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:08.140365 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda53e9-60e8-4b9f-9560-3774019268c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7442f50404fb4f4f9905d7e53b451582, user_id=95b9632d901042f7b4a0f1d0ab0285d4, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:08.143005 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda53e9-60e8-4b9f-9560-3774019268c1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:08.151732 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31adf606-18af-4a4e-b7d3-1525aaf47022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=773b5df79e9d4c93be774e4ba003574b, user_id=40d5966e6b9f49adaa9150522bda4edd, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:08.154382 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31adf606-18af-4a4e-b7d3-1525aaf47022 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:08.155622 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 949/1903] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:08 2022] PUT /identity/v3/projects/7442f50404fb4f4f9905d7e53b451582/users/95b9632d901042f7b4a0f1d0ab0285d4/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:08.156533 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda53e9-60e8-4b9f-9560-3774019268c1 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:08.160055 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-7fda53e9-60e8-4b9f-9560-3774019268c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:08.167490 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 955/1904] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:08 2022] PUT /identity/v3/projects/773b5df79e9d4c93be774e4ba003574b/users/40d5966e6b9f49adaa9150522bda4edd/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:08.168118 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adf606-18af-4a4e-b7d3-1525aaf47022 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:08.221738 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda53e9-60e8-4b9f-9560-3774019268c1 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:08.228486 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adf606-18af-4a4e-b7d3-1525aaf47022 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:08.233149 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7698f-50db-4d5f-9469-7985648c0337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:08.233810 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7698f-50db-4d5f-9469-7985648c0337 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:08.234150 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7698f-50db-4d5f-9469-7985648c0337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:08.234424 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7698f-50db-4d5f-9469-7985648c0337 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:08.235334 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7698f-50db-4d5f-9469-7985648c0337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:08.237208 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7698f-50db-4d5f-9469-7985648c0337 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:08.252763 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 956/1905] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:08.252763 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08e3a5-52dc-43a5-84d1-125a24e54a29 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:08.252763 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08e3a5-52dc-43a5-84d1-125a24e54a29 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:08.252763 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08e3a5-52dc-43a5-84d1-125a24e54a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:08.279076 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-bf08e3a5-52dc-43a5-84d1-125a24e54a29 None None] MFA Rules not processed for user `40d5966e6b9f49adaa9150522bda4edd`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:08.279406 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3ff30-bc5f-4d68-9a3c-26880c04e8d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:08.280295 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-bf08e3a5-52dc-43a5-84d1-125a24e54a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:08.280408 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3ff30-bc5f-4d68-9a3c-26880c04e8d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:08.280664 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3ff30-bc5f-4d68-9a3c-26880c04e8d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:08.281011 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3ff30-bc5f-4d68-9a3c-26880c04e8d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:08.283492 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-6bc3ff30-bc5f-4d68-9a3c-26880c04e8d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:08.344660 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3ff30-bc5f-4d68-9a3c-26880c04e8d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:08.346820 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3ff30-bc5f-4d68-9a3c-26880c04e8d1 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:08.353481 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 957/1906] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:08.353481 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08e3a5-52dc-43a5-84d1-125a24e54a29 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:08.360819 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 950/1907] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:08.361558 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3ff30-bc5f-4d68-9a3c-26880c04e8d1 service cinder] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:08.363010 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08e3a5-52dc-43a5-84d1-125a24e54a29 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:08.369459 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e821b30-cbaf-464c-ba86-cc35330f375a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:08.370747 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e821b30-cbaf-464c-ba86-cc35330f375a admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:08.371007 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e821b30-cbaf-464c-ba86-cc35330f375a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:08.371298 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e821b30-cbaf-464c-ba86-cc35330f375a admin admin] PATH_INFO: `/v3/projects/7442f50404fb4f4f9905d7e53b451582/users/95b9632d901042f7b4a0f1d0ab0285d4/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:08.373618 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e821b30-cbaf-464c-ba86-cc35330f375a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7442f50404fb4f4f9905d7e53b451582, user_id=95b9632d901042f7b4a0f1d0ab0285d4, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:08.375566 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3ff30-bc5f-4d68-9a3c-26880c04e8d1 service cinder] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:08.376327 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e821b30-cbaf-464c-ba86-cc35330f375a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:08.382636 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f3a7a-04d0-40f1-a4ab-eea3d6069f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:08.383294 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f3a7a-04d0-40f1-a4ab-eea3d6069f24 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:08.383586 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f3a7a-04d0-40f1-a4ab-eea3d6069f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:08.383872 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f3a7a-04d0-40f1-a4ab-eea3d6069f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:08.384572 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f3a7a-04d0-40f1-a4ab-eea3d6069f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:08.387596 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f3a7a-04d0-40f1-a4ab-eea3d6069f24 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:08.405346 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 958/1908] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:08 2022] PUT /identity/v3/projects/7442f50404fb4f4f9905d7e53b451582/users/95b9632d901042f7b4a0f1d0ab0285d4/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:08.407541 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3f8f6-ec3a-40ae-8a75-2d9e5139e33b None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:08.408429 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3f8f6-ec3a-40ae-8a75-2d9e5139e33b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:08.408784 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3f8f6-ec3a-40ae-8a75-2d9e5139e33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:08.449151 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 951/1909] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:08 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:08.449342 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-e4c3f8f6-ec3a-40ae-8a75-2d9e5139e33b None None] MFA Rules not processed for user `95b9632d901042f7b4a0f1d0ab0285d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:08.449342 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e4c3f8f6-ec3a-40ae-8a75-2d9e5139e33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:08.450194 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f3a7a-04d0-40f1-a4ab-eea3d6069f24 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:08.580078 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f3a7a-04d0-40f1-a4ab-eea3d6069f24 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:08.586934 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd9912-6823-410a-891f-5677696effc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:08.587618 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd9912-6823-410a-891f-5677696effc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:08.587952 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd9912-6823-410a-891f-5677696effc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:08.588242 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd9912-6823-410a-891f-5677696effc4 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:08.589262 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd9912-6823-410a-891f-5677696effc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:08.591220 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd9912-6823-410a-891f-5677696effc4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:08.593082 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 959/1910] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:08.606795 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3f8f6-ec3a-40ae-8a75-2d9e5139e33b None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:08.635176 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 952/1911] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:08 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:16:08.639499 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd9912-6823-410a-891f-5677696effc4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:08.651908 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd9912-6823-410a-891f-5677696effc4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:08.658567 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd2804-a0cc-463e-b554-6d2ce53b8c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:08.659234 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd2804-a0cc-463e-b554-6d2ce53b8c14 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:08.659519 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd2804-a0cc-463e-b554-6d2ce53b8c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:08.660393 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd2804-a0cc-463e-b554-6d2ce53b8c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:08.661301 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd2804-a0cc-463e-b554-6d2ce53b8c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:08.664040 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd2804-a0cc-463e-b554-6d2ce53b8c14 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:08.688359 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 953/1912] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:08.691095 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd2804-a0cc-463e-b554-6d2ce53b8c14 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:08.705910 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3f8f6-ec3a-40ae-8a75-2d9e5139e33b None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:08.708931 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd2804-a0cc-463e-b554-6d2ce53b8c14 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:08.719354 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b85d9-2141-420a-bd75-70fb2db0dae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:08.720108 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b85d9-2141-420a-bd75-70fb2db0dae4 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:08.720396 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b85d9-2141-420a-bd75-70fb2db0dae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:08.720606 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b85d9-2141-420a-bd75-70fb2db0dae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:08.723080 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe8b80-f196-4fd2-ae03-c699ec9cd1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:08.725109 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe8b80-f196-4fd2-ae03-c699ec9cd1d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:08.725448 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe8b80-f196-4fd2-ae03-c699ec9cd1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:08.726194 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe8b80-f196-4fd2-ae03-c699ec9cd1d6 admin admin] PATH_INFO: `/v3/projects/fa167d821f7c4721af25f05f5ea46286/users/903edd32f6684989ad34b65d33d15ffb/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:08.732150 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b85d9-2141-420a-bd75-70fb2db0dae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:08.733789 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b85d9-2141-420a-bd75-70fb2db0dae4 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:08.750785 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 960/1913] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:08.770109 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe8b80-f196-4fd2-ae03-c699ec9cd1d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa167d821f7c4721af25f05f5ea46286, user_id=903edd32f6684989ad34b65d33d15ffb, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:08.777261 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe8b80-f196-4fd2-ae03-c699ec9cd1d6 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:08.795145 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 954/1914] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:08 2022] PUT /identity/v3/projects/fa167d821f7c4721af25f05f5ea46286/users/903edd32f6684989ad34b65d33d15ffb/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:08.799596 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b85d9-2141-420a-bd75-70fb2db0dae4 service cinder] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:08.811798 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe8b80-f196-4fd2-ae03-c699ec9cd1d6 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:08.814369 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b85d9-2141-420a-bd75-70fb2db0dae4 service cinder] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:08.919239 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230f92c-78e2-41f7-943f-7ff6a765a718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:08.920021 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230f92c-78e2-41f7-943f-7ff6a765a718 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:08.920235 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230f92c-78e2-41f7-943f-7ff6a765a718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:08.920507 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230f92c-78e2-41f7-943f-7ff6a765a718 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:08.921252 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230f92c-78e2-41f7-943f-7ff6a765a718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:08.923073 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230f92c-78e2-41f7-943f-7ff6a765a718 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:08.953918 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 961/1915] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:08.956930 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230f92c-78e2-41f7-943f-7ff6a765a718 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:08.982936 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230f92c-78e2-41f7-943f-7ff6a765a718 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:08.983142 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe8b80-f196-4fd2-ae03-c699ec9cd1d6 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:09.004905 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250b2e6-87d6-415e-b591-bfbb0d32e053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:09.004905 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250b2e6-87d6-415e-b591-bfbb0d32e053 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:09.004905 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250b2e6-87d6-415e-b591-bfbb0d32e053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:09.004905 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250b2e6-87d6-415e-b591-bfbb0d32e053 admin admin] PATH_INFO: `/v3/projects/fa167d821f7c4721af25f05f5ea46286/users/903edd32f6684989ad34b65d33d15ffb/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:09.005186 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250b2e6-87d6-415e-b591-bfbb0d32e053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa167d821f7c4721af25f05f5ea46286, user_id=903edd32f6684989ad34b65d33d15ffb, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:09.005254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5faa35b-6005-45a1-ad3a-7e7a1e423536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:09.005335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250b2e6-87d6-415e-b591-bfbb0d32e053 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:09.008408 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faa35b-6005-45a1-ad3a-7e7a1e423536 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:09.008963 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faa35b-6005-45a1-ad3a-7e7a1e423536 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:09.009455 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faa35b-6005-45a1-ad3a-7e7a1e423536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:09.011972 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-b5faa35b-6005-45a1-ad3a-7e7a1e423536 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:09.023889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 962/1916] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:08 2022] PUT /identity/v3/projects/fa167d821f7c4721af25f05f5ea46286/users/903edd32f6684989ad34b65d33d15ffb/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:09.034952 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a2d04-219d-4a38-90c1-992ffea80358 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:09.034952 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a2d04-219d-4a38-90c1-992ffea80358 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:09.035488 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a2d04-219d-4a38-90c1-992ffea80358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:09.066453 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-e23a2d04-219d-4a38-90c1-992ffea80358 None None] MFA Rules not processed for user `903edd32f6684989ad34b65d33d15ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:09.067933 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e23a2d04-219d-4a38-90c1-992ffea80358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:09.083366 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5faa35b-6005-45a1-ad3a-7e7a1e423536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:09.088387 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5faa35b-6005-45a1-ad3a-7e7a1e423536 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:09.105525 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 955/1917] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:09.168354 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 963/1918] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:09.221137 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5faa35b-6005-45a1-ad3a-7e7a1e423536 service cinder] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:09.231394 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5faa35b-6005-45a1-ad3a-7e7a1e423536 service cinder] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:09.284290 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da9613-8d65-4aa6-8ba4-13a50078e646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:09.285290 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da9613-8d65-4aa6-8ba4-13a50078e646 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:09.285777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da9613-8d65-4aa6-8ba4-13a50078e646 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:09.286304 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da9613-8d65-4aa6-8ba4-13a50078e646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:09.299478 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da9613-8d65-4aa6-8ba4-13a50078e646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:09.301004 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da9613-8d65-4aa6-8ba4-13a50078e646 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:09.316198 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 956/1919] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:09.346978 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a2d04-219d-4a38-90c1-992ffea80358 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:09.443201 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a2d04-219d-4a38-90c1-992ffea80358 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:09.448944 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c0e79-b6a0-4bc9-a77b-c9af41b653e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:09.449937 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c0e79-b6a0-4bc9-a77b-c9af41b653e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:09.450424 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c0e79-b6a0-4bc9-a77b-c9af41b653e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:09.450709 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c0e79-b6a0-4bc9-a77b-c9af41b653e4 admin admin] PATH_INFO: `/v3/users/40d5966e6b9f49adaa9150522bda4edd` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:09.452013 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c0e79-b6a0-4bc9-a77b-c9af41b653e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40d5966e6b9f49adaa9150522bda4edd)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:09.454615 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c0e79-b6a0-4bc9-a77b-c9af41b653e4 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:09.520208 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-184c0e79-b6a0-4bc9-a77b-c9af41b653e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40d5966e6b9f49adaa9150522bda4edd'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:09.539964 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-184c0e79-b6a0-4bc9-a77b-c9af41b653e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40d5966e6b9f49adaa9150522bda4edd'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:09.540714 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-184c0e79-b6a0-4bc9-a77b-c9af41b653e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40d5966e6b9f49adaa9150522bda4edd'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:09.550395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-184c0e79-b6a0-4bc9-a77b-c9af41b653e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40d5966e6b9f49adaa9150522bda4edd'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:09.551036 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-184c0e79-b6a0-4bc9-a77b-c9af41b653e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40d5966e6b9f49adaa9150522bda4edd'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:09.564850 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 964/1920] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:09 2022] DELETE /identity/v3/users/40d5966e6b9f49adaa9150522bda4edd => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:09.570253 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26822b02-2a18-4d97-8931-e3188d89ee46 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:09.570611 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26822b02-2a18-4d97-8931-e3188d89ee46 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:09.571191 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26822b02-2a18-4d97-8931-e3188d89ee46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:09.589980 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-26822b02-2a18-4d97-8931-e3188d89ee46 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:09.591182 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-26822b02-2a18-4d97-8931-e3188d89ee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:09.651669 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 957/1921] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:09.661324 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c0e79-b6a0-4bc9-a77b-c9af41b653e4 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:09.665461 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-184c0e79-b6a0-4bc9-a77b-c9af41b653e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:09.723153 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c0e79-b6a0-4bc9-a77b-c9af41b653e4 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:09.728065 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd9ca7-c0f5-4b06-8b8a-8a6aa4843d3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:09.728774 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd9ca7-c0f5-4b06-8b8a-8a6aa4843d3e service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:09.729063 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd9ca7-c0f5-4b06-8b8a-8a6aa4843d3e service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:09.729335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd9ca7-c0f5-4b06-8b8a-8a6aa4843d3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:09.740085 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd9ca7-c0f5-4b06-8b8a-8a6aa4843d3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:09.741798 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd9ca7-c0f5-4b06-8b8a-8a6aa4843d3e service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:09.752828 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 965/1922] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:10.203802 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26822b02-2a18-4d97-8931-e3188d89ee46 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:10.205269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-26822b02-2a18-4d97-8931-e3188d89ee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:10.225169 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26822b02-2a18-4d97-8931-e3188d89ee46 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:10.240975 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dde61-70e7-4dfd-850b-3c6e485b32d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:10.244124 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dde61-70e7-4dfd-850b-3c6e485b32d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:10.244364 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dde61-70e7-4dfd-850b-3c6e485b32d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:10.244653 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dde61-70e7-4dfd-850b-3c6e485b32d1 admin admin] PATH_INFO: `/v3/projects/773b5df79e9d4c93be774e4ba003574b` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:10.252756 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135dde61-70e7-4dfd-850b-3c6e485b32d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=773b5df79e9d4c93be774e4ba003574b)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:10.254684 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135dde61-70e7-4dfd-850b-3c6e485b32d1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:10.342863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-135dde61-70e7-4dfd-850b-3c6e485b32d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '773b5df79e9d4c93be774e4ba003574b', 'request_id': 'req-135dde61-70e7-4dfd-850b-3c6e485b32d1'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:10.352049 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-135dde61-70e7-4dfd-850b-3c6e485b32d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '773b5df79e9d4c93be774e4ba003574b', 'request_id': 'req-135dde61-70e7-4dfd-850b-3c6e485b32d1'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:10.359557 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-135dde61-70e7-4dfd-850b-3c6e485b32d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '773b5df79e9d4c93be774e4ba003574b', 'request_id': 'req-135dde61-70e7-4dfd-850b-3c6e485b32d1'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:10.373448 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-135dde61-70e7-4dfd-850b-3c6e485b32d1 admin admin] The token cache is being invalidate because project 773b5df79e9d4c93be774e4ba003574b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:10.373740 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-135dde61-70e7-4dfd-850b-3c6e485b32d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:10.374396 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-135dde61-70e7-4dfd-850b-3c6e485b32d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:10.378715 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 958/1923] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:10 2022] DELETE /identity/v3/projects/773b5df79e9d4c93be774e4ba003574b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:10.379956 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd9ca7-c0f5-4b06-8b8a-8a6aa4843d3e service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:10.390139 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd9ca7-c0f5-4b06-8b8a-8a6aa4843d3e service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:10.455560 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e61f4-ca0f-4310-ac2e-6aad995bc67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:10.456463 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e61f4-ca0f-4310-ac2e-6aad995bc67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:10.456708 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e61f4-ca0f-4310-ac2e-6aad995bc67e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:10.456991 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e61f4-ca0f-4310-ac2e-6aad995bc67e admin admin] PATH_INFO: `/v3/users/903edd32f6684989ad34b65d33d15ffb` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:10.458203 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e61f4-ca0f-4310-ac2e-6aad995bc67e admin admin] RBAC: Authorizing `identity:delete_user(user_id=903edd32f6684989ad34b65d33d15ffb)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:10.461013 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e61f4-ca0f-4310-ac2e-6aad995bc67e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:10.514483 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-0d4e61f4-ca0f-4310-ac2e-6aad995bc67e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '903edd32f6684989ad34b65d33d15ffb'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:10.528706 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-0d4e61f4-ca0f-4310-ac2e-6aad995bc67e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '903edd32f6684989ad34b65d33d15ffb'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:10.529879 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-0d4e61f4-ca0f-4310-ac2e-6aad995bc67e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '903edd32f6684989ad34b65d33d15ffb'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:10.539024 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-0d4e61f4-ca0f-4310-ac2e-6aad995bc67e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '903edd32f6684989ad34b65d33d15ffb'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:10.539659 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-0d4e61f4-ca0f-4310-ac2e-6aad995bc67e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '903edd32f6684989ad34b65d33d15ffb'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:10.555624 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 966/1924] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:10 2022] DELETE /identity/v3/users/903edd32f6684989ad34b65d33d15ffb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:10.851969 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dde61-70e7-4dfd-850b-3c6e485b32d1 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:10.853421 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-135dde61-70e7-4dfd-850b-3c6e485b32d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:10.866482 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dde61-70e7-4dfd-850b-3c6e485b32d1 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:10.951855 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa620e-2658-4c24-b6e0-73bf2e6961e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:10.953331 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa620e-2658-4c24-b6e0-73bf2e6961e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:10.953331 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa620e-2658-4c24-b6e0-73bf2e6961e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:10.953849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa620e-2658-4c24-b6e0-73bf2e6961e1 admin admin] PATH_INFO: `/v3/projects/fa167d821f7c4721af25f05f5ea46286` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:10.955540 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa620e-2658-4c24-b6e0-73bf2e6961e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa167d821f7c4721af25f05f5ea46286)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:10.958381 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa620e-2658-4c24-b6e0-73bf2e6961e1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:11.028356 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-12fa620e-2658-4c24-b6e0-73bf2e6961e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa167d821f7c4721af25f05f5ea46286', 'request_id': 'req-12fa620e-2658-4c24-b6e0-73bf2e6961e1'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:11.037558 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-12fa620e-2658-4c24-b6e0-73bf2e6961e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa167d821f7c4721af25f05f5ea46286', 'request_id': 'req-12fa620e-2658-4c24-b6e0-73bf2e6961e1'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:11.044693 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-12fa620e-2658-4c24-b6e0-73bf2e6961e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa167d821f7c4721af25f05f5ea46286', 'request_id': 'req-12fa620e-2658-4c24-b6e0-73bf2e6961e1'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:11.060946 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-12fa620e-2658-4c24-b6e0-73bf2e6961e1 admin admin] The token cache is being invalidate because project fa167d821f7c4721af25f05f5ea46286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:11.061716 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-12fa620e-2658-4c24-b6e0-73bf2e6961e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:11.062552 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-12fa620e-2658-4c24-b6e0-73bf2e6961e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:11.065222 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 959/1925] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:10 2022] DELETE /identity/v3/projects/fa167d821f7c4721af25f05f5ea46286 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:11.070004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a77f-1478-4e80-b23c-786df72108b0 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:11.070293 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a77f-1478-4e80-b23c-786df72108b0 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:11.070574 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a77f-1478-4e80-b23c-786df72108b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:11.095396 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-9a64a77f-1478-4e80-b23c-786df72108b0 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:11.096889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-9a64a77f-1478-4e80-b23c-786df72108b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:11.177798 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 967/1926] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:11.186879 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5fa2e-fecd-4d57-b0d2-622be7f3896b None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:11.187176 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5fa2e-fecd-4d57-b0d2-622be7f3896b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:11.187458 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5fa2e-fecd-4d57-b0d2-622be7f3896b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:11.207702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-c3c5fa2e-fecd-4d57-b0d2-622be7f3896b None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:11.208940 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-c3c5fa2e-fecd-4d57-b0d2-622be7f3896b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:11.217403 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 960/1927] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:11.221511 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64a77f-1478-4e80-b23c-786df72108b0 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:11.232141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64a77f-1478-4e80-b23c-786df72108b0 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:11.236884 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56e430-3591-4b7b-8890-669665bfb1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:11.237563 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56e430-3591-4b7b-8890-669665bfb1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:11.237817 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56e430-3591-4b7b-8890-669665bfb1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:11.238090 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56e430-3591-4b7b-8890-669665bfb1c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:11.239024 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56e430-3591-4b7b-8890-669665bfb1c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:16:11.239324 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56e430-3591-4b7b-8890-669665bfb1c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:11.241110 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56e430-3591-4b7b-8890-669665bfb1c8 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:11.253798 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 968/1928] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:16:11.256196 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152c13a-4172-46a9-9c8a-55bf88ac2dd1 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:11.256489 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152c13a-4172-46a9-9c8a-55bf88ac2dd1 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:11.256789 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152c13a-4172-46a9-9c8a-55bf88ac2dd1 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:11.258884 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56e430-3591-4b7b-8890-669665bfb1c8 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:11.261027 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 961/1929] 10.222.0.77 () {54 vars in 921 bytes} [Thu Feb 10 23:16:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:16:11.269558 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56e430-3591-4b7b-8890-669665bfb1c8 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:11.272722 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73381ece-8e21-4870-8e87-73fc455d57ca None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:11.273462 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73381ece-8e21-4870-8e87-73fc455d57ca None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:11.273978 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73381ece-8e21-4870-8e87-73fc455d57ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:11.275791 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ef701-c99f-4a03-98c7-a8b4977f2880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:11.277005 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ef701-c99f-4a03-98c7-a8b4977f2880 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:11.277343 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ef701-c99f-4a03-98c7-a8b4977f2880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:11.277630 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ef701-c99f-4a03-98c7-a8b4977f2880 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:11.278942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ef701-c99f-4a03-98c7-a8b4977f2880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:11.281442 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ef701-c99f-4a03-98c7-a8b4977f2880 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:11.297172 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-73381ece-8e21-4870-8e87-73fc455d57ca None None] MFA Rules not processed for user `551da2c9fab74cb8b14287a5634adb25`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:11.298595 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-73381ece-8e21-4870-8e87-73fc455d57ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:11.317677 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 969/1930] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:11 2022] POST /identity/v3/projects => generated 391 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:11.322372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ef701-c99f-4a03-98c7-a8b4977f2880 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:11.380026 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 962/1931] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Feb 10 23:16:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:11.415919 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ef701-c99f-4a03-98c7-a8b4977f2880 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:11.422313 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b83726-3073-41b1-bf99-8a03e1768e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:11.423139 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b83726-3073-41b1-bf99-8a03e1768e4b admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:11.423432 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b83726-3073-41b1-bf99-8a03e1768e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:11.423720 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b83726-3073-41b1-bf99-8a03e1768e4b admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:11.424475 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b83726-3073-41b1-bf99-8a03e1768e4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:11.427068 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b83726-3073-41b1-bf99-8a03e1768e4b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:11.466647 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 970/1932] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:11 2022] POST /identity/v3/users => generated 296 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:11.470263 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73381ece-8e21-4870-8e87-73fc455d57ca None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:11.485445 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73381ece-8e21-4870-8e87-73fc455d57ca None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:11.495981 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5b526-ebef-4f0e-b1db-cba6b42078ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:11.498454 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5b526-ebef-4f0e-b1db-cba6b42078ea admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:11.499120 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5b526-ebef-4f0e-b1db-cba6b42078ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:11.499874 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5b526-ebef-4f0e-b1db-cba6b42078ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:11.500938 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5b526-ebef-4f0e-b1db-cba6b42078ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:11.503017 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5b526-ebef-4f0e-b1db-cba6b42078ea admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:11.518211 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 963/1933] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:11.521908 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b83726-3073-41b1-bf99-8a03e1768e4b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:11.532592 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b83726-3073-41b1-bf99-8a03e1768e4b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:11.540280 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda11812-aea5-4866-a784-54763c9b8dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:11.541170 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda11812-aea5-4866-a784-54763c9b8dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:11.541599 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda11812-aea5-4866-a784-54763c9b8dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:11.542080 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda11812-aea5-4866-a784-54763c9b8dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:11.543468 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda11812-aea5-4866-a784-54763c9b8dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:11.545242 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda11812-aea5-4866-a784-54763c9b8dc1 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:11.560929 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5b526-ebef-4f0e-b1db-cba6b42078ea admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:11.568654 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-59b5b526-ebef-4f0e-b1db-cba6b42078ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:11.582953 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 971/1934] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:11.587960 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda11812-aea5-4866-a784-54763c9b8dc1 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:11.615450 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda11812-aea5-4866-a784-54763c9b8dc1 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:11.629571 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0d7f2-321b-439f-82f6-83cc55c3ae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:11.630485 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0d7f2-321b-439f-82f6-83cc55c3ae1d admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:11.630803 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0d7f2-321b-439f-82f6-83cc55c3ae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:11.631019 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0d7f2-321b-439f-82f6-83cc55c3ae1d admin admin] PATH_INFO: `/v3/projects/927d6e73c0594b8f9dc00570047d615e/users/8ea0215287a14520886c71aacaeebc1c/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:11.653042 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0d7f2-321b-439f-82f6-83cc55c3ae1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=927d6e73c0594b8f9dc00570047d615e, user_id=8ea0215287a14520886c71aacaeebc1c, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:11.657481 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0d7f2-321b-439f-82f6-83cc55c3ae1d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:11.684435 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 972/1935] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:11 2022] PUT /identity/v3/projects/927d6e73c0594b8f9dc00570047d615e/users/8ea0215287a14520886c71aacaeebc1c/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:11.697507 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa24296-8e04-4904-a9d9-f7c5cec32cc6 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:11.697923 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa24296-8e04-4904-a9d9-f7c5cec32cc6 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:11.698496 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa24296-8e04-4904-a9d9-f7c5cec32cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:11.731290 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5b526-ebef-4f0e-b1db-cba6b42078ea admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:11.746382 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-8aa24296-8e04-4904-a9d9-f7c5cec32cc6 None None] MFA Rules not processed for user `8ea0215287a14520886c71aacaeebc1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:11.748024 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-8aa24296-8e04-4904-a9d9-f7c5cec32cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:11.822133 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7997a-06c5-4141-bec4-9f004b221623 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:11.822867 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7997a-06c5-4141-bec4-9f004b221623 service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:11.823221 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7997a-06c5-4141-bec4-9f004b221623 service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:11.823564 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7997a-06c5-4141-bec4-9f004b221623 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:11.832415 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 973/1936] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:11.832778 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7997a-06c5-4141-bec4-9f004b221623 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:11.834524 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7997a-06c5-4141-bec4-9f004b221623 service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:11.837076 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa24296-8e04-4904-a9d9-f7c5cec32cc6 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:11.847215 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 964/1937] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:16:11.911072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa24296-8e04-4904-a9d9-f7c5cec32cc6 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:11.916276 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab349d7c-a2bc-4e93-be12-0abd2b421bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:11.916940 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab349d7c-a2bc-4e93-be12-0abd2b421bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:11.917273 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab349d7c-a2bc-4e93-be12-0abd2b421bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:11.917490 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab349d7c-a2bc-4e93-be12-0abd2b421bd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:11.918189 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab349d7c-a2bc-4e93-be12-0abd2b421bd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:11.920141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab349d7c-a2bc-4e93-be12-0abd2b421bd3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:11.955605 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7997a-06c5-4141-bec4-9f004b221623 service nova] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:11.960949 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 974/1938] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:11 2022] POST /identity/v3/projects => generated 391 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:11.969881 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7997a-06c5-4141-bec4-9f004b221623 service nova] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:12.068180 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7842c-e59b-4779-a78a-ade0f44b8d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:12.068956 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7842c-e59b-4779-a78a-ade0f44b8d8b admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:12.070142 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7842c-e59b-4779-a78a-ade0f44b8d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:12.070500 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7842c-e59b-4779-a78a-ade0f44b8d8b admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:12.071477 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7842c-e59b-4779-a78a-ade0f44b8d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:12.076391 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7842c-e59b-4779-a78a-ade0f44b8d8b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:12.118939 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 965/1939] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:11 2022] POST /identity/v3/users => generated 302 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:16:12.121211 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab349d7c-a2bc-4e93-be12-0abd2b421bd3 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:12.133725 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7842c-e59b-4779-a78a-ade0f44b8d8b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:12.137684 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab349d7c-a2bc-4e93-be12-0abd2b421bd3 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:12.141340 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-eaa7842c-e59b-4779-a78a-ade0f44b8d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:12.150117 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89b782-b16c-49b8-aed5-ad43be382394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:12.150944 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89b782-b16c-49b8-aed5-ad43be382394 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:12.151302 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89b782-b16c-49b8-aed5-ad43be382394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:12.151586 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89b782-b16c-49b8-aed5-ad43be382394 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:12.152370 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89b782-b16c-49b8-aed5-ad43be382394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:12.153956 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89b782-b16c-49b8-aed5-ad43be382394 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:12.161985 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7842c-e59b-4779-a78a-ade0f44b8d8b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:12.168102 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17560987-fd9e-4db9-997e-29b690650794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:12.169150 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560987-fd9e-4db9-997e-29b690650794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:12.169574 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560987-fd9e-4db9-997e-29b690650794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:12.170017 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560987-fd9e-4db9-997e-29b690650794 admin admin] PATH_INFO: `/v3/users/285da87794bf4c0a8336b80abfc2a47d` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:12.171783 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17560987-fd9e-4db9-997e-29b690650794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=285da87794bf4c0a8336b80abfc2a47d)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:12.174117 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17560987-fd9e-4db9-997e-29b690650794 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:12.174771 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 975/1940] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:16:12.179303 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89b782-b16c-49b8-aed5-ad43be382394 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:12.192418 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89b782-b16c-49b8-aed5-ad43be382394 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:12.198012 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093abbe-08c1-4bd2-8137-6f2252b58e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:12.198899 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093abbe-08c1-4bd2-8137-6f2252b58e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:12.199178 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093abbe-08c1-4bd2-8137-6f2252b58e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:12.199447 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093abbe-08c1-4bd2-8137-6f2252b58e29 admin admin] PATH_INFO: `/v3/projects/35c980fb2cdb4564bba8d34de6400ec6/users/a0c3af0dc83a4cd782fa72f2269fd7da/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:12.219346 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093abbe-08c1-4bd2-8137-6f2252b58e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35c980fb2cdb4564bba8d34de6400ec6, user_id=a0c3af0dc83a4cd782fa72f2269fd7da, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:12.223244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093abbe-08c1-4bd2-8137-6f2252b58e29 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:12.240507 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 976/1941] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:12 2022] PUT /identity/v3/projects/35c980fb2cdb4564bba8d34de6400ec6/users/a0c3af0dc83a4cd782fa72f2269fd7da/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:12.243599 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093abbe-08c1-4bd2-8137-6f2252b58e29 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:12.245324 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2093abbe-08c1-4bd2-8137-6f2252b58e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:12.259685 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-17560987-fd9e-4db9-997e-29b690650794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '285da87794bf4c0a8336b80abfc2a47d'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:12.278343 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-17560987-fd9e-4db9-997e-29b690650794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '285da87794bf4c0a8336b80abfc2a47d'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:12.279406 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-17560987-fd9e-4db9-997e-29b690650794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '285da87794bf4c0a8336b80abfc2a47d'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:12.280304 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-17560987-fd9e-4db9-997e-29b690650794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '285da87794bf4c0a8336b80abfc2a47d'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:12.297279 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-17560987-fd9e-4db9-997e-29b690650794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '285da87794bf4c0a8336b80abfc2a47d'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:12.314303 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 966/1942] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:12 2022] DELETE /identity/v3/users/285da87794bf4c0a8336b80abfc2a47d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:12.315571 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17560987-fd9e-4db9-997e-29b690650794 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:12.317500 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-17560987-fd9e-4db9-997e-29b690650794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:12.330143 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093abbe-08c1-4bd2-8137-6f2252b58e29 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:12.394250 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17560987-fd9e-4db9-997e-29b690650794 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:12.399374 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31433461-56e0-44c0-ad61-bb46046d8c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:12.399891 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31433461-56e0-44c0-ad61-bb46046d8c44 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:12.400176 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31433461-56e0-44c0-ad61-bb46046d8c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:12.400447 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31433461-56e0-44c0-ad61-bb46046d8c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:12.401190 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31433461-56e0-44c0-ad61-bb46046d8c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:12.402786 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31433461-56e0-44c0-ad61-bb46046d8c44 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:12.417186 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 967/1943] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:12.417186 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a209d2-a86e-4ba3-a8ad-f90513fbf858 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:12.417186 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a209d2-a86e-4ba3-a8ad-f90513fbf858 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:12.417186 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a209d2-a86e-4ba3-a8ad-f90513fbf858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:12.424564 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c99ba9-b468-464c-ab9c-6e6297085040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:12.425546 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c99ba9-b468-464c-ab9c-6e6297085040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:12.425828 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c99ba9-b468-464c-ab9c-6e6297085040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:12.426104 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c99ba9-b468-464c-ab9c-6e6297085040 admin admin] PATH_INFO: `/v3/users/e63b14e138844d4789ec63f5f4af1c69` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:12.427352 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c99ba9-b468-464c-ab9c-6e6297085040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e63b14e138844d4789ec63f5f4af1c69)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:12.429956 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c99ba9-b468-464c-ab9c-6e6297085040 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:12.435297 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-74a209d2-a86e-4ba3-a8ad-f90513fbf858 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:12.436759 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-74a209d2-a86e-4ba3-a8ad-f90513fbf858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:12.447325 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 968/1944] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:12.448017 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a209d2-a86e-4ba3-a8ad-f90513fbf858 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:12.458876 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a209d2-a86e-4ba3-a8ad-f90513fbf858 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:12.465900 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1a1ad-e41a-4fe5-9a92-732fb8f8fcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:12.466929 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1a1ad-e41a-4fe5-9a92-732fb8f8fcf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:12.467298 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1a1ad-e41a-4fe5-9a92-732fb8f8fcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:12.467709 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1a1ad-e41a-4fe5-9a92-732fb8f8fcf8 admin admin] PATH_INFO: `/v3/projects/35c980fb2cdb4564bba8d34de6400ec6/users/a0c3af0dc83a4cd782fa72f2269fd7da/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:12.469977 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1a1ad-e41a-4fe5-9a92-732fb8f8fcf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35c980fb2cdb4564bba8d34de6400ec6, user_id=a0c3af0dc83a4cd782fa72f2269fd7da, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:12.472861 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1a1ad-e41a-4fe5-9a92-732fb8f8fcf8 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:12.484383 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 969/1945] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:12 2022] PUT /identity/v3/projects/35c980fb2cdb4564bba8d34de6400ec6/users/a0c3af0dc83a4cd782fa72f2269fd7da/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:12.488125 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-d8c99ba9-b468-464c-ab9c-6e6297085040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e63b14e138844d4789ec63f5f4af1c69'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:12.488233 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1a1ad-e41a-4fe5-9a92-732fb8f8fcf8 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:12.488233 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-8af1a1ad-e41a-4fe5-9a92-732fb8f8fcf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:12.506080 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-d8c99ba9-b468-464c-ab9c-6e6297085040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e63b14e138844d4789ec63f5f4af1c69'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:12.506640 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-d8c99ba9-b468-464c-ab9c-6e6297085040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e63b14e138844d4789ec63f5f4af1c69'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:12.518249 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-d8c99ba9-b468-464c-ab9c-6e6297085040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e63b14e138844d4789ec63f5f4af1c69'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:12.519013 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-d8c99ba9-b468-464c-ab9c-6e6297085040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e63b14e138844d4789ec63f5f4af1c69'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:12.534554 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 977/1946] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:12 2022] DELETE /identity/v3/users/e63b14e138844d4789ec63f5f4af1c69 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:12.538755 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c9811-bc77-43fa-8f24-6af7a249ed3e None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:12.539261 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c9811-bc77-43fa-8f24-6af7a249ed3e None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:12.539703 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c9811-bc77-43fa-8f24-6af7a249ed3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:12.558370 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1a1ad-e41a-4fe5-9a92-732fb8f8fcf8 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:12.586066 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-546c9811-bc77-43fa-8f24-6af7a249ed3e None None] MFA Rules not processed for user `a0c3af0dc83a4cd782fa72f2269fd7da`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:12.587797 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-546c9811-bc77-43fa-8f24-6af7a249ed3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:12.642996 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85728b32-2f24-4ca7-97c5-143282465220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:12.643905 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85728b32-2f24-4ca7-97c5-143282465220 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:12.644291 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85728b32-2f24-4ca7-97c5-143282465220 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:12.644460 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85728b32-2f24-4ca7-97c5-143282465220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:12.652332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-85728b32-2f24-4ca7-97c5-143282465220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:12.699220 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 978/1947] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:12.701029 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b7809-1db1-4061-be72-554414d75ac5 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:12.701651 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b7809-1db1-4061-be72-554414d75ac5 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:12.702044 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b7809-1db1-4061-be72-554414d75ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:12.746034 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-2a3b7809-1db1-4061-be72-554414d75ac5 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:12.748326 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2a3b7809-1db1-4061-be72-554414d75ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:12.758340 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 979/1948] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:12.762447 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b7809-1db1-4061-be72-554414d75ac5 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:12.764789 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2a3b7809-1db1-4061-be72-554414d75ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:12.766973 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85728b32-2f24-4ca7-97c5-143282465220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:12.769114 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85728b32-2f24-4ca7-97c5-143282465220 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:12.781055 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 970/1949] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:12.782103 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85728b32-2f24-4ca7-97c5-143282465220 service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:12.783459 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-85728b32-2f24-4ca7-97c5-143282465220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:12.796770 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85728b32-2f24-4ca7-97c5-143282465220 service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:12.803480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a19e00-c8a7-4f12-8578-a4797f96c273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:12.805156 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a19e00-c8a7-4f12-8578-a4797f96c273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:12.805447 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a19e00-c8a7-4f12-8578-a4797f96c273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:12.805727 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a19e00-c8a7-4f12-8578-a4797f96c273 admin admin] PATH_INFO: `/v3/users/91ce6914e3bb4ffda309017f091b904f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:12.807124 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a19e00-c8a7-4f12-8578-a4797f96c273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91ce6914e3bb4ffda309017f091b904f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:12.809039 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a19e00-c8a7-4f12-8578-a4797f96c273 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:12.833768 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b7809-1db1-4061-be72-554414d75ac5 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:12.841176 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87359c79-851b-4d07-a36d-82f9949fba26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:12.842510 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87359c79-851b-4d07-a36d-82f9949fba26 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:12.842950 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87359c79-851b-4d07-a36d-82f9949fba26 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:12.843792 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87359c79-851b-4d07-a36d-82f9949fba26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:12.858889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87359c79-851b-4d07-a36d-82f9949fba26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:12.860423 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87359c79-851b-4d07-a36d-82f9949fba26 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:12.872663 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 980/1950] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:12.873789 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87359c79-851b-4d07-a36d-82f9949fba26 service cinder] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:12.873919 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-c7a19e00-c8a7-4f12-8578-a4797f96c273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91ce6914e3bb4ffda309017f091b904f'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:12.875305 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-87359c79-851b-4d07-a36d-82f9949fba26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:12.888654 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-c7a19e00-c8a7-4f12-8578-a4797f96c273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91ce6914e3bb4ffda309017f091b904f'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:12.889465 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-c7a19e00-c8a7-4f12-8578-a4797f96c273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91ce6914e3bb4ffda309017f091b904f'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:12.889894 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87359c79-851b-4d07-a36d-82f9949fba26 service cinder] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:12.890228 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-c7a19e00-c8a7-4f12-8578-a4797f96c273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91ce6914e3bb4ffda309017f091b904f'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:12.896291 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f0afa-1821-402a-9884-95d120396ca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:12.897088 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f0afa-1821-402a-9884-95d120396ca6 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:12.898162 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f0afa-1821-402a-9884-95d120396ca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:12.898791 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f0afa-1821-402a-9884-95d120396ca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:12.900744 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-c7a19e00-c8a7-4f12-8578-a4797f96c273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91ce6914e3bb4ffda309017f091b904f'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:12.901023 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-820f0afa-1821-402a-9884-95d120396ca6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:12.915701 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f0afa-1821-402a-9884-95d120396ca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:12.917304 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f0afa-1821-402a-9884-95d120396ca6 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:12.919594 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 971/1951] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:12 2022] DELETE /identity/v3/users/91ce6914e3bb4ffda309017f091b904f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:12.924433 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499a0b0-c2f3-4063-b0f6-82e9ad39f526 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:12.924942 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499a0b0-c2f3-4063-b0f6-82e9ad39f526 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:12.925470 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499a0b0-c2f3-4063-b0f6-82e9ad39f526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:12.932701 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 981/1952] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:12.949756 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f0afa-1821-402a-9884-95d120396ca6 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:12.955029 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-820f0afa-1821-402a-9884-95d120396ca6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:12.956550 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-f499a0b0-c2f3-4063-b0f6-82e9ad39f526 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:12.958959 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-f499a0b0-c2f3-4063-b0f6-82e9ad39f526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:12.977381 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f0afa-1821-402a-9884-95d120396ca6 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:13.064929 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3838bfb-1f72-4cbe-84a9-6d3cb144dc68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:13.065785 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3838bfb-1f72-4cbe-84a9-6d3cb144dc68 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:13.066444 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3838bfb-1f72-4cbe-84a9-6d3cb144dc68 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:13.066735 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3838bfb-1f72-4cbe-84a9-6d3cb144dc68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:13.069828 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d3838bfb-1f72-4cbe-84a9-6d3cb144dc68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:13.074646 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 972/1953] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:16:13.095289 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499a0b0-c2f3-4063-b0f6-82e9ad39f526 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:13.096974 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-f499a0b0-c2f3-4063-b0f6-82e9ad39f526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:13.164075 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3838bfb-1f72-4cbe-84a9-6d3cb144dc68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:13.166397 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3838bfb-1f72-4cbe-84a9-6d3cb144dc68 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:13.170070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499a0b0-c2f3-4063-b0f6-82e9ad39f526 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:13.185580 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d670526-a22a-4f44-8c11-5df98e1ed18e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:13.187707 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d670526-a22a-4f44-8c11-5df98e1ed18e service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:13.188039 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 982/1954] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:13.188451 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d670526-a22a-4f44-8c11-5df98e1ed18e service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:13.188832 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d670526-a22a-4f44-8c11-5df98e1ed18e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:13.201873 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d670526-a22a-4f44-8c11-5df98e1ed18e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:13.203453 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d670526-a22a-4f44-8c11-5df98e1ed18e service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:13.217915 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 973/1955] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:13.249115 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3838bfb-1f72-4cbe-84a9-6d3cb144dc68 service cinder] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:13.251003 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d3838bfb-1f72-4cbe-84a9-6d3cb144dc68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:13.269815 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3838bfb-1f72-4cbe-84a9-6d3cb144dc68 service cinder] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:13.277353 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd2e06-3369-4f37-a363-f73d275b9ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:13.278621 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd2e06-3369-4f37-a363-f73d275b9ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:13.279007 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd2e06-3369-4f37-a363-f73d275b9ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:13.279385 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd2e06-3369-4f37-a363-f73d275b9ad5 admin admin] PATH_INFO: `/v3/projects/3aab5ab8953544f98ea5cc72b9e2dda0` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:13.280960 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd2e06-3369-4f37-a363-f73d275b9ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aab5ab8953544f98ea5cc72b9e2dda0)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:13.283734 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd2e06-3369-4f37-a363-f73d275b9ad5 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:13.355996 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-cbdd2e06-3369-4f37-a363-f73d275b9ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aab5ab8953544f98ea5cc72b9e2dda0', 'request_id': 'req-cbdd2e06-3369-4f37-a363-f73d275b9ad5'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:13.368789 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-cbdd2e06-3369-4f37-a363-f73d275b9ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aab5ab8953544f98ea5cc72b9e2dda0', 'request_id': 'req-cbdd2e06-3369-4f37-a363-f73d275b9ad5'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:13.385303 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-cbdd2e06-3369-4f37-a363-f73d275b9ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aab5ab8953544f98ea5cc72b9e2dda0', 'request_id': 'req-cbdd2e06-3369-4f37-a363-f73d275b9ad5'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:13.409324 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-cbdd2e06-3369-4f37-a363-f73d275b9ad5 admin admin] The token cache is being invalidate because project 3aab5ab8953544f98ea5cc72b9e2dda0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:13.409783 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-cbdd2e06-3369-4f37-a363-f73d275b9ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:13.412272 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-cbdd2e06-3369-4f37-a363-f73d275b9ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:13.419296 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 983/1956] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:13 2022] DELETE /identity/v3/projects/3aab5ab8953544f98ea5cc72b9e2dda0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:13.420365 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d670526-a22a-4f44-8c11-5df98e1ed18e service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:13.432310 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd2e06-3369-4f37-a363-f73d275b9ad5 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:13.433553 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d670526-a22a-4f44-8c11-5df98e1ed18e service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:13.436156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-cbdd2e06-3369-4f37-a363-f73d275b9ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:13.551705 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972873b-3f67-4792-81e8-bdbb4885411d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:13.554258 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972873b-3f67-4792-81e8-bdbb4885411d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:13.554758 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972873b-3f67-4792-81e8-bdbb4885411d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:13.555209 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972873b-3f67-4792-81e8-bdbb4885411d admin admin] PATH_INFO: `/v3/users/c918241a927f45b3a7ab95df56c45114` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:13.556659 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972873b-3f67-4792-81e8-bdbb4885411d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c918241a927f45b3a7ab95df56c45114)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:13.560142 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd2e06-3369-4f37-a363-f73d275b9ad5 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:13.560602 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972873b-3f67-4792-81e8-bdbb4885411d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:13.567917 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0ff46-8014-47c7-a3d6-1af222bb94db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:13.570088 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0ff46-8014-47c7-a3d6-1af222bb94db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:13.570687 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0ff46-8014-47c7-a3d6-1af222bb94db admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:13.571050 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0ff46-8014-47c7-a3d6-1af222bb94db admin admin] PATH_INFO: `/v3/projects/588f181c017b445e98d7d6521762e04f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:13.573290 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0ff46-8014-47c7-a3d6-1af222bb94db admin admin] RBAC: Authorizing `identity:delete_project(project_id=588f181c017b445e98d7d6521762e04f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:13.580330 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0ff46-8014-47c7-a3d6-1af222bb94db admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:13.644617 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a972873b-3f67-4792-81e8-bdbb4885411d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c918241a927f45b3a7ab95df56c45114'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:13.663855 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a972873b-3f67-4792-81e8-bdbb4885411d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c918241a927f45b3a7ab95df56c45114'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:13.663855 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a972873b-3f67-4792-81e8-bdbb4885411d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c918241a927f45b3a7ab95df56c45114'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:13.663855 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a972873b-3f67-4792-81e8-bdbb4885411d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c918241a927f45b3a7ab95df56c45114'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:13.669113 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a972873b-3f67-4792-81e8-bdbb4885411d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c918241a927f45b3a7ab95df56c45114'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:13.687791 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 974/1957] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:13 2022] DELETE /identity/v3/users/c918241a927f45b3a7ab95df56c45114 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:13.738788 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7fa0ff46-8014-47c7-a3d6-1af222bb94db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '588f181c017b445e98d7d6521762e04f', 'request_id': 'req-7fa0ff46-8014-47c7-a3d6-1af222bb94db'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:13.748301 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7fa0ff46-8014-47c7-a3d6-1af222bb94db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '588f181c017b445e98d7d6521762e04f', 'request_id': 'req-7fa0ff46-8014-47c7-a3d6-1af222bb94db'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:13.764988 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7fa0ff46-8014-47c7-a3d6-1af222bb94db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '588f181c017b445e98d7d6521762e04f', 'request_id': 'req-7fa0ff46-8014-47c7-a3d6-1af222bb94db'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:13.781710 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7fa0ff46-8014-47c7-a3d6-1af222bb94db admin admin] The token cache is being invalidate because project 588f181c017b445e98d7d6521762e04f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:13.782204 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7fa0ff46-8014-47c7-a3d6-1af222bb94db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:13.783332 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7fa0ff46-8014-47c7-a3d6-1af222bb94db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:13.785053 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 984/1958] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:13 2022] DELETE /identity/v3/projects/588f181c017b445e98d7d6521762e04f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:13.790099 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972873b-3f67-4792-81e8-bdbb4885411d admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:13.791555 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a972873b-3f67-4792-81e8-bdbb4885411d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:13.871569 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972873b-3f67-4792-81e8-bdbb4885411d admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:13.955281 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0ff46-8014-47c7-a3d6-1af222bb94db admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:13.956852 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-7fa0ff46-8014-47c7-a3d6-1af222bb94db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:13.973658 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072059ca-841f-45de-a7a6-79129e264e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:13.974884 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072059ca-841f-45de-a7a6-79129e264e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:13.975261 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072059ca-841f-45de-a7a6-79129e264e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:13.976509 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072059ca-841f-45de-a7a6-79129e264e0b admin admin] PATH_INFO: `/v3/users/4b1c633c9f2249738fecbc9bb741452e` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:13.977986 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072059ca-841f-45de-a7a6-79129e264e0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b1c633c9f2249738fecbc9bb741452e)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:13.982179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072059ca-841f-45de-a7a6-79129e264e0b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:14.051040 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0ff46-8014-47c7-a3d6-1af222bb94db admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:14.059133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2ad56-2654-4ea8-b66a-6b7c255904e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:14.060521 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2ad56-2654-4ea8-b66a-6b7c255904e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:14.060921 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2ad56-2654-4ea8-b66a-6b7c255904e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:14.061262 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2ad56-2654-4ea8-b66a-6b7c255904e2 admin admin] PATH_INFO: `/v3/projects/da6d6a3d1e10439ba6d9019074c43427` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:14.063449 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2ad56-2654-4ea8-b66a-6b7c255904e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da6d6a3d1e10439ba6d9019074c43427)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:14.067509 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2ad56-2654-4ea8-b66a-6b7c255904e2 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:14.121507 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-072059ca-841f-45de-a7a6-79129e264e0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b1c633c9f2249738fecbc9bb741452e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.145707 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-072059ca-841f-45de-a7a6-79129e264e0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b1c633c9f2249738fecbc9bb741452e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.146458 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-072059ca-841f-45de-a7a6-79129e264e0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b1c633c9f2249738fecbc9bb741452e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.147264 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-072059ca-841f-45de-a7a6-79129e264e0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b1c633c9f2249738fecbc9bb741452e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.159764 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-072059ca-841f-45de-a7a6-79129e264e0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b1c633c9f2249738fecbc9bb741452e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.165989 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-eff2ad56-2654-4ea8-b66a-6b7c255904e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da6d6a3d1e10439ba6d9019074c43427', 'request_id': 'req-eff2ad56-2654-4ea8-b66a-6b7c255904e2'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.173109 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-eff2ad56-2654-4ea8-b66a-6b7c255904e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da6d6a3d1e10439ba6d9019074c43427', 'request_id': 'req-eff2ad56-2654-4ea8-b66a-6b7c255904e2'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.180488 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-eff2ad56-2654-4ea8-b66a-6b7c255904e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da6d6a3d1e10439ba6d9019074c43427', 'request_id': 'req-eff2ad56-2654-4ea8-b66a-6b7c255904e2'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.195033 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-eff2ad56-2654-4ea8-b66a-6b7c255904e2 admin admin] The token cache is being invalidate because project da6d6a3d1e10439ba6d9019074c43427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:14.195254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 975/1959] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:13 2022] DELETE /identity/v3/users/4b1c633c9f2249738fecbc9bb741452e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:14.196388 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-eff2ad56-2654-4ea8-b66a-6b7c255904e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.197384 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-eff2ad56-2654-4ea8-b66a-6b7c255904e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.200926 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 985/1960] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:13 2022] DELETE /identity/v3/projects/da6d6a3d1e10439ba6d9019074c43427 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:14.205703 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072059ca-841f-45de-a7a6-79129e264e0b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:14.207727 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-072059ca-841f-45de-a7a6-79129e264e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:14.212423 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2ad56-2654-4ea8-b66a-6b7c255904e2 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:14.213818 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-eff2ad56-2654-4ea8-b66a-6b7c255904e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:14.301436 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072059ca-841f-45de-a7a6-79129e264e0b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:14.307568 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f4fd4-4ecb-46f8-8598-1d0a9f84115f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:14.308473 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f4fd4-4ecb-46f8-8598-1d0a9f84115f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:14.308968 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f4fd4-4ecb-46f8-8598-1d0a9f84115f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:14.309076 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f4fd4-4ecb-46f8-8598-1d0a9f84115f admin admin] PATH_INFO: `/v3/users/084638e7a6fc49d3840dec3c0f9bd83f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:14.310308 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f4fd4-4ecb-46f8-8598-1d0a9f84115f admin admin] RBAC: Authorizing `identity:delete_user(user_id=084638e7a6fc49d3840dec3c0f9bd83f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:14.312269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f4fd4-4ecb-46f8-8598-1d0a9f84115f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:14.345479 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2ad56-2654-4ea8-b66a-6b7c255904e2 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:14.352136 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1d279-f432-4e8c-87e6-b8d407867f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:14.355162 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1d279-f432-4e8c-87e6-b8d407867f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:14.356586 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1d279-f432-4e8c-87e6-b8d407867f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:14.357042 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1d279-f432-4e8c-87e6-b8d407867f72 admin admin] PATH_INFO: `/v3/projects/9878e05da5a149029682d0775f4e2dd8` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:14.358612 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1d279-f432-4e8c-87e6-b8d407867f72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9878e05da5a149029682d0775f4e2dd8)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:14.361653 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1d279-f432-4e8c-87e6-b8d407867f72 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:14.384489 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4a6f4fd4-4ecb-46f8-8598-1d0a9f84115f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '084638e7a6fc49d3840dec3c0f9bd83f'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.424684 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4a6f4fd4-4ecb-46f8-8598-1d0a9f84115f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '084638e7a6fc49d3840dec3c0f9bd83f'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.427372 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4a6f4fd4-4ecb-46f8-8598-1d0a9f84115f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '084638e7a6fc49d3840dec3c0f9bd83f'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.427372 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4a6f4fd4-4ecb-46f8-8598-1d0a9f84115f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '084638e7a6fc49d3840dec3c0f9bd83f'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.442927 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4a6f4fd4-4ecb-46f8-8598-1d0a9f84115f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '084638e7a6fc49d3840dec3c0f9bd83f'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.468234 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a0b1d279-f432-4e8c-87e6-b8d407867f72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9878e05da5a149029682d0775f4e2dd8', 'request_id': 'req-a0b1d279-f432-4e8c-87e6-b8d407867f72'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.470231 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 976/1961] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:14 2022] DELETE /identity/v3/users/084638e7a6fc49d3840dec3c0f9bd83f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:14.485836 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a0b1d279-f432-4e8c-87e6-b8d407867f72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9878e05da5a149029682d0775f4e2dd8', 'request_id': 'req-a0b1d279-f432-4e8c-87e6-b8d407867f72'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.494992 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a0b1d279-f432-4e8c-87e6-b8d407867f72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9878e05da5a149029682d0775f4e2dd8', 'request_id': 'req-a0b1d279-f432-4e8c-87e6-b8d407867f72'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.509086 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a0b1d279-f432-4e8c-87e6-b8d407867f72 admin admin] The token cache is being invalidate because project 9878e05da5a149029682d0775f4e2dd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:14.509469 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a0b1d279-f432-4e8c-87e6-b8d407867f72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.511712 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a0b1d279-f432-4e8c-87e6-b8d407867f72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.513554 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 986/1962] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:14 2022] DELETE /identity/v3/projects/9878e05da5a149029682d0775f4e2dd8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:14.517954 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f4fd4-4ecb-46f8-8598-1d0a9f84115f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:14.519412 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-4a6f4fd4-4ecb-46f8-8598-1d0a9f84115f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:14.595868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f4fd4-4ecb-46f8-8598-1d0a9f84115f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:14.601664 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7cf79-59cd-4dc6-90d9-8f6ec082fa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:14.602540 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7cf79-59cd-4dc6-90d9-8f6ec082fa20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:14.602818 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7cf79-59cd-4dc6-90d9-8f6ec082fa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:14.603091 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7cf79-59cd-4dc6-90d9-8f6ec082fa20 admin admin] PATH_INFO: `/v3/users/95b9632d901042f7b4a0f1d0ab0285d4` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:14.604347 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7cf79-59cd-4dc6-90d9-8f6ec082fa20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95b9632d901042f7b4a0f1d0ab0285d4)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:14.606933 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7cf79-59cd-4dc6-90d9-8f6ec082fa20 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:14.679924 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1bb7cf79-59cd-4dc6-90d9-8f6ec082fa20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95b9632d901042f7b4a0f1d0ab0285d4'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.697192 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1bb7cf79-59cd-4dc6-90d9-8f6ec082fa20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95b9632d901042f7b4a0f1d0ab0285d4'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.697941 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1bb7cf79-59cd-4dc6-90d9-8f6ec082fa20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95b9632d901042f7b4a0f1d0ab0285d4'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.698563 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1bb7cf79-59cd-4dc6-90d9-8f6ec082fa20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95b9632d901042f7b4a0f1d0ab0285d4'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.708323 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1bb7cf79-59cd-4dc6-90d9-8f6ec082fa20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95b9632d901042f7b4a0f1d0ab0285d4'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:14.715554 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1d279-f432-4e8c-87e6-b8d407867f72 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:14.718457 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a0b1d279-f432-4e8c-87e6-b8d407867f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:14.724143 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 977/1963] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:14 2022] DELETE /identity/v3/users/95b9632d901042f7b4a0f1d0ab0285d4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:14.812910 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1d279-f432-4e8c-87e6-b8d407867f72 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:14.884530 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7cf79-59cd-4dc6-90d9-8f6ec082fa20 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:14.887500 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-1bb7cf79-59cd-4dc6-90d9-8f6ec082fa20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:14.908667 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c400953-175e-491a-8317-3171077bb7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:14.910477 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c400953-175e-491a-8317-3171077bb7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:14.910790 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c400953-175e-491a-8317-3171077bb7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:14.911073 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c400953-175e-491a-8317-3171077bb7bd admin admin] PATH_INFO: `/v3/projects/a2138fda827d43fcb679afcd670868b9` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:14.914606 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c400953-175e-491a-8317-3171077bb7bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2138fda827d43fcb679afcd670868b9)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:14.919711 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c400953-175e-491a-8317-3171077bb7bd admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:15.043970 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7cf79-59cd-4dc6-90d9-8f6ec082fa20 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:15.057992 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-8c400953-175e-491a-8317-3171077bb7bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2138fda827d43fcb679afcd670868b9', 'request_id': 'req-8c400953-175e-491a-8317-3171077bb7bd'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:15.076489 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-8c400953-175e-491a-8317-3171077bb7bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2138fda827d43fcb679afcd670868b9', 'request_id': 'req-8c400953-175e-491a-8317-3171077bb7bd'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:15.092953 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-8c400953-175e-491a-8317-3171077bb7bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2138fda827d43fcb679afcd670868b9', 'request_id': 'req-8c400953-175e-491a-8317-3171077bb7bd'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:15.124378 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-8c400953-175e-491a-8317-3171077bb7bd admin admin] The token cache is being invalidate because project a2138fda827d43fcb679afcd670868b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:15.124682 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-8c400953-175e-491a-8317-3171077bb7bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:15.126810 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-8c400953-175e-491a-8317-3171077bb7bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:15.128781 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 987/1964] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:14 2022] DELETE /identity/v3/projects/a2138fda827d43fcb679afcd670868b9 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:15.133455 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad8b15-ce2f-490d-ac64-dd41340b4751 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:15.133984 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad8b15-ce2f-490d-ac64-dd41340b4751 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:15.134412 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad8b15-ce2f-490d-ac64-dd41340b4751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:15.176267 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-ddad8b15-ce2f-490d-ac64-dd41340b4751 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:15.178060 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-ddad8b15-ce2f-490d-ac64-dd41340b4751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:15.181543 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2574b-150b-4938-8b28-21b71fcb3aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:15.182485 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2574b-150b-4938-8b28-21b71fcb3aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:15.182777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2574b-150b-4938-8b28-21b71fcb3aee admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:15.183065 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2574b-150b-4938-8b28-21b71fcb3aee admin admin] PATH_INFO: `/v3/projects/82031c8832f143048c5928a837f84309` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:15.185484 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2574b-150b-4938-8b28-21b71fcb3aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=82031c8832f143048c5928a837f84309)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:15.187696 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2574b-150b-4938-8b28-21b71fcb3aee admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:15.210712 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 988/1965] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:15.220896 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753c5f1-cb76-4869-ba17-59de2723e16e None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:15.221395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753c5f1-cb76-4869-ba17-59de2723e16e None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:15.222461 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753c5f1-cb76-4869-ba17-59de2723e16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:15.257480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-29f2574b-150b-4938-8b28-21b71fcb3aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82031c8832f143048c5928a837f84309', 'request_id': 'req-29f2574b-150b-4938-8b28-21b71fcb3aee'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:15.271881 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-b753c5f1-cb76-4869-ba17-59de2723e16e None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:15.272259 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-29f2574b-150b-4938-8b28-21b71fcb3aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82031c8832f143048c5928a837f84309', 'request_id': 'req-29f2574b-150b-4938-8b28-21b71fcb3aee'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:15.275376 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-b753c5f1-cb76-4869-ba17-59de2723e16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:15.282331 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-29f2574b-150b-4938-8b28-21b71fcb3aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82031c8832f143048c5928a837f84309', 'request_id': 'req-29f2574b-150b-4938-8b28-21b71fcb3aee'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:15.303604 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-29f2574b-150b-4938-8b28-21b71fcb3aee admin admin] The token cache is being invalidate because project 82031c8832f143048c5928a837f84309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:15.304176 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-29f2574b-150b-4938-8b28-21b71fcb3aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:15.304946 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-29f2574b-150b-4938-8b28-21b71fcb3aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:15.306552 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 978/1966] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:14 2022] DELETE /identity/v3/projects/82031c8832f143048c5928a837f84309 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:15.313312 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96fc7b-3dd3-4ae6-98dd-f6f36bdfdb02 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:15.313676 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96fc7b-3dd3-4ae6-98dd-f6f36bdfdb02 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:15.314039 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96fc7b-3dd3-4ae6-98dd-f6f36bdfdb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:15.344816 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-9a96fc7b-3dd3-4ae6-98dd-f6f36bdfdb02 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:15.346360 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-9a96fc7b-3dd3-4ae6-98dd-f6f36bdfdb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:15.434124 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 989/1967] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:15.435399 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753c5f1-cb76-4869-ba17-59de2723e16e None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:15.446239 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753c5f1-cb76-4869-ba17-59de2723e16e None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:15.448792 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 979/1968] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:15.456997 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe4276-eecf-44ae-a424-744dac077fe7 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:15.457307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe4276-eecf-44ae-a424-744dac077fe7 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:15.457588 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe4276-eecf-44ae-a424-744dac077fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:15.469448 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc968f-6c31-40ce-844a-ec377189e799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:15.470244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc968f-6c31-40ce-844a-ec377189e799 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:15.470624 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc968f-6c31-40ce-844a-ec377189e799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:15.471023 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc968f-6c31-40ce-844a-ec377189e799 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:15.472028 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc968f-6c31-40ce-844a-ec377189e799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:16:15.472436 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc968f-6c31-40ce-844a-ec377189e799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:15.493241 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc968f-6c31-40ce-844a-ec377189e799 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:15.501966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-ccfe4276-eecf-44ae-a424-744dac077fe7 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:15.501966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-ccfe4276-eecf-44ae-a424-744dac077fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:15.524842 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 980/1969] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:16:15.525823 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe4276-eecf-44ae-a424-744dac077fe7 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:15.527809 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-ccfe4276-eecf-44ae-a424-744dac077fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:15.531963 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 990/1970] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:16:15.531963 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc968f-6c31-40ce-844a-ec377189e799 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:15.541172 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc968f-6c31-40ce-844a-ec377189e799 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:15.555301 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe4276-eecf-44ae-a424-744dac077fe7 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:15.560859 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f9ce2-5cc5-43d2-992f-bc8bd285b383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:15.561615 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f9ce2-5cc5-43d2-992f-bc8bd285b383 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:15.561909 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f9ce2-5cc5-43d2-992f-bc8bd285b383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:15.562193 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f9ce2-5cc5-43d2-992f-bc8bd285b383 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:15.563082 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f9ce2-5cc5-43d2-992f-bc8bd285b383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:16:15.563414 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f9ce2-5cc5-43d2-992f-bc8bd285b383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:15.565049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f9ce2-5cc5-43d2-992f-bc8bd285b383 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:15.565168 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d368d-e35f-4bc0-9402-e0574513f5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:15.566142 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d368d-e35f-4bc0-9402-e0574513f5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:15.566427 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d368d-e35f-4bc0-9402-e0574513f5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:15.566707 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d368d-e35f-4bc0-9402-e0574513f5b4 admin admin] PATH_INFO: `/v3/projects/7442f50404fb4f4f9905d7e53b451582` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:15.568215 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d368d-e35f-4bc0-9402-e0574513f5b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7442f50404fb4f4f9905d7e53b451582)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:15.570267 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d368d-e35f-4bc0-9402-e0574513f5b4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:15.579798 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 991/1971] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:16:15.580912 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f9ce2-5cc5-43d2-992f-bc8bd285b383 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:15.592536 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f9ce2-5cc5-43d2-992f-bc8bd285b383 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:15.597338 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1d485-c4f0-4e41-87df-43518f4e1c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:15.597985 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1d485-c4f0-4e41-87df-43518f4e1c6b admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:15.598267 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1d485-c4f0-4e41-87df-43518f4e1c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:15.598540 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1d485-c4f0-4e41-87df-43518f4e1c6b admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:15.599250 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1d485-c4f0-4e41-87df-43518f4e1c6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:15.602322 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1d485-c4f0-4e41-87df-43518f4e1c6b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:15.623602 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-491d368d-e35f-4bc0-9402-e0574513f5b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7442f50404fb4f4f9905d7e53b451582', 'request_id': 'req-491d368d-e35f-4bc0-9402-e0574513f5b4'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:15.635199 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-491d368d-e35f-4bc0-9402-e0574513f5b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7442f50404fb4f4f9905d7e53b451582', 'request_id': 'req-491d368d-e35f-4bc0-9402-e0574513f5b4'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:15.636615 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 992/1972] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:15 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:15.640504 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1d485-c4f0-4e41-87df-43518f4e1c6b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:15.643172 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-491d368d-e35f-4bc0-9402-e0574513f5b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7442f50404fb4f4f9905d7e53b451582', 'request_id': 'req-491d368d-e35f-4bc0-9402-e0574513f5b4'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:15.661204 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-491d368d-e35f-4bc0-9402-e0574513f5b4 admin admin] The token cache is being invalidate because project 7442f50404fb4f4f9905d7e53b451582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:15.661762 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-491d368d-e35f-4bc0-9402-e0574513f5b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:15.662430 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-491d368d-e35f-4bc0-9402-e0574513f5b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:15.664726 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 981/1973] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:15 2022] DELETE /identity/v3/projects/7442f50404fb4f4f9905d7e53b451582 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:15.669164 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d368d-e35f-4bc0-9402-e0574513f5b4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:15.669164 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-491d368d-e35f-4bc0-9402-e0574513f5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:15.709663 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1d485-c4f0-4e41-87df-43518f4e1c6b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:15.714623 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f0a87-8b77-4d93-b292-80eb4506a819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:15.715283 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f0a87-8b77-4d93-b292-80eb4506a819 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:15.715572 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f0a87-8b77-4d93-b292-80eb4506a819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:15.715870 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f0a87-8b77-4d93-b292-80eb4506a819 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:15.716578 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f0a87-8b77-4d93-b292-80eb4506a819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:15.718761 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f0a87-8b77-4d93-b292-80eb4506a819 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:15.738165 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d368d-e35f-4bc0-9402-e0574513f5b4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:15.744733 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8e799-dd1f-4d98-810e-0f006ed56ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:15.745273 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8e799-dd1f-4d98-810e-0f006ed56ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:15.745564 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8e799-dd1f-4d98-810e-0f006ed56ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:15.745839 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8e799-dd1f-4d98-810e-0f006ed56ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:15.749898 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8e799-dd1f-4d98-810e-0f006ed56ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:15.750072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 993/1974] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:15 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:15.750072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3a503-d86b-41ff-9c59-9c6452c8ad31 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:15.750072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3a503-d86b-41ff-9c59-9c6452c8ad31 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:15.750270 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8e799-dd1f-4d98-810e-0f006ed56ab4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:15.750340 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3a503-d86b-41ff-9c59-9c6452c8ad31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:15.769690 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-0cc3a503-d86b-41ff-9c59-9c6452c8ad31 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:15.770882 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-0cc3a503-d86b-41ff-9c59-9c6452c8ad31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:15.774714 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 982/1975] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:15 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:15.774714 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8e799-dd1f-4d98-810e-0f006ed56ab4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:15.775664 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-08b8e799-dd1f-4d98-810e-0f006ed56ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:15.787628 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8e799-dd1f-4d98-810e-0f006ed56ab4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:15.844785 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 994/1976] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:15.844785 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3a503-d86b-41ff-9c59-9c6452c8ad31 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:15.848797 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3a503-d86b-41ff-9c59-9c6452c8ad31 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:15.854563 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe0612-2fb7-46ee-8c9a-cdadb4bb50cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:15.855332 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe0612-2fb7-46ee-8c9a-cdadb4bb50cc admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:15.855718 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe0612-2fb7-46ee-8c9a-cdadb4bb50cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:15.856160 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe0612-2fb7-46ee-8c9a-cdadb4bb50cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:15.856997 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe0612-2fb7-46ee-8c9a-cdadb4bb50cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:15.858584 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe0612-2fb7-46ee-8c9a-cdadb4bb50cc admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:15.867102 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aeb44-8f56-478f-971c-ce99143a1ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:15.868143 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aeb44-8f56-478f-971c-ce99143a1ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:15.868431 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aeb44-8f56-478f-971c-ce99143a1ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:15.868707 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aeb44-8f56-478f-971c-ce99143a1ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:15.869594 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5aeb44-8f56-478f-971c-ce99143a1ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:15.873915 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 995/1977] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:15.874046 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5aeb44-8f56-478f-971c-ce99143a1ab6 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:15.874126 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6dda-aa29-4a7d-bb12-2f47bb998412 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:15.874126 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6dda-aa29-4a7d-bb12-2f47bb998412 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:15.874126 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6dda-aa29-4a7d-bb12-2f47bb998412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:15.895296 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-e84d6dda-aa29-4a7d-bb12-2f47bb998412 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:15.896931 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e84d6dda-aa29-4a7d-bb12-2f47bb998412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:15.899505 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 983/1978] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:15 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:15.900648 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aeb44-8f56-478f-971c-ce99143a1ab6 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:15.911394 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aeb44-8f56-478f-971c-ce99143a1ab6 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:15.915972 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 996/1979] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:15.916901 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53620b3-fcf3-4a69-a2df-f84fb18989d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:15.917571 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53620b3-fcf3-4a69-a2df-f84fb18989d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:15.917907 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53620b3-fcf3-4a69-a2df-f84fb18989d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:15.918231 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53620b3-fcf3-4a69-a2df-f84fb18989d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:15.918398 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d6dda-aa29-4a7d-bb12-2f47bb998412 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:15.919041 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53620b3-fcf3-4a69-a2df-f84fb18989d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:15.921011 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53620b3-fcf3-4a69-a2df-f84fb18989d5 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:15.935553 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 984/1980] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:15.935553 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53620b3-fcf3-4a69-a2df-f84fb18989d5 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:15.935764 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d6dda-aa29-4a7d-bb12-2f47bb998412 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:15.939574 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba6fb9-873f-467c-b673-b0f3c5d62e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:15.940626 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba6fb9-873f-467c-b673-b0f3c5d62e85 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:15.940996 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba6fb9-873f-467c-b673-b0f3c5d62e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:15.941442 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba6fb9-873f-467c-b673-b0f3c5d62e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:15.942232 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba6fb9-873f-467c-b673-b0f3c5d62e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:15.943381 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53620b3-fcf3-4a69-a2df-f84fb18989d5 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:15.943853 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba6fb9-873f-467c-b673-b0f3c5d62e85 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:15.948689 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133168c-b939-431f-bea1-c98008f38ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:15.949337 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133168c-b939-431f-bea1-c98008f38ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:15.949627 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133168c-b939-431f-bea1-c98008f38ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:15.949908 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133168c-b939-431f-bea1-c98008f38ac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:15.950641 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133168c-b939-431f-bea1-c98008f38ac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:16:15.950950 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133168c-b939-431f-bea1-c98008f38ac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:15.952570 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133168c-b939-431f-bea1-c98008f38ac8 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:15.958374 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 997/1981] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:15.958374 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba6fb9-873f-467c-b673-b0f3c5d62e85 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:15.967995 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 985/1982] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:16:15.967995 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133168c-b939-431f-bea1-c98008f38ac8 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:15.968220 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba6fb9-873f-467c-b673-b0f3c5d62e85 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:15.972231 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f58b43-165a-4556-878c-160a110094e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:15.973334 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f58b43-165a-4556-878c-160a110094e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:15.973620 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f58b43-165a-4556-878c-160a110094e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:15.973901 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f58b43-165a-4556-878c-160a110094e3 admin admin] PATH_INFO: `/v3/projects/fe55b1ac711d4bd1b803f1d27e338fe6/users/e61954f407cc4bcca43e2b6491d7d82a/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:15.977472 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133168c-b939-431f-bea1-c98008f38ac8 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:15.982156 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd2bad-9154-4ff6-9454-08d2bbbc815e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:15.982731 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd2bad-9154-4ff6-9454-08d2bbbc815e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:15.983009 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd2bad-9154-4ff6-9454-08d2bbbc815e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:15.983295 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd2bad-9154-4ff6-9454-08d2bbbc815e admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:15.984023 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd2bad-9154-4ff6-9454-08d2bbbc815e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:15.985592 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd2bad-9154-4ff6-9454-08d2bbbc815e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:15.989520 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f58b43-165a-4556-878c-160a110094e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe55b1ac711d4bd1b803f1d27e338fe6, user_id=e61954f407cc4bcca43e2b6491d7d82a, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:15.993059 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f58b43-165a-4556-878c-160a110094e3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:15.996884 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 986/1983] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:16.000719 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd2bad-9154-4ff6-9454-08d2bbbc815e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:16.009340 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 998/1984] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:15 2022] PUT /identity/v3/projects/fe55b1ac711d4bd1b803f1d27e338fe6/users/e61954f407cc4bcca43e2b6491d7d82a/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:16.010319 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f58b43-165a-4556-878c-160a110094e3 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:16.011237 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd2bad-9154-4ff6-9454-08d2bbbc815e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:16.082681 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f58b43-165a-4556-878c-160a110094e3 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:16.087249 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb23ab8-2dcc-4b1a-ba25-6a093c07c98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:16.090208 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb23ab8-2dcc-4b1a-ba25-6a093c07c98f admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:16.090604 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb23ab8-2dcc-4b1a-ba25-6a093c07c98f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:16.090962 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb23ab8-2dcc-4b1a-ba25-6a093c07c98f admin admin] PATH_INFO: `/v3/projects/438f2f7584cc43648f582c8d86029ceb/users/89d1245535f64c21b3797fbb5bfb7a2a/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:16.096984 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728c969-2c67-4730-87e3-c2d8c7a359e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:16.097904 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728c969-2c67-4730-87e3-c2d8c7a359e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:16.098602 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728c969-2c67-4730-87e3-c2d8c7a359e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:16.098997 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728c969-2c67-4730-87e3-c2d8c7a359e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:16.099731 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728c969-2c67-4730-87e3-c2d8c7a359e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:16.102920 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728c969-2c67-4730-87e3-c2d8c7a359e6 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:16.117942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb23ab8-2dcc-4b1a-ba25-6a093c07c98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=438f2f7584cc43648f582c8d86029ceb, user_id=89d1245535f64c21b3797fbb5bfb7a2a, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:16.121411 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb23ab8-2dcc-4b1a-ba25-6a093c07c98f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:16.139740 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 999/1985] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:16 2022] PUT /identity/v3/projects/438f2f7584cc43648f582c8d86029ceb/users/89d1245535f64c21b3797fbb5bfb7a2a/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:16.146899 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35550460-dcef-4517-a2e1-b5f43430e778 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:16.147207 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35550460-dcef-4517-a2e1-b5f43430e778 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:16.147990 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35550460-dcef-4517-a2e1-b5f43430e778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:16.164523 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 987/1986] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:15 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:16.166254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82120da5-10e9-4905-b5cd-07a23edee797 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:16.166751 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82120da5-10e9-4905-b5cd-07a23edee797 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:16.167327 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82120da5-10e9-4905-b5cd-07a23edee797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:16.200379 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-82120da5-10e9-4905-b5cd-07a23edee797 None None] MFA Rules not processed for user `89d1245535f64c21b3797fbb5bfb7a2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:16.202117 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-82120da5-10e9-4905-b5cd-07a23edee797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:16.218729 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-35550460-dcef-4517-a2e1-b5f43430e778 None None] MFA Rules not processed for user `e61954f407cc4bcca43e2b6491d7d82a`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:16.220481 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-35550460-dcef-4517-a2e1-b5f43430e778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:16.284438 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 988/1987] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:16.285286 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82120da5-10e9-4905-b5cd-07a23edee797 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:16.299560 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1000/1988] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:16.304392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35550460-dcef-4517-a2e1-b5f43430e778 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:16.356628 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82120da5-10e9-4905-b5cd-07a23edee797 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:16.365970 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b0d37-f7fd-4083-8640-10dbeeaf89b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:16.368028 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b0d37-f7fd-4083-8640-10dbeeaf89b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:16.368463 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b0d37-f7fd-4083-8640-10dbeeaf89b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:16.368886 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b0d37-f7fd-4083-8640-10dbeeaf89b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:16.369832 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b0d37-f7fd-4083-8640-10dbeeaf89b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:16.372227 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b0d37-f7fd-4083-8640-10dbeeaf89b6 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:16.384746 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35550460-dcef-4517-a2e1-b5f43430e778 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:16.392456 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5ff61-ad03-4e21-819f-efb986367076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:16.393252 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5ff61-ad03-4e21-819f-efb986367076 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:16.393596 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5ff61-ad03-4e21-819f-efb986367076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:16.393921 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5ff61-ad03-4e21-819f-efb986367076 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:16.394696 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5ff61-ad03-4e21-819f-efb986367076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:16.399307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 989/1989] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:16 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:16.399307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b0d37-f7fd-4083-8640-10dbeeaf89b6 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:16.399563 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5ff61-ad03-4e21-819f-efb986367076 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:16.410394 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b0d37-f7fd-4083-8640-10dbeeaf89b6 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:16.417951 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b68e7-72e3-4ed9-b1a0-e283bfe63afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:16.418621 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b68e7-72e3-4ed9-b1a0-e283bfe63afa admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:16.418962 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b68e7-72e3-4ed9-b1a0-e283bfe63afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:16.419178 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b68e7-72e3-4ed9-b1a0-e283bfe63afa admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:16.419998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b68e7-72e3-4ed9-b1a0-e283bfe63afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:16.422974 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b68e7-72e3-4ed9-b1a0-e283bfe63afa admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:16.433475 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1001/1990] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:16 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:16.433475 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5ff61-ad03-4e21-819f-efb986367076 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:16.453696 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 990/1991] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:16 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:16.454223 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b68e7-72e3-4ed9-b1a0-e283bfe63afa admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:16.508280 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5ff61-ad03-4e21-819f-efb986367076 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:16.545187 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b68e7-72e3-4ed9-b1a0-e283bfe63afa admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:16.552862 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56283c-01c6-44f8-b595-e5c8e2ab5855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:16.554133 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56283c-01c6-44f8-b595-e5c8e2ab5855 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:16.554506 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56283c-01c6-44f8-b595-e5c8e2ab5855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:16.554770 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56283c-01c6-44f8-b595-e5c8e2ab5855 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:16.555470 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56283c-01c6-44f8-b595-e5c8e2ab5855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:16.557570 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56283c-01c6-44f8-b595-e5c8e2ab5855 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:16.576093 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48e5a5-8f60-4392-8efc-cbcb9d4f81e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:16.576774 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48e5a5-8f60-4392-8efc-cbcb9d4f81e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:16.577058 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48e5a5-8f60-4392-8efc-cbcb9d4f81e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:16.577336 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48e5a5-8f60-4392-8efc-cbcb9d4f81e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:16.578082 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48e5a5-8f60-4392-8efc-cbcb9d4f81e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:16.579684 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48e5a5-8f60-4392-8efc-cbcb9d4f81e2 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:16.581872 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 991/1992] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:16 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:16.582915 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56283c-01c6-44f8-b595-e5c8e2ab5855 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:16.593704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56283c-01c6-44f8-b595-e5c8e2ab5855 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:16.598383 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd2135-790c-4578-94bd-d98c7e9253d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:16.599078 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd2135-790c-4578-94bd-d98c7e9253d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:16.599364 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd2135-790c-4578-94bd-d98c7e9253d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:16.599640 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd2135-790c-4578-94bd-d98c7e9253d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:16.601028 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd2135-790c-4578-94bd-d98c7e9253d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:16.602900 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1002/1993] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:16.603126 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd2135-790c-4578-94bd-d98c7e9253d4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:16.608079 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48e5a5-8f60-4392-8efc-cbcb9d4f81e2 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:16.619933 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48e5a5-8f60-4392-8efc-cbcb9d4f81e2 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:16.626008 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96d017-b3cc-4b00-a341-6ffab34bc7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:16.626676 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96d017-b3cc-4b00-a341-6ffab34bc7fa admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:16.626965 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96d017-b3cc-4b00-a341-6ffab34bc7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:16.627242 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96d017-b3cc-4b00-a341-6ffab34bc7fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:16.630696 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 992/1994] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:16 2022] POST /identity/v3/users => generated 299 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:16.630828 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96d017-b3cc-4b00-a341-6ffab34bc7fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:16.630828 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96d017-b3cc-4b00-a341-6ffab34bc7fa admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:16.632587 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd2135-790c-4578-94bd-d98c7e9253d4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:16.644750 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1003/1995] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:16.645718 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96d017-b3cc-4b00-a341-6ffab34bc7fa admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:16.648494 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd2135-790c-4578-94bd-d98c7e9253d4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:16.661465 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96d017-b3cc-4b00-a341-6ffab34bc7fa admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:16.663611 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba870fd-d760-4e57-812f-4e841f717fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:16.664326 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba870fd-d760-4e57-812f-4e841f717fcb admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:16.664706 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba870fd-d760-4e57-812f-4e841f717fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:16.664879 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba870fd-d760-4e57-812f-4e841f717fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:16.665649 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba870fd-d760-4e57-812f-4e841f717fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:16.667399 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba870fd-d760-4e57-812f-4e841f717fcb admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:16.675560 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a5c0e-ac4f-41f3-baba-4bfcc25036e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:16.676405 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a5c0e-ac4f-41f3-baba-4bfcc25036e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:16.676797 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a5c0e-ac4f-41f3-baba-4bfcc25036e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:16.677228 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a5c0e-ac4f-41f3-baba-4bfcc25036e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:16.678252 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a5c0e-ac4f-41f3-baba-4bfcc25036e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:16.680830 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a5c0e-ac4f-41f3-baba-4bfcc25036e7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:16.684999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 993/1996] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:16.684999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba870fd-d760-4e57-812f-4e841f717fcb admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:16.693546 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1004/1997] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:16.695262 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a5c0e-ac4f-41f3-baba-4bfcc25036e7 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:16.702652 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba870fd-d760-4e57-812f-4e841f717fcb admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:16.708244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a5c0e-ac4f-41f3-baba-4bfcc25036e7 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:16.708820 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989d855-0429-4a70-8f74-ac3571e2435f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:16.709724 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989d855-0429-4a70-8f74-ac3571e2435f admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:16.710074 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989d855-0429-4a70-8f74-ac3571e2435f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:16.710466 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989d855-0429-4a70-8f74-ac3571e2435f admin admin] PATH_INFO: `/v3/projects/5a298687a6594cbbb419f1d81d044f85/users/887cdfb834084f728adf42ffeb6bd4f8/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:16.713933 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e936d3-595e-41e4-a92d-650c9292a180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:16.714956 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e936d3-595e-41e4-a92d-650c9292a180 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:16.715307 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e936d3-595e-41e4-a92d-650c9292a180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:16.715647 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e936d3-595e-41e4-a92d-650c9292a180 admin admin] PATH_INFO: `/v3/projects/ec04e31dabad408189c872bac820dfe8/users/1aaec9a53369405b8cae785e221e6f3c/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:16.729868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989d855-0429-4a70-8f74-ac3571e2435f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a298687a6594cbbb419f1d81d044f85, user_id=887cdfb834084f728adf42ffeb6bd4f8, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:16.733799 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989d855-0429-4a70-8f74-ac3571e2435f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:16.734373 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e936d3-595e-41e4-a92d-650c9292a180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec04e31dabad408189c872bac820dfe8, user_id=1aaec9a53369405b8cae785e221e6f3c, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:16.737569 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e936d3-595e-41e4-a92d-650c9292a180 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:16.757599 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1005/1998] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:16 2022] PUT /identity/v3/projects/ec04e31dabad408189c872bac820dfe8/users/1aaec9a53369405b8cae785e221e6f3c/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:16.768373 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e936d3-595e-41e4-a92d-650c9292a180 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:16.768467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 994/1999] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:16 2022] PUT /identity/v3/projects/5a298687a6594cbbb419f1d81d044f85/users/887cdfb834084f728adf42ffeb6bd4f8/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:16.768467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989d855-0429-4a70-8f74-ac3571e2435f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:16.824826 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e936d3-595e-41e4-a92d-650c9292a180 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:16.827494 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989d855-0429-4a70-8f74-ac3571e2435f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:16.829516 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8690cd-0510-4e60-a279-504d133f4a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:16.830401 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8690cd-0510-4e60-a279-504d133f4a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:16.830686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8690cd-0510-4e60-a279-504d133f4a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:16.830966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8690cd-0510-4e60-a279-504d133f4a8e admin admin] PATH_INFO: `/v3/projects/9b662525020c48d8b36c4b54bc77ed12/users/09d68bf6f29744dda2cf2d65171a3ca7/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:16.832335 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126141a-6728-4fae-bf93-cb00529da3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:16.832999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126141a-6728-4fae-bf93-cb00529da3eb admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:16.833276 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126141a-6728-4fae-bf93-cb00529da3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:16.833550 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126141a-6728-4fae-bf93-cb00529da3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:16.834276 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126141a-6728-4fae-bf93-cb00529da3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:16.836134 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126141a-6728-4fae-bf93-cb00529da3eb admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:16.848935 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 995/2000] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:16.849132 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8690cd-0510-4e60-a279-504d133f4a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b662525020c48d8b36c4b54bc77ed12, user_id=09d68bf6f29744dda2cf2d65171a3ca7, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:16.849236 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9699953-d3bb-42f8-afd7-9a4b78657c6b None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:16.849236 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9699953-d3bb-42f8-afd7-9a4b78657c6b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:16.849236 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9699953-d3bb-42f8-afd7-9a4b78657c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:16.849976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8690cd-0510-4e60-a279-504d133f4a8e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:16.863868 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1006/2001] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:16 2022] PUT /identity/v3/projects/9b662525020c48d8b36c4b54bc77ed12/users/09d68bf6f29744dda2cf2d65171a3ca7/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:16.864754 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8690cd-0510-4e60-a279-504d133f4a8e admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:16.877806 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-d9699953-d3bb-42f8-afd7-9a4b78657c6b None None] MFA Rules not processed for user `1aaec9a53369405b8cae785e221e6f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:16.879024 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-d9699953-d3bb-42f8-afd7-9a4b78657c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:16.925174 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8690cd-0510-4e60-a279-504d133f4a8e admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:16.930367 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc9a4a-cc98-4f90-b1f0-dda48974397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:16.931239 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc9a4a-cc98-4f90-b1f0-dda48974397d admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:16.931538 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc9a4a-cc98-4f90-b1f0-dda48974397d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:16.931828 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc9a4a-cc98-4f90-b1f0-dda48974397d admin admin] PATH_INFO: `/v3/projects/5a298687a6594cbbb419f1d81d044f85/users/887cdfb834084f728adf42ffeb6bd4f8/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:16.933908 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc9a4a-cc98-4f90-b1f0-dda48974397d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a298687a6594cbbb419f1d81d044f85, user_id=887cdfb834084f728adf42ffeb6bd4f8, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:16.937032 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc9a4a-cc98-4f90-b1f0-dda48974397d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:16.941230 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 996/2002] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:16.941842 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9699953-d3bb-42f8-afd7-9a4b78657c6b None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:16.953103 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1007/2003] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:16 2022] PUT /identity/v3/projects/5a298687a6594cbbb419f1d81d044f85/users/887cdfb834084f728adf42ffeb6bd4f8/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:16.954011 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc9a4a-cc98-4f90-b1f0-dda48974397d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:16.955277 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9699953-d3bb-42f8-afd7-9a4b78657c6b None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:16.964165 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-3fdc9a4a-cc98-4f90-b1f0-dda48974397d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:17.024610 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc99373-f966-4a48-badb-6d0b6499280b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:17.024830 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc9a4a-cc98-4f90-b1f0-dda48974397d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:17.025366 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc99373-f966-4a48-badb-6d0b6499280b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:17.025719 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc99373-f966-4a48-badb-6d0b6499280b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:17.027926 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc99373-f966-4a48-badb-6d0b6499280b admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:17.027926 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc99373-f966-4a48-badb-6d0b6499280b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:17.028605 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc99373-f966-4a48-badb-6d0b6499280b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:17.036073 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef795f26-991d-4a23-83c4-1bb80fc0adbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:17.036846 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef795f26-991d-4a23-83c4-1bb80fc0adbd service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:17.037194 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef795f26-991d-4a23-83c4-1bb80fc0adbd service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:17.037560 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef795f26-991d-4a23-83c4-1bb80fc0adbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:17.040951 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 997/2004] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:17.042113 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fb8e2-7924-4451-8258-46a020f34b48 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:17.042368 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fb8e2-7924-4451-8258-46a020f34b48 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:17.042661 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fb8e2-7924-4451-8258-46a020f34b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:17.070912 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-372fb8e2-7924-4451-8258-46a020f34b48 None None] MFA Rules not processed for user `887cdfb834084f728adf42ffeb6bd4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:17.072318 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-372fb8e2-7924-4451-8258-46a020f34b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:17.115913 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef795f26-991d-4a23-83c4-1bb80fc0adbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:17.118262 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef795f26-991d-4a23-83c4-1bb80fc0adbd service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:17.127192 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1008/2005] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:17.128311 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef795f26-991d-4a23-83c4-1bb80fc0adbd service cinder] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:17.137922 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef795f26-991d-4a23-83c4-1bb80fc0adbd service cinder] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:17.143068 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea23eb8-cf4e-41c7-991c-8c0139498175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:17.143983 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea23eb8-cf4e-41c7-991c-8c0139498175 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:17.144269 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea23eb8-cf4e-41c7-991c-8c0139498175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:17.144543 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea23eb8-cf4e-41c7-991c-8c0139498175 admin admin] PATH_INFO: `/v3/projects/9b662525020c48d8b36c4b54bc77ed12/users/09d68bf6f29744dda2cf2d65171a3ca7/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:17.146675 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea23eb8-cf4e-41c7-991c-8c0139498175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b662525020c48d8b36c4b54bc77ed12, user_id=09d68bf6f29744dda2cf2d65171a3ca7, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:17.150102 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea23eb8-cf4e-41c7-991c-8c0139498175 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:17.160472 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1009/2006] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:17 2022] PUT /identity/v3/projects/9b662525020c48d8b36c4b54bc77ed12/users/09d68bf6f29744dda2cf2d65171a3ca7/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:17.161255 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea23eb8-cf4e-41c7-991c-8c0139498175 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:17.162824 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-3ea23eb8-cf4e-41c7-991c-8c0139498175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:17.164032 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 998/2007] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:17.165224 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fb8e2-7924-4451-8258-46a020f34b48 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:17.178239 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fb8e2-7924-4451-8258-46a020f34b48 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:17.229345 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea23eb8-cf4e-41c7-991c-8c0139498175 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:17.231616 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8efbb-728e-469b-af12-b419c9ba0e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:17.232505 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8efbb-728e-469b-af12-b419c9ba0e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:17.232788 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8efbb-728e-469b-af12-b419c9ba0e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:17.233058 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8efbb-728e-469b-af12-b419c9ba0e10 admin admin] PATH_INFO: `/v3/users/1aaec9a53369405b8cae785e221e6f3c` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:17.234198 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0534c8d-652e-4a7e-94c0-c5dabb0a6cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:17.234359 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8efbb-728e-469b-af12-b419c9ba0e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aaec9a53369405b8cae785e221e6f3c)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:17.235063 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0534c8d-652e-4a7e-94c0-c5dabb0a6cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:17.235348 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0534c8d-652e-4a7e-94c0-c5dabb0a6cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:17.235626 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0534c8d-652e-4a7e-94c0-c5dabb0a6cac admin admin] PATH_INFO: `/v3/users/8ea0215287a14520886c71aacaeebc1c` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:17.236161 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8efbb-728e-469b-af12-b419c9ba0e10 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:17.236869 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0534c8d-652e-4a7e-94c0-c5dabb0a6cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ea0215287a14520886c71aacaeebc1c)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:17.238802 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0534c8d-652e-4a7e-94c0-c5dabb0a6cac admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:17.284403 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-46f8efbb-728e-469b-af12-b419c9ba0e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aaec9a53369405b8cae785e221e6f3c'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:17.284828 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f0534c8d-652e-4a7e-94c0-c5dabb0a6cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ea0215287a14520886c71aacaeebc1c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:17.297956 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f0534c8d-652e-4a7e-94c0-c5dabb0a6cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ea0215287a14520886c71aacaeebc1c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:17.298692 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f0534c8d-652e-4a7e-94c0-c5dabb0a6cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ea0215287a14520886c71aacaeebc1c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:17.299426 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-46f8efbb-728e-469b-af12-b419c9ba0e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aaec9a53369405b8cae785e221e6f3c'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:17.300201 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-46f8efbb-728e-469b-af12-b419c9ba0e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aaec9a53369405b8cae785e221e6f3c'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:17.300943 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-46f8efbb-728e-469b-af12-b419c9ba0e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aaec9a53369405b8cae785e221e6f3c'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:17.306554 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f0534c8d-652e-4a7e-94c0-c5dabb0a6cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ea0215287a14520886c71aacaeebc1c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:17.307464 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f0534c8d-652e-4a7e-94c0-c5dabb0a6cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ea0215287a14520886c71aacaeebc1c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:17.308847 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-46f8efbb-728e-469b-af12-b419c9ba0e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aaec9a53369405b8cae785e221e6f3c'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:17.323372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1010/2008] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:17 2022] DELETE /identity/v3/users/8ea0215287a14520886c71aacaeebc1c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:17.323372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c36620-08c0-4ae0-9b36-d404bf824e9f None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:17.323679 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 999/2009] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:17 2022] DELETE /identity/v3/users/1aaec9a53369405b8cae785e221e6f3c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:17.323758 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c36620-08c0-4ae0-9b36-d404bf824e9f None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:17.323758 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c36620-08c0-4ae0-9b36-d404bf824e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:17.323913 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8efbb-728e-469b-af12-b419c9ba0e10 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:17.324457 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-46f8efbb-728e-469b-af12-b419c9ba0e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:17.359210 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-f8c36620-08c0-4ae0-9b36-d404bf824e9f None None] MFA Rules not processed for user `09d68bf6f29744dda2cf2d65171a3ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:17.360711 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-f8c36620-08c0-4ae0-9b36-d404bf824e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:17.387890 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8efbb-728e-469b-af12-b419c9ba0e10 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:17.391629 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649f302-3c9f-4b04-bd06-b0134def1a70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:17.392317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649f302-3c9f-4b04-bd06-b0134def1a70 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:17.392597 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649f302-3c9f-4b04-bd06-b0134def1a70 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:17.392871 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649f302-3c9f-4b04-bd06-b0134def1a70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:17.394712 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-f649f302-3c9f-4b04-bd06-b0134def1a70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:17.431939 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1011/2010] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:17.442430 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fac6d4-0f27-403c-a3d5-0083ed5c6745 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:17.442716 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fac6d4-0f27-403c-a3d5-0083ed5c6745 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:17.442990 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fac6d4-0f27-403c-a3d5-0083ed5c6745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:17.462402 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-09fac6d4-0f27-403c-a3d5-0083ed5c6745 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:17.463579 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-09fac6d4-0f27-403c-a3d5-0083ed5c6745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:17.472547 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649f302-3c9f-4b04-bd06-b0134def1a70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:17.474096 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649f302-3c9f-4b04-bd06-b0134def1a70 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:17.484754 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1000/2011] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:17.486191 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfffcc-3dd5-4098-9466-0f2a5bb109b5 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:17.486531 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfffcc-3dd5-4098-9466-0f2a5bb109b5 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:17.486967 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfffcc-3dd5-4098-9466-0f2a5bb109b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:17.505652 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-d4bfffcc-3dd5-4098-9466-0f2a5bb109b5 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:17.506970 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-d4bfffcc-3dd5-4098-9466-0f2a5bb109b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:17.531875 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1012/2012] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:17.531875 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fac6d4-0f27-403c-a3d5-0083ed5c6745 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:17.536078 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-09fac6d4-0f27-403c-a3d5-0083ed5c6745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:17.578716 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fac6d4-0f27-403c-a3d5-0083ed5c6745 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:17.591863 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e09390-13cd-4a73-b519-83f2e9755ddd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:17.593579 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e09390-13cd-4a73-b519-83f2e9755ddd service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:17.593859 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e09390-13cd-4a73-b519-83f2e9755ddd service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:17.595571 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e09390-13cd-4a73-b519-83f2e9755ddd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:17.605177 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1001/2013] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:17.608354 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfffcc-3dd5-4098-9466-0f2a5bb109b5 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:17.608354 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-d4bfffcc-3dd5-4098-9466-0f2a5bb109b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:17.619313 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e09390-13cd-4a73-b519-83f2e9755ddd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:17.622495 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e09390-13cd-4a73-b519-83f2e9755ddd service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:17.672555 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1013/2014] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:17.673558 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e09390-13cd-4a73-b519-83f2e9755ddd service cinder] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:17.678447 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-29e09390-13cd-4a73-b519-83f2e9755ddd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:17.701627 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfffcc-3dd5-4098-9466-0f2a5bb109b5 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:17.705327 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1f2a8-41a4-4cae-b57c-e6fcda21a2d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:17.705986 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1f2a8-41a4-4cae-b57c-e6fcda21a2d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:17.706269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1f2a8-41a4-4cae-b57c-e6fcda21a2d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:17.706548 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1f2a8-41a4-4cae-b57c-e6fcda21a2d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:17.728286 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1f2a8-41a4-4cae-b57c-e6fcda21a2d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:17.730379 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1f2a8-41a4-4cae-b57c-e6fcda21a2d6 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:17.749159 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1002/2015] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:17.789016 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e09390-13cd-4a73-b519-83f2e9755ddd service cinder] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:17.794508 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34faaf-00d1-44cc-a9c8-ae0b5a20c57f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:17.796074 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34faaf-00d1-44cc-a9c8-ae0b5a20c57f service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:17.796511 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34faaf-00d1-44cc-a9c8-ae0b5a20c57f service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:17.796938 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34faaf-00d1-44cc-a9c8-ae0b5a20c57f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:17.811517 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34faaf-00d1-44cc-a9c8-ae0b5a20c57f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:17.813505 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34faaf-00d1-44cc-a9c8-ae0b5a20c57f service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:17.828201 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1014/2016] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:18.063713 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1f2a8-41a4-4cae-b57c-e6fcda21a2d6 service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:18.065883 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-73d1f2a8-41a4-4cae-b57c-e6fcda21a2d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:18.085833 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1f2a8-41a4-4cae-b57c-e6fcda21a2d6 service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:18.092244 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72493d-2f6e-4f97-9bb5-ff3ac0f264f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:18.093285 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72493d-2f6e-4f97-9bb5-ff3ac0f264f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:18.093755 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72493d-2f6e-4f97-9bb5-ff3ac0f264f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:18.094156 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72493d-2f6e-4f97-9bb5-ff3ac0f264f5 admin admin] PATH_INFO: `/v3/users/e61954f407cc4bcca43e2b6491d7d82a` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:18.095509 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72493d-2f6e-4f97-9bb5-ff3ac0f264f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e61954f407cc4bcca43e2b6491d7d82a)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:18.099146 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72493d-2f6e-4f97-9bb5-ff3ac0f264f5 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:18.207704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5e72493d-2f6e-4f97-9bb5-ff3ac0f264f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e61954f407cc4bcca43e2b6491d7d82a'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:18.225193 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5e72493d-2f6e-4f97-9bb5-ff3ac0f264f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e61954f407cc4bcca43e2b6491d7d82a'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:18.226107 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5e72493d-2f6e-4f97-9bb5-ff3ac0f264f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e61954f407cc4bcca43e2b6491d7d82a'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:18.226773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5e72493d-2f6e-4f97-9bb5-ff3ac0f264f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e61954f407cc4bcca43e2b6491d7d82a'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:18.238614 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5e72493d-2f6e-4f97-9bb5-ff3ac0f264f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e61954f407cc4bcca43e2b6491d7d82a'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:18.259213 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1003/2017] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:18 2022] DELETE /identity/v3/users/e61954f407cc4bcca43e2b6491d7d82a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:18.261736 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67367b56-55b5-4deb-bb56-314c24077763 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:18.262012 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67367b56-55b5-4deb-bb56-314c24077763 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:18.262407 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67367b56-55b5-4deb-bb56-314c24077763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:18.287646 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-67367b56-55b5-4deb-bb56-314c24077763 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:18.289480 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-67367b56-55b5-4deb-bb56-314c24077763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:18.371351 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1015/2018] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:18.388290 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72493d-2f6e-4f97-9bb5-ff3ac0f264f5 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:18.392410 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-5e72493d-2f6e-4f97-9bb5-ff3ac0f264f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:18.414044 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67367b56-55b5-4deb-bb56-314c24077763 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:18.416359 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-67367b56-55b5-4deb-bb56-314c24077763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:18.434000 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67367b56-55b5-4deb-bb56-314c24077763 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:18.440007 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d74bb4-2866-450b-83c1-08815796f35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:18.441059 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d74bb4-2866-450b-83c1-08815796f35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:18.441355 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d74bb4-2866-450b-83c1-08815796f35e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:18.441776 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d74bb4-2866-450b-83c1-08815796f35e admin admin] PATH_INFO: `/v3/projects/ec04e31dabad408189c872bac820dfe8` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:18.443243 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d74bb4-2866-450b-83c1-08815796f35e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec04e31dabad408189c872bac820dfe8)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:18.445636 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d74bb4-2866-450b-83c1-08815796f35e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:18.466017 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72493d-2f6e-4f97-9bb5-ff3ac0f264f5 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:18.469973 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a43f17-55b6-4570-90b0-4388945e5881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:18.470653 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a43f17-55b6-4570-90b0-4388945e5881 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:18.470932 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a43f17-55b6-4570-90b0-4388945e5881 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:18.471202 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a43f17-55b6-4570-90b0-4388945e5881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:18.482578 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a43f17-55b6-4570-90b0-4388945e5881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:18.484073 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a43f17-55b6-4570-90b0-4388945e5881 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:18.494570 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1004/2019] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:18.496775 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a43f17-55b6-4570-90b0-4388945e5881 service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:18.497850 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-56d74bb4-2866-450b-83c1-08815796f35e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec04e31dabad408189c872bac820dfe8', 'request_id': 'req-56d74bb4-2866-450b-83c1-08815796f35e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:18.498082 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-07a43f17-55b6-4570-90b0-4388945e5881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:18.504255 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-56d74bb4-2866-450b-83c1-08815796f35e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec04e31dabad408189c872bac820dfe8', 'request_id': 'req-56d74bb4-2866-450b-83c1-08815796f35e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:18.510789 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-56d74bb4-2866-450b-83c1-08815796f35e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec04e31dabad408189c872bac820dfe8', 'request_id': 'req-56d74bb4-2866-450b-83c1-08815796f35e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:18.510995 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a43f17-55b6-4570-90b0-4388945e5881 service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:18.525286 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-56d74bb4-2866-450b-83c1-08815796f35e admin admin] The token cache is being invalidate because project ec04e31dabad408189c872bac820dfe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:18.525633 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-56d74bb4-2866-450b-83c1-08815796f35e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:18.526501 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-56d74bb4-2866-450b-83c1-08815796f35e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:18.528435 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1016/2020] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:18 2022] DELETE /identity/v3/projects/ec04e31dabad408189c872bac820dfe8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:18.533695 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc459b4-fb51-47fe-a453-5db20cc430c4 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:18.534314 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc459b4-fb51-47fe-a453-5db20cc430c4 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:18.534428 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc459b4-fb51-47fe-a453-5db20cc430c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:18.557325 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-5cc459b4-fb51-47fe-a453-5db20cc430c4 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:18.558584 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-5cc459b4-fb51-47fe-a453-5db20cc430c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:18.575066 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b938d-d999-40aa-86a8-9bf31788a4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:18.576867 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b938d-d999-40aa-86a8-9bf31788a4cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:18.577156 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b938d-d999-40aa-86a8-9bf31788a4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:18.577450 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b938d-d999-40aa-86a8-9bf31788a4cf admin admin] PATH_INFO: `/v3/projects/927d6e73c0594b8f9dc00570047d615e` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:18.578695 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b938d-d999-40aa-86a8-9bf31788a4cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=927d6e73c0594b8f9dc00570047d615e)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:18.580638 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b938d-d999-40aa-86a8-9bf31788a4cf admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:18.645428 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1017/2021] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:16:18.645663 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e10b938d-d999-40aa-86a8-9bf31788a4cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '927d6e73c0594b8f9dc00570047d615e', 'request_id': 'req-e10b938d-d999-40aa-86a8-9bf31788a4cf'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:18.647763 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df76d5-946d-4f5a-a2ae-192b4167bccd None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:18.648262 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df76d5-946d-4f5a-a2ae-192b4167bccd None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:18.648564 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df76d5-946d-4f5a-a2ae-192b4167bccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:18.654809 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e10b938d-d999-40aa-86a8-9bf31788a4cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '927d6e73c0594b8f9dc00570047d615e', 'request_id': 'req-e10b938d-d999-40aa-86a8-9bf31788a4cf'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:18.661500 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e10b938d-d999-40aa-86a8-9bf31788a4cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '927d6e73c0594b8f9dc00570047d615e', 'request_id': 'req-e10b938d-d999-40aa-86a8-9bf31788a4cf'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:18.674061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-f0df76d5-946d-4f5a-a2ae-192b4167bccd None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:18.675269 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-f0df76d5-946d-4f5a-a2ae-192b4167bccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:18.679695 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e10b938d-d999-40aa-86a8-9bf31788a4cf admin admin] The token cache is being invalidate because project 927d6e73c0594b8f9dc00570047d615e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:18.680739 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e10b938d-d999-40aa-86a8-9bf31788a4cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:18.681631 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e10b938d-d999-40aa-86a8-9bf31788a4cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:18.683653 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1005/2022] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:18 2022] DELETE /identity/v3/projects/927d6e73c0594b8f9dc00570047d615e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:18.687159 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b938d-d999-40aa-86a8-9bf31788a4cf admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:18.688587 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e10b938d-d999-40aa-86a8-9bf31788a4cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:18.743155 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1018/2023] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:16:18.747105 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df76d5-946d-4f5a-a2ae-192b4167bccd None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:18.756703 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df76d5-946d-4f5a-a2ae-192b4167bccd None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:18.762549 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b0f0f-4b24-4e72-89f0-470ca5fa8abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:18.763669 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b0f0f-4b24-4e72-89f0-470ca5fa8abb admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:18.763669 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b0f0f-4b24-4e72-89f0-470ca5fa8abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:18.763889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b0f0f-4b24-4e72-89f0-470ca5fa8abb admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:18.764518 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b0f0f-4b24-4e72-89f0-470ca5fa8abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:16:18.764818 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b0f0f-4b24-4e72-89f0-470ca5fa8abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:18.766394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b0f0f-4b24-4e72-89f0-470ca5fa8abb admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:18.767793 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b938d-d999-40aa-86a8-9bf31788a4cf admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:18.783218 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1019/2024] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:16:18.784548 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54dd77-b6d2-4952-9d48-7a4d9d120734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:18.784818 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b0f0f-4b24-4e72-89f0-470ca5fa8abb admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:18.785645 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54dd77-b6d2-4952-9d48-7a4d9d120734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:18.785967 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54dd77-b6d2-4952-9d48-7a4d9d120734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:18.786288 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54dd77-b6d2-4952-9d48-7a4d9d120734 admin admin] PATH_INFO: `/v3/users/a0c3af0dc83a4cd782fa72f2269fd7da` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:18.788061 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54dd77-b6d2-4952-9d48-7a4d9d120734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c3af0dc83a4cd782fa72f2269fd7da)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:18.797674 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54dd77-b6d2-4952-9d48-7a4d9d120734 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:18.813974 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b0f0f-4b24-4e72-89f0-470ca5fa8abb admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:18.820113 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1728e00-882b-4053-9fde-4c0b5b171b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:18.820774 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1728e00-882b-4053-9fde-4c0b5b171b16 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:18.821057 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1728e00-882b-4053-9fde-4c0b5b171b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:18.821377 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1728e00-882b-4053-9fde-4c0b5b171b16 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:18.822100 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1728e00-882b-4053-9fde-4c0b5b171b16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:18.824755 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1728e00-882b-4053-9fde-4c0b5b171b16 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:18.863366 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1020/2025] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:18 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:16:18.864285 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1728e00-882b-4053-9fde-4c0b5b171b16 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:18.869485 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d1728e00-882b-4053-9fde-4c0b5b171b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:18.874537 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5a54dd77-b6d2-4952-9d48-7a4d9d120734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c3af0dc83a4cd782fa72f2269fd7da'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:18.889325 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5a54dd77-b6d2-4952-9d48-7a4d9d120734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c3af0dc83a4cd782fa72f2269fd7da'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:18.890221 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5a54dd77-b6d2-4952-9d48-7a4d9d120734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c3af0dc83a4cd782fa72f2269fd7da'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:18.890962 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5a54dd77-b6d2-4952-9d48-7a4d9d120734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c3af0dc83a4cd782fa72f2269fd7da'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:18.908480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5a54dd77-b6d2-4952-9d48-7a4d9d120734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c3af0dc83a4cd782fa72f2269fd7da'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:18.926057 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1006/2026] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:18 2022] DELETE /identity/v3/users/a0c3af0dc83a4cd782fa72f2269fd7da => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:18.927202 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54dd77-b6d2-4952-9d48-7a4d9d120734 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:18.930155 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-5a54dd77-b6d2-4952-9d48-7a4d9d120734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:18.942018 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1728e00-882b-4053-9fde-4c0b5b171b16 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:19.001853 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54dd77-b6d2-4952-9d48-7a4d9d120734 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:19.004165 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be949b4b-a344-414a-81e8-f6b432ff1bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:19.005296 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be949b4b-a344-414a-81e8-f6b432ff1bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:19.005626 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be949b4b-a344-414a-81e8-f6b432ff1bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:19.005901 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be949b4b-a344-414a-81e8-f6b432ff1bce admin admin] PATH_INFO: `/v3/projects/fe55b1ac711d4bd1b803f1d27e338fe6` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:19.008232 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be949b4b-a344-414a-81e8-f6b432ff1bce admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe55b1ac711d4bd1b803f1d27e338fe6)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:19.009360 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa7a81-77e0-4b15-905c-6c0f85d569ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:19.010205 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa7a81-77e0-4b15-905c-6c0f85d569ce admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:19.010322 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be949b4b-a344-414a-81e8-f6b432ff1bce admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:19.010728 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa7a81-77e0-4b15-905c-6c0f85d569ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:19.011151 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa7a81-77e0-4b15-905c-6c0f85d569ce admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:19.012046 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa7a81-77e0-4b15-905c-6c0f85d569ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:19.014239 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa7a81-77e0-4b15-905c-6c0f85d569ce admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:19.043436 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1007/2027] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:18 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:19.047320 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa7a81-77e0-4b15-905c-6c0f85d569ce admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:19.058193 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa7a81-77e0-4b15-905c-6c0f85d569ce admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:19.072918 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-be949b4b-a344-414a-81e8-f6b432ff1bce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe55b1ac711d4bd1b803f1d27e338fe6', 'request_id': 'req-be949b4b-a344-414a-81e8-f6b432ff1bce'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:19.079127 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-be949b4b-a344-414a-81e8-f6b432ff1bce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe55b1ac711d4bd1b803f1d27e338fe6', 'request_id': 'req-be949b4b-a344-414a-81e8-f6b432ff1bce'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:19.092386 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-be949b4b-a344-414a-81e8-f6b432ff1bce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe55b1ac711d4bd1b803f1d27e338fe6', 'request_id': 'req-be949b4b-a344-414a-81e8-f6b432ff1bce'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:19.113367 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-be949b4b-a344-414a-81e8-f6b432ff1bce admin admin] The token cache is being invalidate because project fe55b1ac711d4bd1b803f1d27e338fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:19.116719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-be949b4b-a344-414a-81e8-f6b432ff1bce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:19.119702 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-be949b4b-a344-414a-81e8-f6b432ff1bce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:19.134230 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1021/2028] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:18 2022] DELETE /identity/v3/projects/fe55b1ac711d4bd1b803f1d27e338fe6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:19.134230 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be949b4b-a344-414a-81e8-f6b432ff1bce admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:19.135752 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-be949b4b-a344-414a-81e8-f6b432ff1bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:19.138795 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9af00-572d-4278-96bc-f26fc3a841c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:19.139486 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9af00-572d-4278-96bc-f26fc3a841c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:19.139759 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9af00-572d-4278-96bc-f26fc3a841c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:19.140064 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9af00-572d-4278-96bc-f26fc3a841c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:19.140814 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9af00-572d-4278-96bc-f26fc3a841c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:19.143092 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9af00-572d-4278-96bc-f26fc3a841c6 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:19.151890 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be949b4b-a344-414a-81e8-f6b432ff1bce admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:19.158878 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d71f04-eb1f-4e5e-8e17-ead5da20adc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:19.160290 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d71f04-eb1f-4e5e-8e17-ead5da20adc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:19.160739 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d71f04-eb1f-4e5e-8e17-ead5da20adc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:19.162667 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d71f04-eb1f-4e5e-8e17-ead5da20adc9 admin admin] PATH_INFO: `/v3/users/09d68bf6f29744dda2cf2d65171a3ca7` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:19.164634 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d71f04-eb1f-4e5e-8e17-ead5da20adc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d68bf6f29744dda2cf2d65171a3ca7)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:19.167243 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d71f04-eb1f-4e5e-8e17-ead5da20adc9 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:19.175357 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1008/2029] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:16:19.180855 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9af00-572d-4278-96bc-f26fc3a841c6 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:19.186998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-7ac9af00-572d-4278-96bc-f26fc3a841c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:19.208958 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9af00-572d-4278-96bc-f26fc3a841c6 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:19.222608 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411caec4-0ceb-47d3-8850-839bcc83bf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:19.223550 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411caec4-0ceb-47d3-8850-839bcc83bf5e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:19.224059 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411caec4-0ceb-47d3-8850-839bcc83bf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:19.225070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411caec4-0ceb-47d3-8850-839bcc83bf5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:19.226947 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411caec4-0ceb-47d3-8850-839bcc83bf5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:19.232194 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411caec4-0ceb-47d3-8850-839bcc83bf5e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:19.243237 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c1d71f04-eb1f-4e5e-8e17-ead5da20adc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d68bf6f29744dda2cf2d65171a3ca7'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:19.258676 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1009/2030] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:19.259773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411caec4-0ceb-47d3-8850-839bcc83bf5e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:19.263072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c1d71f04-eb1f-4e5e-8e17-ead5da20adc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d68bf6f29744dda2cf2d65171a3ca7'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:19.263716 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c1d71f04-eb1f-4e5e-8e17-ead5da20adc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d68bf6f29744dda2cf2d65171a3ca7'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:19.274457 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c1d71f04-eb1f-4e5e-8e17-ead5da20adc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d68bf6f29744dda2cf2d65171a3ca7'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:19.276915 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c1d71f04-eb1f-4e5e-8e17-ead5da20adc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d68bf6f29744dda2cf2d65171a3ca7'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:19.287730 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411caec4-0ceb-47d3-8850-839bcc83bf5e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:19.294632 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1022/2031] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:19 2022] DELETE /identity/v3/users/09d68bf6f29744dda2cf2d65171a3ca7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:19.308180 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd317f5-2a82-4ed8-971b-d986c7533355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:19.309121 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd317f5-2a82-4ed8-971b-d986c7533355 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:19.309425 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd317f5-2a82-4ed8-971b-d986c7533355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:19.309682 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd317f5-2a82-4ed8-971b-d986c7533355 admin admin] PATH_INFO: `/v3/projects/8b55d797705f4fc283124e2ff6c16b45/users/d81f2817088749b38bbb55bb1d48cf25/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:19.338471 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd317f5-2a82-4ed8-971b-d986c7533355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b55d797705f4fc283124e2ff6c16b45, user_id=d81f2817088749b38bbb55bb1d48cf25, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:19.345026 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd317f5-2a82-4ed8-971b-d986c7533355 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:19.378251 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1010/2032] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:19 2022] PUT /identity/v3/projects/8b55d797705f4fc283124e2ff6c16b45/users/d81f2817088749b38bbb55bb1d48cf25/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:19.389905 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dce9d-2581-4133-b955-9c4dcd1a2ac7 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:19.390709 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dce9d-2581-4133-b955-9c4dcd1a2ac7 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:19.390932 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dce9d-2581-4133-b955-9c4dcd1a2ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:19.428200 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-e27dce9d-2581-4133-b955-9c4dcd1a2ac7 None None] MFA Rules not processed for user `d81f2817088749b38bbb55bb1d48cf25`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:19.431510 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e27dce9d-2581-4133-b955-9c4dcd1a2ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:19.526795 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1023/2033] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:19.533326 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd317f5-2a82-4ed8-971b-d986c7533355 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:19.535725 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-fbd317f5-2a82-4ed8-971b-d986c7533355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:19.615483 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dce9d-2581-4133-b955-9c4dcd1a2ac7 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:19.617397 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e27dce9d-2581-4133-b955-9c4dcd1a2ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:19.691750 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd317f5-2a82-4ed8-971b-d986c7533355 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:19.699800 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7785d5-bcc5-49db-9d9c-033cb84f830b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:19.701456 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7785d5-bcc5-49db-9d9c-033cb84f830b service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:19.703080 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7785d5-bcc5-49db-9d9c-033cb84f830b service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:19.704041 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7785d5-bcc5-49db-9d9c-033cb84f830b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:19.723544 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7785d5-bcc5-49db-9d9c-033cb84f830b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:19.726391 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7785d5-bcc5-49db-9d9c-033cb84f830b service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:19.751953 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1011/2034] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:19.775800 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7785d5-bcc5-49db-9d9c-033cb84f830b service cinder] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:19.777216 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-1f7785d5-bcc5-49db-9d9c-033cb84f830b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:19.821766 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dce9d-2581-4133-b955-9c4dcd1a2ac7 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:19.828475 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd675a9-b054-4c27-a4e4-b5cc5bdb92d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:19.830015 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd675a9-b054-4c27-a4e4-b5cc5bdb92d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:19.830527 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd675a9-b054-4c27-a4e4-b5cc5bdb92d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:19.831009 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd675a9-b054-4c27-a4e4-b5cc5bdb92d0 admin admin] PATH_INFO: `/v3/projects/35c980fb2cdb4564bba8d34de6400ec6` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:19.833075 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd675a9-b054-4c27-a4e4-b5cc5bdb92d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35c980fb2cdb4564bba8d34de6400ec6)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:19.838470 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd675a9-b054-4c27-a4e4-b5cc5bdb92d0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:19.913502 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7785d5-bcc5-49db-9d9c-033cb84f830b service cinder] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:19.941517 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-8cd675a9-b054-4c27-a4e4-b5cc5bdb92d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35c980fb2cdb4564bba8d34de6400ec6', 'request_id': 'req-8cd675a9-b054-4c27-a4e4-b5cc5bdb92d0'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:19.951946 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-8cd675a9-b054-4c27-a4e4-b5cc5bdb92d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35c980fb2cdb4564bba8d34de6400ec6', 'request_id': 'req-8cd675a9-b054-4c27-a4e4-b5cc5bdb92d0'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:19.964786 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-8cd675a9-b054-4c27-a4e4-b5cc5bdb92d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35c980fb2cdb4564bba8d34de6400ec6', 'request_id': 'req-8cd675a9-b054-4c27-a4e4-b5cc5bdb92d0'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:19.989385 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-8cd675a9-b054-4c27-a4e4-b5cc5bdb92d0 admin admin] The token cache is being invalidate because project 35c980fb2cdb4564bba8d34de6400ec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:19.989680 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-8cd675a9-b054-4c27-a4e4-b5cc5bdb92d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:19.990818 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-8cd675a9-b054-4c27-a4e4-b5cc5bdb92d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:19.997467 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1024/2035] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:19 2022] DELETE /identity/v3/projects/35c980fb2cdb4564bba8d34de6400ec6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:19.998385 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd675a9-b054-4c27-a4e4-b5cc5bdb92d0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:20.000228 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-8cd675a9-b054-4c27-a4e4-b5cc5bdb92d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:20.008837 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd641fc0-0be4-40df-a75b-cb0de8aa2ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:20.010616 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd641fc0-0be4-40df-a75b-cb0de8aa2ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:20.011299 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd641fc0-0be4-40df-a75b-cb0de8aa2ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:20.011914 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd641fc0-0be4-40df-a75b-cb0de8aa2ba7 admin admin] PATH_INFO: `/v3/users/d81f2817088749b38bbb55bb1d48cf25` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:20.014237 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd641fc0-0be4-40df-a75b-cb0de8aa2ba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d81f2817088749b38bbb55bb1d48cf25)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:20.017178 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd641fc0-0be4-40df-a75b-cb0de8aa2ba7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:20.119654 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd675a9-b054-4c27-a4e4-b5cc5bdb92d0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:20.134899 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d30d4-2c95-4bcd-ace0-1cece051fb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:20.135921 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d30d4-2c95-4bcd-ace0-1cece051fb57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:20.136207 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d30d4-2c95-4bcd-ace0-1cece051fb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:20.136537 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d30d4-2c95-4bcd-ace0-1cece051fb57 admin admin] PATH_INFO: `/v3/projects/9b662525020c48d8b36c4b54bc77ed12` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:20.137806 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d30d4-2c95-4bcd-ace0-1cece051fb57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b662525020c48d8b36c4b54bc77ed12)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:20.139963 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d30d4-2c95-4bcd-ace0-1cece051fb57 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:20.140997 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-bd641fc0-0be4-40df-a75b-cb0de8aa2ba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd81f2817088749b38bbb55bb1d48cf25'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:20.155606 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-bd641fc0-0be4-40df-a75b-cb0de8aa2ba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd81f2817088749b38bbb55bb1d48cf25'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:20.156627 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-bd641fc0-0be4-40df-a75b-cb0de8aa2ba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd81f2817088749b38bbb55bb1d48cf25'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:20.157380 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-bd641fc0-0be4-40df-a75b-cb0de8aa2ba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd81f2817088749b38bbb55bb1d48cf25'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:20.172256 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-bd641fc0-0be4-40df-a75b-cb0de8aa2ba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd81f2817088749b38bbb55bb1d48cf25'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:20.204148 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1012/2036] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:19 2022] DELETE /identity/v3/users/d81f2817088749b38bbb55bb1d48cf25 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:20.208342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dccb0-482f-4d5c-bd80-5bc41bd522b1 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:20.208649 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dccb0-482f-4d5c-bd80-5bc41bd522b1 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:20.209371 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dccb0-482f-4d5c-bd80-5bc41bd522b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:20.231609 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-ec7dccb0-482f-4d5c-bd80-5bc41bd522b1 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:20.232883 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-ec7dccb0-482f-4d5c-bd80-5bc41bd522b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:20.250495 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-0f7d30d4-2c95-4bcd-ace0-1cece051fb57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b662525020c48d8b36c4b54bc77ed12', 'request_id': 'req-0f7d30d4-2c95-4bcd-ace0-1cece051fb57'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:20.257641 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-0f7d30d4-2c95-4bcd-ace0-1cece051fb57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b662525020c48d8b36c4b54bc77ed12', 'request_id': 'req-0f7d30d4-2c95-4bcd-ace0-1cece051fb57'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:20.265397 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-0f7d30d4-2c95-4bcd-ace0-1cece051fb57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b662525020c48d8b36c4b54bc77ed12', 'request_id': 'req-0f7d30d4-2c95-4bcd-ace0-1cece051fb57'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:20.284352 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-0f7d30d4-2c95-4bcd-ace0-1cece051fb57 admin admin] The token cache is being invalidate because project 9b662525020c48d8b36c4b54bc77ed12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:20.284982 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-0f7d30d4-2c95-4bcd-ace0-1cece051fb57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:20.286314 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-0f7d30d4-2c95-4bcd-ace0-1cece051fb57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:20.290638 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1025/2037] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:19 2022] DELETE /identity/v3/projects/9b662525020c48d8b36c4b54bc77ed12 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:20.293064 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17647bd3-96c9-4c6d-8e5c-b73442636c39 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:20.293353 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17647bd3-96c9-4c6d-8e5c-b73442636c39 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:20.293716 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17647bd3-96c9-4c6d-8e5c-b73442636c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:20.306476 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1013/2038] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:20.311436 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655541f-f34e-4f62-b239-f3c09dba351f None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:20.312265 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655541f-f34e-4f62-b239-f3c09dba351f None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:20.312375 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655541f-f34e-4f62-b239-f3c09dba351f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:20.331058 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-17647bd3-96c9-4c6d-8e5c-b73442636c39 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:20.332298 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-17647bd3-96c9-4c6d-8e5c-b73442636c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:20.337410 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-a655541f-f34e-4f62-b239-f3c09dba351f None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:20.338595 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a655541f-f34e-4f62-b239-f3c09dba351f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:20.366728 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1026/2039] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:20.368392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7012f53-d779-42e3-b9ba-88c5f7fa43de None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:20.368679 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7012f53-d779-42e3-b9ba-88c5f7fa43de None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:20.369499 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7012f53-d779-42e3-b9ba-88c5f7fa43de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:20.381527 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1014/2040] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:20.383665 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655541f-f34e-4f62-b239-f3c09dba351f None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:20.385334 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a655541f-f34e-4f62-b239-f3c09dba351f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:20.395795 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-e7012f53-d779-42e3-b9ba-88c5f7fa43de None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:20.397137 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e7012f53-d779-42e3-b9ba-88c5f7fa43de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:20.405359 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1027/2041] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:20.406756 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd888bc-ef53-4ff4-a6da-6ac2ac4d9c06 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:20.407051 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd888bc-ef53-4ff4-a6da-6ac2ac4d9c06 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:20.407315 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd888bc-ef53-4ff4-a6da-6ac2ac4d9c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:20.426011 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-fdd888bc-ef53-4ff4-a6da-6ac2ac4d9c06 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:20.427194 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-fdd888bc-ef53-4ff4-a6da-6ac2ac4d9c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:20.445092 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1028/2042] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:20.446136 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd888bc-ef53-4ff4-a6da-6ac2ac4d9c06 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:20.461735 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655541f-f34e-4f62-b239-f3c09dba351f None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:20.464667 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd888bc-ef53-4ff4-a6da-6ac2ac4d9c06 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:20.466593 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee77918-8d10-426e-b09b-9f4e2d13531d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:20.467422 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee77918-8d10-426e-b09b-9f4e2d13531d service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:20.467813 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee77918-8d10-426e-b09b-9f4e2d13531d service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:20.468212 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee77918-8d10-426e-b09b-9f4e2d13531d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:20.481607 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee77918-8d10-426e-b09b-9f4e2d13531d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:20.483557 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee77918-8d10-426e-b09b-9f4e2d13531d service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:20.488115 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52369d4f-4730-42ff-9db0-35e5189698b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:20.489005 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52369d4f-4730-42ff-9db0-35e5189698b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:20.489432 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52369d4f-4730-42ff-9db0-35e5189698b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:20.489979 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52369d4f-4730-42ff-9db0-35e5189698b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:20.494158 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52369d4f-4730-42ff-9db0-35e5189698b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:16:20.494660 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52369d4f-4730-42ff-9db0-35e5189698b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:20.497024 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1015/2043] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:20.497260 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52369d4f-4730-42ff-9db0-35e5189698b7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:20.504817 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee77918-8d10-426e-b09b-9f4e2d13531d service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:20.517708 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1029/2044] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:16:20.519504 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52369d4f-4730-42ff-9db0-35e5189698b7 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:20.523777 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-52369d4f-4730-42ff-9db0-35e5189698b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:20.536258 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee77918-8d10-426e-b09b-9f4e2d13531d service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:20.537630 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52369d4f-4730-42ff-9db0-35e5189698b7 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:20.544788 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76470197-3499-44b2-8e22-e81ea4e369a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:20.545931 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76470197-3499-44b2-8e22-e81ea4e369a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:20.546365 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76470197-3499-44b2-8e22-e81ea4e369a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:20.546788 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76470197-3499-44b2-8e22-e81ea4e369a8 admin admin] PATH_INFO: `/v3/users/89d1245535f64c21b3797fbb5bfb7a2a` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:20.548755 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76470197-3499-44b2-8e22-e81ea4e369a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89d1245535f64c21b3797fbb5bfb7a2a)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:20.550657 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76470197-3499-44b2-8e22-e81ea4e369a8 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:20.555404 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb4537-3c74-4c3a-ab1d-be366bb688b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:20.556293 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb4537-3c74-4c3a-ab1d-be366bb688b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:20.557774 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb4537-3c74-4c3a-ab1d-be366bb688b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:20.558279 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb4537-3c74-4c3a-ab1d-be366bb688b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:20.559125 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb4537-3c74-4c3a-ab1d-be366bb688b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:16:20.559472 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb4537-3c74-4c3a-ab1d-be366bb688b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:20.564087 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb4537-3c74-4c3a-ab1d-be366bb688b1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:20.619858 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1016/2045] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:16:20.620421 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb4537-3c74-4c3a-ab1d-be366bb688b1 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:20.635514 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-76470197-3499-44b2-8e22-e81ea4e369a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89d1245535f64c21b3797fbb5bfb7a2a'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:20.640666 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb4537-3c74-4c3a-ab1d-be366bb688b1 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:20.651858 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-76470197-3499-44b2-8e22-e81ea4e369a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89d1245535f64c21b3797fbb5bfb7a2a'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:20.652594 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-76470197-3499-44b2-8e22-e81ea4e369a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89d1245535f64c21b3797fbb5bfb7a2a'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:20.660507 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ed727-93c4-4990-8733-971d5dfea34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:20.661190 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ed727-93c4-4990-8733-971d5dfea34d admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:20.661520 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ed727-93c4-4990-8733-971d5dfea34d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:20.661802 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ed727-93c4-4990-8733-971d5dfea34d admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:20.662519 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ed727-93c4-4990-8733-971d5dfea34d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:20.663339 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-76470197-3499-44b2-8e22-e81ea4e369a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89d1245535f64c21b3797fbb5bfb7a2a'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:20.666438 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ed727-93c4-4990-8733-971d5dfea34d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:20.674594 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-76470197-3499-44b2-8e22-e81ea4e369a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89d1245535f64c21b3797fbb5bfb7a2a'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:20.688641 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1030/2046] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:20 2022] DELETE /identity/v3/users/89d1245535f64c21b3797fbb5bfb7a2a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:20.689893 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76470197-3499-44b2-8e22-e81ea4e369a8 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:20.691643 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-76470197-3499-44b2-8e22-e81ea4e369a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:20.726876 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1017/2047] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:20 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:20.728703 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0d1a1-3dd8-461c-8cc8-48aa57a8fe82 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:20.729171 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0d1a1-3dd8-461c-8cc8-48aa57a8fe82 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:20.730071 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0d1a1-3dd8-461c-8cc8-48aa57a8fe82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:20.754242 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-2aa0d1a1-3dd8-461c-8cc8-48aa57a8fe82 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:20.755717 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-2aa0d1a1-3dd8-461c-8cc8-48aa57a8fe82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:20.884589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76470197-3499-44b2-8e22-e81ea4e369a8 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:20.885660 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1018/2048] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:20.889745 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0d1a1-3dd8-461c-8cc8-48aa57a8fe82 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:20.892154 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-2aa0d1a1-3dd8-461c-8cc8-48aa57a8fe82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:20.894014 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0068d1-7b1d-40ea-90b8-1185bade65fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:20.894933 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0068d1-7b1d-40ea-90b8-1185bade65fc admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:20.895188 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0068d1-7b1d-40ea-90b8-1185bade65fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:20.895469 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0068d1-7b1d-40ea-90b8-1185bade65fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:20.904961 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0068d1-7b1d-40ea-90b8-1185bade65fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:20.906450 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0d1a1-3dd8-461c-8cc8-48aa57a8fe82 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:20.911686 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeb73e-5818-4a63-bed6-8d690871447c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:20.912847 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeb73e-5818-4a63-bed6-8d690871447c admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:20.914029 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeb73e-5818-4a63-bed6-8d690871447c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:20.914502 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeb73e-5818-4a63-bed6-8d690871447c admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:20.915966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eeb73e-5818-4a63-bed6-8d690871447c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:20.917726 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0068d1-7b1d-40ea-90b8-1185bade65fc admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:20.919013 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eeb73e-5818-4a63-bed6-8d690871447c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:20.951689 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1019/2049] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:20 2022] POST /identity/v3/users => generated 292 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:20.955252 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeb73e-5818-4a63-bed6-8d690871447c admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:20.960486 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-36eeb73e-5818-4a63-bed6-8d690871447c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:20.986120 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1031/2050] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:20 2022] POST /identity/v3/projects => generated 385 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:20.987187 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0068d1-7b1d-40ea-90b8-1185bade65fc admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:20.989179 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-dc0068d1-7b1d-40ea-90b8-1185bade65fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:21.039121 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeb73e-5818-4a63-bed6-8d690871447c admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:21.066071 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0068d1-7b1d-40ea-90b8-1185bade65fc admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:21.071665 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ff7cf-8439-48e8-a564-d76c6487a0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:21.072556 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ff7cf-8439-48e8-a564-d76c6487a0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:21.072836 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ff7cf-8439-48e8-a564-d76c6487a0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:21.073107 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ff7cf-8439-48e8-a564-d76c6487a0d5 admin admin] PATH_INFO: `/v3/projects/8b55d797705f4fc283124e2ff6c16b45` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:21.074948 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ff7cf-8439-48e8-a564-d76c6487a0d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b55d797705f4fc283124e2ff6c16b45)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:21.079884 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ff7cf-8439-48e8-a564-d76c6487a0d5 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:21.094261 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9026ac-6bc2-45ab-9da1-726a42124d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:21.095373 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9026ac-6bc2-45ab-9da1-726a42124d8a service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:21.095665 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9026ac-6bc2-45ab-9da1-726a42124d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:21.095990 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9026ac-6bc2-45ab-9da1-726a42124d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:21.110663 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9026ac-6bc2-45ab-9da1-726a42124d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:21.112159 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9026ac-6bc2-45ab-9da1-726a42124d8a service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:21.124735 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1020/2051] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:21.125430 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9026ac-6bc2-45ab-9da1-726a42124d8a service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:21.130187 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e35ff7cf-8439-48e8-a564-d76c6487a0d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b55d797705f4fc283124e2ff6c16b45', 'request_id': 'req-e35ff7cf-8439-48e8-a564-d76c6487a0d5'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:21.137147 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e35ff7cf-8439-48e8-a564-d76c6487a0d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b55d797705f4fc283124e2ff6c16b45', 'request_id': 'req-e35ff7cf-8439-48e8-a564-d76c6487a0d5'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:21.137942 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9026ac-6bc2-45ab-9da1-726a42124d8a service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:21.144066 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e35ff7cf-8439-48e8-a564-d76c6487a0d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b55d797705f4fc283124e2ff6c16b45', 'request_id': 'req-e35ff7cf-8439-48e8-a564-d76c6487a0d5'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:21.163404 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e35ff7cf-8439-48e8-a564-d76c6487a0d5 admin admin] The token cache is being invalidate because project 8b55d797705f4fc283124e2ff6c16b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:21.163677 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e35ff7cf-8439-48e8-a564-d76c6487a0d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:21.166499 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e35ff7cf-8439-48e8-a564-d76c6487a0d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:21.169631 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1032/2052] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:20 2022] DELETE /identity/v3/projects/8b55d797705f4fc283124e2ff6c16b45 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:21.171176 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ff7cf-8439-48e8-a564-d76c6487a0d5 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:21.175143 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e35ff7cf-8439-48e8-a564-d76c6487a0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:21.257331 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0daa57-ab67-4c53-ada9-bb38a4c89a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:21.258019 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0daa57-ab67-4c53-ada9-bb38a4c89a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:21.258312 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0daa57-ab67-4c53-ada9-bb38a4c89a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:21.258583 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0daa57-ab67-4c53-ada9-bb38a4c89a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:21.259332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0daa57-ab67-4c53-ada9-bb38a4c89a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:21.261846 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0daa57-ab67-4c53-ada9-bb38a4c89a42 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:21.273076 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ff7cf-8439-48e8-a564-d76c6487a0d5 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:21.278998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1021/2053] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:21.280478 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e88fd-4e24-4b16-aa42-eb395c4dda50 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:21.280769 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e88fd-4e24-4b16-aa42-eb395c4dda50 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:21.281045 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e88fd-4e24-4b16-aa42-eb395c4dda50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:21.284581 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a9225-2506-482c-82a8-d0fe5f0e18b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:21.285407 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a9225-2506-482c-82a8-d0fe5f0e18b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:21.285787 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a9225-2506-482c-82a8-d0fe5f0e18b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:21.286164 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a9225-2506-482c-82a8-d0fe5f0e18b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:21.286981 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a9225-2506-482c-82a8-d0fe5f0e18b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:21.289993 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a9225-2506-482c-82a8-d0fe5f0e18b5 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:21.312073 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-2a4e88fd-4e24-4b16-aa42-eb395c4dda50 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:21.313628 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-2a4e88fd-4e24-4b16-aa42-eb395c4dda50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:21.314494 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1033/2054] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:21 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:21.315373 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a9225-2506-482c-82a8-d0fe5f0e18b5 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:21.317441 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-510a9225-2506-482c-82a8-d0fe5f0e18b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:21.331268 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1022/2055] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:21.331268 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e88fd-4e24-4b16-aa42-eb395c4dda50 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:21.331945 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a9225-2506-482c-82a8-d0fe5f0e18b5 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:21.337763 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8faea0-b004-4895-861a-e0ea63e77d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:21.338432 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8faea0-b004-4895-861a-e0ea63e77d37 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:21.338737 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8faea0-b004-4895-861a-e0ea63e77d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:21.339041 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8faea0-b004-4895-861a-e0ea63e77d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:21.339786 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8faea0-b004-4895-861a-e0ea63e77d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:21.341463 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8faea0-b004-4895-861a-e0ea63e77d37 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:21.343962 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e88fd-4e24-4b16-aa42-eb395c4dda50 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:21.354671 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9af56-11ac-4086-8a81-ddf12838617a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:21.355747 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9af56-11ac-4086-8a81-ddf12838617a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:21.356254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9af56-11ac-4086-8a81-ddf12838617a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:21.356937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9af56-11ac-4086-8a81-ddf12838617a admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:21.358708 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9af56-11ac-4086-8a81-ddf12838617a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:21.363188 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1034/2056] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:21.365333 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48954cd7-1779-40ac-991c-cf70c118ac38 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:21.365712 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9af56-11ac-4086-8a81-ddf12838617a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:21.366927 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48954cd7-1779-40ac-991c-cf70c118ac38 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:21.367327 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48954cd7-1779-40ac-991c-cf70c118ac38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:21.379692 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1023/2057] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:21.380953 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9af56-11ac-4086-8a81-ddf12838617a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:21.389450 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-48954cd7-1779-40ac-991c-cf70c118ac38 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:21.390773 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-48954cd7-1779-40ac-991c-cf70c118ac38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:21.398124 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9af56-11ac-4086-8a81-ddf12838617a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:21.403955 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1035/2058] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:21.403955 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48954cd7-1779-40ac-991c-cf70c118ac38 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:21.406706 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa6667-4b97-4c80-830c-a3b92284ec3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:21.408276 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa6667-4b97-4c80-830c-a3b92284ec3e admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:21.408636 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa6667-4b97-4c80-830c-a3b92284ec3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:21.408982 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa6667-4b97-4c80-830c-a3b92284ec3e admin admin] PATH_INFO: `/v3/projects/be7addaafa05418298fc0b845e457a4f/users/4747d841e84a4f7888da9fdec0ba20d0/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:21.417609 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48954cd7-1779-40ac-991c-cf70c118ac38 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:21.423658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9e90d-9578-4e6d-8c2a-3a3e14afc0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:21.424444 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9e90d-9578-4e6d-8c2a-3a3e14afc0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:21.424742 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9e90d-9578-4e6d-8c2a-3a3e14afc0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:21.425021 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9e90d-9578-4e6d-8c2a-3a3e14afc0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:21.425860 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9e90d-9578-4e6d-8c2a-3a3e14afc0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:21.427487 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9e90d-9578-4e6d-8c2a-3a3e14afc0c8 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:21.431363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa6667-4b97-4c80-830c-a3b92284ec3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7addaafa05418298fc0b845e457a4f, user_id=4747d841e84a4f7888da9fdec0ba20d0, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:21.436704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa6667-4b97-4c80-830c-a3b92284ec3e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:21.444724 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1036/2059] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:21.444724 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9e90d-9578-4e6d-8c2a-3a3e14afc0c8 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:21.456526 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9e90d-9578-4e6d-8c2a-3a3e14afc0c8 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:21.463687 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1024/2060] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:21 2022] PUT /identity/v3/projects/be7addaafa05418298fc0b845e457a4f/users/4747d841e84a4f7888da9fdec0ba20d0/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:21.473156 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa6667-4b97-4c80-830c-a3b92284ec3e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:21.532750 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa6667-4b97-4c80-830c-a3b92284ec3e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:21.537761 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199f169-47dd-4fd8-9557-823fc25f30fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:21.539338 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199f169-47dd-4fd8-9557-823fc25f30fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:21.539642 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199f169-47dd-4fd8-9557-823fc25f30fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:21.540042 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199f169-47dd-4fd8-9557-823fc25f30fe admin admin] PATH_INFO: `/v3/projects/19e24f27bd11401fa1697076dae7d98b/users/1e6c8a8fa3ec4d10a23eee48422ef73d/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:21.545146 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffc6c4-3dbb-4598-841d-a3e43c6a23f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:21.545935 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffc6c4-3dbb-4598-841d-a3e43c6a23f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:21.546324 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffc6c4-3dbb-4598-841d-a3e43c6a23f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:21.546705 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffc6c4-3dbb-4598-841d-a3e43c6a23f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:21.547898 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffc6c4-3dbb-4598-841d-a3e43c6a23f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:16:21.547898 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffc6c4-3dbb-4598-841d-a3e43c6a23f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:21.550057 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffc6c4-3dbb-4598-841d-a3e43c6a23f9 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:21.557831 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199f169-47dd-4fd8-9557-823fc25f30fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e24f27bd11401fa1697076dae7d98b, user_id=1e6c8a8fa3ec4d10a23eee48422ef73d, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:21.560606 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199f169-47dd-4fd8-9557-823fc25f30fe admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:21.566746 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1037/2061] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:16:21.571250 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fb063-d1c5-40e8-82e5-97b3b7d2f172 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:21.571639 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fb063-d1c5-40e8-82e5-97b3b7d2f172 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:21.571938 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fb063-d1c5-40e8-82e5-97b3b7d2f172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:21.581844 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1025/2062] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:21 2022] PUT /identity/v3/projects/19e24f27bd11401fa1697076dae7d98b/users/1e6c8a8fa3ec4d10a23eee48422ef73d/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:21.583094 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199f169-47dd-4fd8-9557-823fc25f30fe admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:21.634701 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-bc4fb063-d1c5-40e8-82e5-97b3b7d2f172 None None] MFA Rules not processed for user `4747d841e84a4f7888da9fdec0ba20d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:21.636229 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-bc4fb063-d1c5-40e8-82e5-97b3b7d2f172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:21.689795 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199f169-47dd-4fd8-9557-823fc25f30fe admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:21.697554 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e502fd-402b-49a9-a8eb-715f32bbfede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:21.698275 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e502fd-402b-49a9-a8eb-715f32bbfede admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:21.698568 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e502fd-402b-49a9-a8eb-715f32bbfede admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:21.698848 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e502fd-402b-49a9-a8eb-715f32bbfede admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:21.699616 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e502fd-402b-49a9-a8eb-715f32bbfede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:21.701666 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e502fd-402b-49a9-a8eb-715f32bbfede admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:21.716334 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1038/2063] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:21.717988 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb55cb-514c-4ed7-9881-e1f39022ff50 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:21.718437 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb55cb-514c-4ed7-9881-e1f39022ff50 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:21.718816 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb55cb-514c-4ed7-9881-e1f39022ff50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:21.754516 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-99cb55cb-514c-4ed7-9881-e1f39022ff50 None None] MFA Rules not processed for user `1e6c8a8fa3ec4d10a23eee48422ef73d`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:21.758797 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1026/2064] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:21 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:21.758797 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e502fd-402b-49a9-a8eb-715f32bbfede admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:21.758997 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-99cb55cb-514c-4ed7-9881-e1f39022ff50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:21.829640 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1039/2065] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:21.830384 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb55cb-514c-4ed7-9881-e1f39022ff50 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:21.837928 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e502fd-402b-49a9-a8eb-715f32bbfede admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:21.843074 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb55cb-514c-4ed7-9881-e1f39022ff50 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:21.843304 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518f3c0-c90f-4b41-a457-e2293008bbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:21.844105 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518f3c0-c90f-4b41-a457-e2293008bbad admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:21.844465 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518f3c0-c90f-4b41-a457-e2293008bbad admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:21.844818 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518f3c0-c90f-4b41-a457-e2293008bbad admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:21.845796 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518f3c0-c90f-4b41-a457-e2293008bbad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:21.847779 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518f3c0-c90f-4b41-a457-e2293008bbad admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:21.848355 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2384132-316b-448c-9926-aeae33790e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:21.849205 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2384132-316b-448c-9926-aeae33790e17 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:21.849635 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2384132-316b-448c-9926-aeae33790e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:21.850080 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2384132-316b-448c-9926-aeae33790e17 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:21.851850 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2384132-316b-448c-9926-aeae33790e17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:21.853733 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2384132-316b-448c-9926-aeae33790e17 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:21.875423 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1040/2066] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:21 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:21.876371 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2384132-316b-448c-9926-aeae33790e17 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:21.880706 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1027/2067] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:21 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:21.882880 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518f3c0-c90f-4b41-a457-e2293008bbad admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:21.888782 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2384132-316b-448c-9926-aeae33790e17 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:21.970129 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518f3c0-c90f-4b41-a457-e2293008bbad admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:21.977898 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1207d-5695-41ce-bb28-fadd3ba9981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:21.978895 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1207d-5695-41ce-bb28-fadd3ba9981e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:21.979356 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1207d-5695-41ce-bb28-fadd3ba9981e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:21.979778 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1207d-5695-41ce-bb28-fadd3ba9981e admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:21.980692 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1207d-5695-41ce-bb28-fadd3ba9981e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:21.982453 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1207d-5695-41ce-bb28-fadd3ba9981e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:21.996246 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1028/2068] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:21.997295 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1207d-5695-41ce-bb28-fadd3ba9981e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:22.003581 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460f028-001d-4dfe-b324-3af631799c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:22.004948 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460f028-001d-4dfe-b324-3af631799c5b admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:22.005589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460f028-001d-4dfe-b324-3af631799c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:22.006116 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460f028-001d-4dfe-b324-3af631799c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:22.007435 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460f028-001d-4dfe-b324-3af631799c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:22.009853 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1207d-5695-41ce-bb28-fadd3ba9981e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:22.010046 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460f028-001d-4dfe-b324-3af631799c5b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:22.016037 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f941a-4fa2-4580-9ce8-2307dccee368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:22.016713 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f941a-4fa2-4580-9ce8-2307dccee368 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:22.016996 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f941a-4fa2-4580-9ce8-2307dccee368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:22.017274 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f941a-4fa2-4580-9ce8-2307dccee368 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:22.018465 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f941a-4fa2-4580-9ce8-2307dccee368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:22.020594 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f941a-4fa2-4580-9ce8-2307dccee368 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:22.047916 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1029/2069] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:21 2022] POST /identity/v3/users => generated 298 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:22.048765 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f941a-4fa2-4580-9ce8-2307dccee368 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:22.057009 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1041/2070] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:21 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:22.057619 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460f028-001d-4dfe-b324-3af631799c5b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:22.062144 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f941a-4fa2-4580-9ce8-2307dccee368 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:22.161668 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460f028-001d-4dfe-b324-3af631799c5b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:22.162420 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f66bc6-0ec7-4414-afaf-e3e0371e61ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:22.163725 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f66bc6-0ec7-4414-afaf-e3e0371e61ab admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:22.164127 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f66bc6-0ec7-4414-afaf-e3e0371e61ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:22.164498 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f66bc6-0ec7-4414-afaf-e3e0371e61ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:22.165248 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f66bc6-0ec7-4414-afaf-e3e0371e61ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:22.166909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f66bc6-0ec7-4414-afaf-e3e0371e61ab admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:22.167397 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f74bc-98a5-4ae6-ad98-55feacbaf72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:22.168353 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f74bc-98a5-4ae6-ad98-55feacbaf72d admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:22.168466 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f74bc-98a5-4ae6-ad98-55feacbaf72d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:22.168851 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f74bc-98a5-4ae6-ad98-55feacbaf72d admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:22.169661 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f74bc-98a5-4ae6-ad98-55feacbaf72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:22.171293 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f74bc-98a5-4ae6-ad98-55feacbaf72d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:22.178304 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1030/2071] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:22.180099 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f66bc6-0ec7-4414-afaf-e3e0371e61ab admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:22.182184 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1042/2072] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:22.185940 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f74bc-98a5-4ae6-ad98-55feacbaf72d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:22.187486 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a91f74bc-98a5-4ae6-ad98-55feacbaf72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:22.191399 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f66bc6-0ec7-4414-afaf-e3e0371e61ab admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:22.196867 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496b70a-d3eb-4618-8dbc-b7275bd22649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:22.197607 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496b70a-d3eb-4618-8dbc-b7275bd22649 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:22.198505 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496b70a-d3eb-4618-8dbc-b7275bd22649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:22.198860 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496b70a-d3eb-4618-8dbc-b7275bd22649 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:22.199855 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496b70a-d3eb-4618-8dbc-b7275bd22649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:22.200031 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f74bc-98a5-4ae6-ad98-55feacbaf72d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:22.201754 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496b70a-d3eb-4618-8dbc-b7275bd22649 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:22.205709 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1dccf-14b7-44ce-a424-1250b075e18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:22.206546 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1dccf-14b7-44ce-a424-1250b075e18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:22.206825 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1dccf-14b7-44ce-a424-1250b075e18f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:22.207098 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1dccf-14b7-44ce-a424-1250b075e18f admin admin] PATH_INFO: `/v3/projects/438f2f7584cc43648f582c8d86029ceb` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:22.208309 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1dccf-14b7-44ce-a424-1250b075e18f admin admin] RBAC: Authorizing `identity:delete_project(project_id=438f2f7584cc43648f582c8d86029ceb)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:22.210290 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1dccf-14b7-44ce-a424-1250b075e18f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:22.224091 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1031/2073] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:22 2022] POST /identity/v3/users => generated 294 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:22.225172 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496b70a-d3eb-4618-8dbc-b7275bd22649 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:22.235889 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496b70a-d3eb-4618-8dbc-b7275bd22649 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:22.243248 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced267d2-ce9f-4d56-9cc0-03f53112d704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:22.245697 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced267d2-ce9f-4d56-9cc0-03f53112d704 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:22.245697 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced267d2-ce9f-4d56-9cc0-03f53112d704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:22.245926 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced267d2-ce9f-4d56-9cc0-03f53112d704 admin admin] PATH_INFO: `/v3/projects/9ab827d79cef43f39e5dcc8f7d9bfe28/users/3da4e93429a84af6ba36fc0fbc544a16/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:22.261870 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f8c1dccf-14b7-44ce-a424-1250b075e18f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '438f2f7584cc43648f582c8d86029ceb', 'request_id': 'req-f8c1dccf-14b7-44ce-a424-1250b075e18f'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:22.262061 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced267d2-ce9f-4d56-9cc0-03f53112d704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ab827d79cef43f39e5dcc8f7d9bfe28, user_id=3da4e93429a84af6ba36fc0fbc544a16, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:22.264646 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced267d2-ce9f-4d56-9cc0-03f53112d704 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:22.267503 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f8c1dccf-14b7-44ce-a424-1250b075e18f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '438f2f7584cc43648f582c8d86029ceb', 'request_id': 'req-f8c1dccf-14b7-44ce-a424-1250b075e18f'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:22.275367 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f8c1dccf-14b7-44ce-a424-1250b075e18f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '438f2f7584cc43648f582c8d86029ceb', 'request_id': 'req-f8c1dccf-14b7-44ce-a424-1250b075e18f'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:22.282065 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1032/2074] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:22 2022] PUT /identity/v3/projects/9ab827d79cef43f39e5dcc8f7d9bfe28/users/3da4e93429a84af6ba36fc0fbc544a16/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:22.283009 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced267d2-ce9f-4d56-9cc0-03f53112d704 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:22.293632 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f8c1dccf-14b7-44ce-a424-1250b075e18f admin admin] The token cache is being invalidate because project 438f2f7584cc43648f582c8d86029ceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:22.294353 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f8c1dccf-14b7-44ce-a424-1250b075e18f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:22.295142 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f8c1dccf-14b7-44ce-a424-1250b075e18f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:22.299056 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1043/2075] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:22 2022] DELETE /identity/v3/projects/438f2f7584cc43648f582c8d86029ceb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:22.299978 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1dccf-14b7-44ce-a424-1250b075e18f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:22.301520 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-f8c1dccf-14b7-44ce-a424-1250b075e18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:22.364404 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced267d2-ce9f-4d56-9cc0-03f53112d704 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:22.371853 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4848e80-789c-44d7-aa8f-745851c189d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:22.373038 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4848e80-789c-44d7-aa8f-745851c189d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:22.373395 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4848e80-789c-44d7-aa8f-745851c189d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:22.373738 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4848e80-789c-44d7-aa8f-745851c189d8 admin admin] PATH_INFO: `/v3/projects/9f811a0d45b8454bbf6a8ac245fbbf99/users/f80829257a9d4730890acfbe3fb8c0ea/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:22.384608 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1dccf-14b7-44ce-a424-1250b075e18f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:22.389908 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9c21e-84f7-4e85-8d7e-9720aed9cfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:22.390780 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9c21e-84f7-4e85-8d7e-9720aed9cfdd admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:22.391069 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9c21e-84f7-4e85-8d7e-9720aed9cfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:22.391349 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9c21e-84f7-4e85-8d7e-9720aed9cfdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:22.392719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9c21e-84f7-4e85-8d7e-9720aed9cfdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:22.392835 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4848e80-789c-44d7-aa8f-745851c189d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f811a0d45b8454bbf6a8ac245fbbf99, user_id=f80829257a9d4730890acfbe3fb8c0ea, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:22.393924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9c21e-84f7-4e85-8d7e-9720aed9cfdd admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:22.395401 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4848e80-789c-44d7-aa8f-745851c189d8 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:22.412002 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1044/2076] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:22.414463 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e3b23-6a05-4ce8-aeb0-7c31c56d9308 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:22.414963 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e3b23-6a05-4ce8-aeb0-7c31c56d9308 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:22.415443 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e3b23-6a05-4ce8-aeb0-7c31c56d9308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:22.421800 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1033/2077] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:22 2022] PUT /identity/v3/projects/9f811a0d45b8454bbf6a8ac245fbbf99/users/f80829257a9d4730890acfbe3fb8c0ea/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:22.422956 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4848e80-789c-44d7-aa8f-745851c189d8 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:22.425009 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-c4848e80-789c-44d7-aa8f-745851c189d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:22.437901 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-e17e3b23-6a05-4ce8-aeb0-7c31c56d9308 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:22.439241 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e17e3b23-6a05-4ce8-aeb0-7c31c56d9308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:22.503041 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4848e80-789c-44d7-aa8f-745851c189d8 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:22.506300 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1045/2078] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:22.507564 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e3b23-6a05-4ce8-aeb0-7c31c56d9308 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:22.517521 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300820aa-6f0d-46ea-b8e9-278eefb7af2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:22.518371 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e3b23-6a05-4ce8-aeb0-7c31c56d9308 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:22.518490 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300820aa-6f0d-46ea-b8e9-278eefb7af2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:22.518684 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300820aa-6f0d-46ea-b8e9-278eefb7af2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:22.518964 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300820aa-6f0d-46ea-b8e9-278eefb7af2b admin admin] PATH_INFO: `/v3/users/887cdfb834084f728adf42ffeb6bd4f8` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:22.520296 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300820aa-6f0d-46ea-b8e9-278eefb7af2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=887cdfb834084f728adf42ffeb6bd4f8)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:22.522999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300820aa-6f0d-46ea-b8e9-278eefb7af2b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:22.523897 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e99e6e-ba8c-4f4f-a75a-958e00204876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:22.524560 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e99e6e-ba8c-4f4f-a75a-958e00204876 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:22.524840 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e99e6e-ba8c-4f4f-a75a-958e00204876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:22.525116 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e99e6e-ba8c-4f4f-a75a-958e00204876 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:22.526000 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e99e6e-ba8c-4f4f-a75a-958e00204876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:22.527647 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e99e6e-ba8c-4f4f-a75a-958e00204876 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:22.539448 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1046/2079] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:22.540336 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e99e6e-ba8c-4f4f-a75a-958e00204876 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:22.542072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-35e99e6e-ba8c-4f4f-a75a-958e00204876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:22.556799 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e99e6e-ba8c-4f4f-a75a-958e00204876 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:22.562045 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290f4bf-cce7-458c-b373-3169ffb73515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:22.562774 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290f4bf-cce7-458c-b373-3169ffb73515 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:22.563105 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290f4bf-cce7-458c-b373-3169ffb73515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:22.563394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290f4bf-cce7-458c-b373-3169ffb73515 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:22.564183 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290f4bf-cce7-458c-b373-3169ffb73515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:22.566087 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290f4bf-cce7-458c-b373-3169ffb73515 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:22.577299 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1047/2080] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:22.578232 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290f4bf-cce7-458c-b373-3169ffb73515 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:22.585303 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-5290f4bf-cce7-458c-b373-3169ffb73515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:22.587583 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-300820aa-6f0d-46ea-b8e9-278eefb7af2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '887cdfb834084f728adf42ffeb6bd4f8'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:22.602086 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-300820aa-6f0d-46ea-b8e9-278eefb7af2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '887cdfb834084f728adf42ffeb6bd4f8'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:22.602837 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-300820aa-6f0d-46ea-b8e9-278eefb7af2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '887cdfb834084f728adf42ffeb6bd4f8'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:22.603476 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-300820aa-6f0d-46ea-b8e9-278eefb7af2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '887cdfb834084f728adf42ffeb6bd4f8'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:22.615130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-300820aa-6f0d-46ea-b8e9-278eefb7af2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '887cdfb834084f728adf42ffeb6bd4f8'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:22.641432 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1034/2081] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:22 2022] DELETE /identity/v3/users/887cdfb834084f728adf42ffeb6bd4f8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:22.644783 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300820aa-6f0d-46ea-b8e9-278eefb7af2b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:22.653658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290f4bf-cce7-458c-b373-3169ffb73515 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:22.654595 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-300820aa-6f0d-46ea-b8e9-278eefb7af2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:22.711016 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c41d5-a5ca-48bc-b343-a54e62de03d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:22.711768 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c41d5-a5ca-48bc-b343-a54e62de03d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:22.712153 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c41d5-a5ca-48bc-b343-a54e62de03d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:22.712551 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c41d5-a5ca-48bc-b343-a54e62de03d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:22.715616 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-9e4c41d5-a5ca-48bc-b343-a54e62de03d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:22.789006 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c41d5-a5ca-48bc-b343-a54e62de03d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:22.790653 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c41d5-a5ca-48bc-b343-a54e62de03d7 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:22.802349 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1048/2082] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:22.803494 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c41d5-a5ca-48bc-b343-a54e62de03d7 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:22.816325 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-9e4c41d5-a5ca-48bc-b343-a54e62de03d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:22.830239 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300820aa-6f0d-46ea-b8e9-278eefb7af2b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:22.844852 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b427373-4db0-41c6-b5b1-c5e4085caa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:22.845559 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b427373-4db0-41c6-b5b1-c5e4085caa08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:22.845844 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b427373-4db0-41c6-b5b1-c5e4085caa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:22.846122 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b427373-4db0-41c6-b5b1-c5e4085caa08 admin admin] PATH_INFO: `/v3/projects/fc1da23324e94c50ab096dc265a2286b/users/0fe33d9310764bda9143437b9f72551b/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:22.846597 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c41d5-a5ca-48bc-b343-a54e62de03d7 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:22.861954 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693ebad-1e80-4678-9797-a6c4573be96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:22.863074 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693ebad-1e80-4678-9797-a6c4573be96c admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:22.863191 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693ebad-1e80-4678-9797-a6c4573be96c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:22.867993 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693ebad-1e80-4678-9797-a6c4573be96c admin admin] PATH_INFO: `/v3/projects/9f811a0d45b8454bbf6a8ac245fbbf99/users/f80829257a9d4730890acfbe3fb8c0ea/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:22.870885 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693ebad-1e80-4678-9797-a6c4573be96c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f811a0d45b8454bbf6a8ac245fbbf99, user_id=f80829257a9d4730890acfbe3fb8c0ea, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:22.876817 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693ebad-1e80-4678-9797-a6c4573be96c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:22.882852 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b427373-4db0-41c6-b5b1-c5e4085caa08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1da23324e94c50ab096dc265a2286b, user_id=0fe33d9310764bda9143437b9f72551b, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:22.889492 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b427373-4db0-41c6-b5b1-c5e4085caa08 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:22.905284 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1049/2083] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:22 2022] PUT /identity/v3/projects/9f811a0d45b8454bbf6a8ac245fbbf99/users/f80829257a9d4730890acfbe3fb8c0ea/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:22.919086 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412fa29-629c-4540-ae37-23fc0cb93be5 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:22.920202 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412fa29-629c-4540-ae37-23fc0cb93be5 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:22.920721 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412fa29-629c-4540-ae37-23fc0cb93be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:22.926975 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1035/2084] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:22 2022] PUT /identity/v3/projects/fc1da23324e94c50ab096dc265a2286b/users/0fe33d9310764bda9143437b9f72551b/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:22.942908 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a5d82-6c4b-4021-b2e7-4a1ba6f48307 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:22.943200 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a5d82-6c4b-4021-b2e7-4a1ba6f48307 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:22.943495 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a5d82-6c4b-4021-b2e7-4a1ba6f48307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:22.959180 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-3412fa29-629c-4540-ae37-23fc0cb93be5 None None] MFA Rules not processed for user `f80829257a9d4730890acfbe3fb8c0ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:22.960661 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-3412fa29-629c-4540-ae37-23fc0cb93be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:22.996543 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-662a5d82-6c4b-4021-b2e7-4a1ba6f48307 None None] MFA Rules not processed for user `0fe33d9310764bda9143437b9f72551b`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:22.997801 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-662a5d82-6c4b-4021-b2e7-4a1ba6f48307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:23.104153 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1050/2085] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:23.115790 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412fa29-629c-4540-ae37-23fc0cb93be5 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:23.120498 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-3412fa29-629c-4540-ae37-23fc0cb93be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:23.136948 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1036/2086] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:16:23.139086 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a5d82-6c4b-4021-b2e7-4a1ba6f48307 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:23.221470 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412fa29-629c-4540-ae37-23fc0cb93be5 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:23.229675 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcba74e-8091-4e89-805d-ff3d84d4b731 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:23.230358 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcba74e-8091-4e89-805d-ff3d84d4b731 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:23.230658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcba74e-8091-4e89-805d-ff3d84d4b731 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:23.230998 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcba74e-8091-4e89-805d-ff3d84d4b731 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:23.254769 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a5d82-6c4b-4021-b2e7-4a1ba6f48307 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:23.261746 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcba74e-8091-4e89-805d-ff3d84d4b731 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:23.262929 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12758f18-2287-4470-b723-f219b55ff40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:23.264012 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12758f18-2287-4470-b723-f219b55ff40d admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:23.264415 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12758f18-2287-4470-b723-f219b55ff40d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:23.264697 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12758f18-2287-4470-b723-f219b55ff40d admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:23.265467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12758f18-2287-4470-b723-f219b55ff40d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:23.267556 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12758f18-2287-4470-b723-f219b55ff40d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:23.274977 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcba74e-8091-4e89-805d-ff3d84d4b731 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:23.291416 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1051/2087] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:16:23.312034 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1037/2088] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:23 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:23.313876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcba74e-8091-4e89-805d-ff3d84d4b731 service cinder] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:23.327675 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcba74e-8091-4e89-805d-ff3d84d4b731 service cinder] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:23.328296 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12758f18-2287-4470-b723-f219b55ff40d admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:23.331633 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-12758f18-2287-4470-b723-f219b55ff40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:23.463162 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a68bd-708b-4f06-996a-d213678df330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:23.464374 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a68bd-708b-4f06-996a-d213678df330 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:23.464833 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a68bd-708b-4f06-996a-d213678df330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:23.465265 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a68bd-708b-4f06-996a-d213678df330 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:23.466329 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a68bd-708b-4f06-996a-d213678df330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:23.468546 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a68bd-708b-4f06-996a-d213678df330 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:23.495022 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12758f18-2287-4470-b723-f219b55ff40d admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:23.504420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1052/2089] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:23 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:23.505786 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a68bd-708b-4f06-996a-d213678df330 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:23.512660 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5afce-d90f-4803-bd3a-3d32d513fa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:23.513552 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5afce-d90f-4803-bd3a-3d32d513fa29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:23.513866 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5afce-d90f-4803-bd3a-3d32d513fa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:23.514116 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5afce-d90f-4803-bd3a-3d32d513fa29 admin admin] PATH_INFO: `/v3/projects/5a298687a6594cbbb419f1d81d044f85` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:23.515697 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5afce-d90f-4803-bd3a-3d32d513fa29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a298687a6594cbbb419f1d81d044f85)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:23.518460 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5afce-d90f-4803-bd3a-3d32d513fa29 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:23.585461 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-3da5afce-d90f-4803-bd3a-3d32d513fa29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a298687a6594cbbb419f1d81d044f85', 'request_id': 'req-3da5afce-d90f-4803-bd3a-3d32d513fa29'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:23.601813 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-3da5afce-d90f-4803-bd3a-3d32d513fa29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a298687a6594cbbb419f1d81d044f85', 'request_id': 'req-3da5afce-d90f-4803-bd3a-3d32d513fa29'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:23.610097 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-3da5afce-d90f-4803-bd3a-3d32d513fa29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a298687a6594cbbb419f1d81d044f85', 'request_id': 'req-3da5afce-d90f-4803-bd3a-3d32d513fa29'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:23.617970 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a68bd-708b-4f06-996a-d213678df330 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:23.625317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-3da5afce-d90f-4803-bd3a-3d32d513fa29 admin admin] The token cache is being invalidate because project 5a298687a6594cbbb419f1d81d044f85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:23.625979 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-3da5afce-d90f-4803-bd3a-3d32d513fa29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:23.626669 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-3da5afce-d90f-4803-bd3a-3d32d513fa29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:23.628498 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1038/2090] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:23 2022] DELETE /identity/v3/projects/5a298687a6594cbbb419f1d81d044f85 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:23.633079 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5afce-d90f-4803-bd3a-3d32d513fa29 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:23.634979 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-3da5afce-d90f-4803-bd3a-3d32d513fa29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:23.727514 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76424fd4-16d8-4288-9af3-86eb7b643672 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:23.728684 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76424fd4-16d8-4288-9af3-86eb7b643672 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:23.732343 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76424fd4-16d8-4288-9af3-86eb7b643672 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:23.732869 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76424fd4-16d8-4288-9af3-86eb7b643672 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:23.735171 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-76424fd4-16d8-4288-9af3-86eb7b643672 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:23.735803 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5afce-d90f-4803-bd3a-3d32d513fa29 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:23.741983 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da2166-091a-402c-b181-1556e60ff6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:23.742923 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da2166-091a-402c-b181-1556e60ff6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:23.743679 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da2166-091a-402c-b181-1556e60ff6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:23.743679 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da2166-091a-402c-b181-1556e60ff6f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:23.744687 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da2166-091a-402c-b181-1556e60ff6f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:23.746299 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da2166-091a-402c-b181-1556e60ff6f6 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:23.760879 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1039/2091] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:23.762420 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e6f96-a1ac-49c0-adb3-f98a0799d353 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:23.762710 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e6f96-a1ac-49c0-adb3-f98a0799d353 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:23.762982 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e6f96-a1ac-49c0-adb3-f98a0799d353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:23.783399 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-a65e6f96-a1ac-49c0-adb3-f98a0799d353 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:23.784798 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a65e6f96-a1ac-49c0-adb3-f98a0799d353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:23.794368 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1040/2092] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:23.795243 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e6f96-a1ac-49c0-adb3-f98a0799d353 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:23.813011 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e6f96-a1ac-49c0-adb3-f98a0799d353 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:23.819618 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806df6ae-5a1b-4510-b913-976efa78d3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:23.820666 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806df6ae-5a1b-4510-b913-976efa78d3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:23.821026 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806df6ae-5a1b-4510-b913-976efa78d3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:23.821433 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806df6ae-5a1b-4510-b913-976efa78d3ca admin admin] PATH_INFO: `/v3/projects/407b483e8f844441b0552578f263f1fa/users/f1080e8b0cf0480a9e2b415d38264fd0/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:23.829451 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76424fd4-16d8-4288-9af3-86eb7b643672 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:23.830911 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76424fd4-16d8-4288-9af3-86eb7b643672 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:23.847332 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1053/2093] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:23.849315 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090eb84-3d0e-4161-94c4-5dfa0ccb2992 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:23.849618 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090eb84-3d0e-4161-94c4-5dfa0ccb2992 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:23.849739 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806df6ae-5a1b-4510-b913-976efa78d3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=407b483e8f844441b0552578f263f1fa, user_id=f1080e8b0cf0480a9e2b415d38264fd0, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:23.849891 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090eb84-3d0e-4161-94c4-5dfa0ccb2992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:23.853758 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806df6ae-5a1b-4510-b913-976efa78d3ca admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:23.891709 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1041/2094] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:23 2022] PUT /identity/v3/projects/407b483e8f844441b0552578f263f1fa/users/f1080e8b0cf0480a9e2b415d38264fd0/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:23.893382 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806df6ae-5a1b-4510-b913-976efa78d3ca admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:23.894075 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-e090eb84-3d0e-4161-94c4-5dfa0ccb2992 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:23.895306 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e090eb84-3d0e-4161-94c4-5dfa0ccb2992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:23.995277 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806df6ae-5a1b-4510-b913-976efa78d3ca admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:24.007345 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1054/2095] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:24.012414 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090eb84-3d0e-4161-94c4-5dfa0ccb2992 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:24.018299 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3439b7-4c48-4b54-ad6d-6e57854fcb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:24.019354 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3439b7-4c48-4b54-ad6d-6e57854fcb90 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:24.019787 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3439b7-4c48-4b54-ad6d-6e57854fcb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:24.020256 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3439b7-4c48-4b54-ad6d-6e57854fcb90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:24.024816 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3439b7-4c48-4b54-ad6d-6e57854fcb90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:24.028440 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3439b7-4c48-4b54-ad6d-6e57854fcb90 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:24.040086 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090eb84-3d0e-4161-94c4-5dfa0ccb2992 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:24.045873 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1042/2096] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:24.046829 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3439b7-4c48-4b54-ad6d-6e57854fcb90 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:24.059026 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3439b7-4c48-4b54-ad6d-6e57854fcb90 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:24.060300 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac279e0-4247-4217-ac84-114dc115f9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:24.061143 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac279e0-4247-4217-ac84-114dc115f9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:24.065476 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae7717-06c0-4ef5-8d19-654671d60959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:24.066748 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae7717-06c0-4ef5-8d19-654671d60959 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:24.067111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae7717-06c0-4ef5-8d19-654671d60959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:24.067491 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae7717-06c0-4ef5-8d19-654671d60959 admin admin] PATH_INFO: `/v3/projects/407b483e8f844441b0552578f263f1fa/users/f1080e8b0cf0480a9e2b415d38264fd0/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:24.071454 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae7717-06c0-4ef5-8d19-654671d60959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=407b483e8f844441b0552578f263f1fa, user_id=f1080e8b0cf0480a9e2b415d38264fd0, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:24.076884 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae7717-06c0-4ef5-8d19-654671d60959 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:24.077375 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac279e0-4247-4217-ac84-114dc115f9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:24.077911 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac279e0-4247-4217-ac84-114dc115f9f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:24.078779 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac279e0-4247-4217-ac84-114dc115f9f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:16:24.079098 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac279e0-4247-4217-ac84-114dc115f9f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:24.080870 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac279e0-4247-4217-ac84-114dc115f9f3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:24.102032 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1043/2097] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:24 2022] PUT /identity/v3/projects/407b483e8f844441b0552578f263f1fa/users/f1080e8b0cf0480a9e2b415d38264fd0/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:24.102032 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc22dd-bacf-4d81-9e0d-405fa3754387 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:24.102032 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc22dd-bacf-4d81-9e0d-405fa3754387 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:24.102032 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc22dd-bacf-4d81-9e0d-405fa3754387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:24.112768 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1055/2098] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:16:24.114711 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20b4d-f3be-43db-8948-4743648daae7 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:24.115006 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20b4d-f3be-43db-8948-4743648daae7 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:24.115290 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20b4d-f3be-43db-8948-4743648daae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:24.154229 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-27dc22dd-bacf-4d81-9e0d-405fa3754387 None None] MFA Rules not processed for user `3da4e93429a84af6ba36fc0fbc544a16`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:24.154229 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-27dc22dd-bacf-4d81-9e0d-405fa3754387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:24.168814 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-39f20b4d-f3be-43db-8948-4743648daae7 None None] MFA Rules not processed for user `f1080e8b0cf0480a9e2b415d38264fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:24.171074 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-39f20b4d-f3be-43db-8948-4743648daae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:24.258132 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1044/2099] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:24.259138 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc22dd-bacf-4d81-9e0d-405fa3754387 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:24.282009 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1056/2100] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:24.283080 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f20b4d-f3be-43db-8948-4743648daae7 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:24.285870 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-39f20b4d-f3be-43db-8948-4743648daae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:24.366959 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc22dd-bacf-4d81-9e0d-405fa3754387 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:24.372083 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606ec70-b0fb-42f7-bf87-408b7849bf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:24.372842 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606ec70-b0fb-42f7-bf87-408b7849bf7c admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:24.373135 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606ec70-b0fb-42f7-bf87-408b7849bf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:24.373415 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606ec70-b0fb-42f7-bf87-408b7849bf7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:24.374136 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606ec70-b0fb-42f7-bf87-408b7849bf7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:24.380662 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606ec70-b0fb-42f7-bf87-408b7849bf7c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:24.387290 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f20b4d-f3be-43db-8948-4743648daae7 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:24.392419 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214ff7e-89f6-4929-bbd0-c8cb1f70ff7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:24.393397 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214ff7e-89f6-4929-bbd0-c8cb1f70ff7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:24.393677 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214ff7e-89f6-4929-bbd0-c8cb1f70ff7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:24.393944 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214ff7e-89f6-4929-bbd0-c8cb1f70ff7e admin admin] PATH_INFO: `/v3/users/4747d841e84a4f7888da9fdec0ba20d0` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:24.395728 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214ff7e-89f6-4929-bbd0-c8cb1f70ff7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4747d841e84a4f7888da9fdec0ba20d0)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:24.400378 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214ff7e-89f6-4929-bbd0-c8cb1f70ff7e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:24.429351 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1045/2101] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:24 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:24.436326 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606ec70-b0fb-42f7-bf87-408b7849bf7c admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:24.439625 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-8606ec70-b0fb-42f7-bf87-408b7849bf7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:24.473341 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7214ff7e-89f6-4929-bbd0-c8cb1f70ff7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4747d841e84a4f7888da9fdec0ba20d0'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:24.487038 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7214ff7e-89f6-4929-bbd0-c8cb1f70ff7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4747d841e84a4f7888da9fdec0ba20d0'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:24.487850 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7214ff7e-89f6-4929-bbd0-c8cb1f70ff7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4747d841e84a4f7888da9fdec0ba20d0'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:24.496096 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7214ff7e-89f6-4929-bbd0-c8cb1f70ff7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4747d841e84a4f7888da9fdec0ba20d0'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:24.496985 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7214ff7e-89f6-4929-bbd0-c8cb1f70ff7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4747d841e84a4f7888da9fdec0ba20d0'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:24.511402 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1057/2102] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:24 2022] DELETE /identity/v3/users/4747d841e84a4f7888da9fdec0ba20d0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:24.512105 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214ff7e-89f6-4929-bbd0-c8cb1f70ff7e admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:24.515543 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-7214ff7e-89f6-4929-bbd0-c8cb1f70ff7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:24.521763 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606ec70-b0fb-42f7-bf87-408b7849bf7c admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:24.572130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f401db-1048-4173-9325-b9f394b6bae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:24.572782 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f401db-1048-4173-9325-b9f394b6bae8 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:24.573066 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f401db-1048-4173-9325-b9f394b6bae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:24.573338 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f401db-1048-4173-9325-b9f394b6bae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:24.575131 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-13f401db-1048-4173-9325-b9f394b6bae8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:24.577888 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214ff7e-89f6-4929-bbd0-c8cb1f70ff7e admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:24.581654 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8a3a6-00d5-4a5d-a33d-8c54daef19af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:24.582290 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8a3a6-00d5-4a5d-a33d-8c54daef19af service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:24.582569 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8a3a6-00d5-4a5d-a33d-8c54daef19af service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:24.582837 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8a3a6-00d5-4a5d-a33d-8c54daef19af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:24.584703 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-54c8a3a6-00d5-4a5d-a33d-8c54daef19af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:24.633946 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f401db-1048-4173-9325-b9f394b6bae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:24.635378 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f401db-1048-4173-9325-b9f394b6bae8 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:24.644216 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1046/2103] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:24.645150 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f401db-1048-4173-9325-b9f394b6bae8 service cinder] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:24.645836 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8a3a6-00d5-4a5d-a33d-8c54daef19af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:24.646569 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-13f401db-1048-4173-9325-b9f394b6bae8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:24.647864 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8a3a6-00d5-4a5d-a33d-8c54daef19af service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:24.657813 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1058/2104] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:24.658928 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f1648-4314-4077-89e6-7ad3be24eff9 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:24.659286 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f1648-4314-4077-89e6-7ad3be24eff9 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:24.659566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f1648-4314-4077-89e6-7ad3be24eff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:24.678895 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-9b2f1648-4314-4077-89e6-7ad3be24eff9 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:24.680251 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-9b2f1648-4314-4077-89e6-7ad3be24eff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:24.735174 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f401db-1048-4173-9325-b9f394b6bae8 service cinder] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:24.747360 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ae008-4de4-45a1-b03a-eef39315feb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:24.748279 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ae008-4de4-45a1-b03a-eef39315feb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:24.748634 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ae008-4de4-45a1-b03a-eef39315feb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:24.748908 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ae008-4de4-45a1-b03a-eef39315feb7 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:24.750008 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ae008-4de4-45a1-b03a-eef39315feb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:24.752903 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ae008-4de4-45a1-b03a-eef39315feb7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:24.757770 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1059/2105] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:24.765246 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f1648-4314-4077-89e6-7ad3be24eff9 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:24.767397 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-9b2f1648-4314-4077-89e6-7ad3be24eff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:24.785313 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1047/2106] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:24 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:24.791801 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ae008-4de4-45a1-b03a-eef39315feb7 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:24.804473 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ae008-4de4-45a1-b03a-eef39315feb7 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:24.809781 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8008ea-a4f5-4027-84ff-973febdc4650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:24.810542 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8008ea-a4f5-4027-84ff-973febdc4650 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:24.810896 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8008ea-a4f5-4027-84ff-973febdc4650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:24.811240 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8008ea-a4f5-4027-84ff-973febdc4650 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:24.812086 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8008ea-a4f5-4027-84ff-973febdc4650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:24.813759 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8008ea-a4f5-4027-84ff-973febdc4650 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:24.834704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1048/2107] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:24.835978 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8008ea-a4f5-4027-84ff-973febdc4650 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:24.839655 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f1648-4314-4077-89e6-7ad3be24eff9 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:24.844394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b4791-a15f-43e9-95f0-a8067c4d22f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:24.845411 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b4791-a15f-43e9-95f0-a8067c4d22f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:24.845993 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b4791-a15f-43e9-95f0-a8067c4d22f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:24.846320 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b4791-a15f-43e9-95f0-a8067c4d22f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:24.847242 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8008ea-a4f5-4027-84ff-973febdc4650 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:24.853337 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b46dfe-bd24-475e-959a-85d916f6ee2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:24.853816 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b46dfe-bd24-475e-959a-85d916f6ee2f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:24.854288 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b46dfe-bd24-475e-959a-85d916f6ee2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:24.854576 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b46dfe-bd24-475e-959a-85d916f6ee2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:24.855318 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b46dfe-bd24-475e-959a-85d916f6ee2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:24.857091 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b46dfe-bd24-475e-959a-85d916f6ee2f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:24.866491 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b4791-a15f-43e9-95f0-a8067c4d22f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:24.868318 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b4791-a15f-43e9-95f0-a8067c4d22f6 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:24.875033 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1049/2108] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:24.879326 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1060/2109] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:16:24.880557 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b46dfe-bd24-475e-959a-85d916f6ee2f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:24.892222 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b46dfe-bd24-475e-959a-85d916f6ee2f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:24.902189 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cfbef-d238-4247-af32-3c78edc454db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:24.902189 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cfbef-d238-4247-af32-3c78edc454db admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:24.902189 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cfbef-d238-4247-af32-3c78edc454db admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:24.902189 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cfbef-d238-4247-af32-3c78edc454db admin admin] PATH_INFO: `/v3/projects/ea6f270a6c54471dbcca5ab4488d1e08/users/da2f01007359416c8955c81c814e7bc9/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:24.917084 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cfbef-d238-4247-af32-3c78edc454db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea6f270a6c54471dbcca5ab4488d1e08, user_id=da2f01007359416c8955c81c814e7bc9, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:24.920323 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cfbef-d238-4247-af32-3c78edc454db admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:24.938024 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1050/2110] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:24 2022] PUT /identity/v3/projects/ea6f270a6c54471dbcca5ab4488d1e08/users/da2f01007359416c8955c81c814e7bc9/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:24.961690 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bedef-26d3-48d9-a7fc-2410c7fc12b8 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:24.961977 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bedef-26d3-48d9-a7fc-2410c7fc12b8 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:24.962257 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bedef-26d3-48d9-a7fc-2410c7fc12b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:25.014943 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-4c3bedef-26d3-48d9-a7fc-2410c7fc12b8 None None] MFA Rules not processed for user `da2f01007359416c8955c81c814e7bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:25.016181 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-4c3bedef-26d3-48d9-a7fc-2410c7fc12b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:25.128051 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1061/2111] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:16:25.140517 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cfbef-d238-4247-af32-3c78edc454db admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:25.214064 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cfbef-d238-4247-af32-3c78edc454db admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:25.217945 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0b62e-98ba-4005-ad35-2b48e644ed84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:25.218678 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0b62e-98ba-4005-ad35-2b48e644ed84 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:25.219052 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0b62e-98ba-4005-ad35-2b48e644ed84 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:25.219390 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0b62e-98ba-4005-ad35-2b48e644ed84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:25.228971 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0b62e-98ba-4005-ad35-2b48e644ed84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:25.230476 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0b62e-98ba-4005-ad35-2b48e644ed84 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:25.246553 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1051/2112] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:25.274191 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bedef-26d3-48d9-a7fc-2410c7fc12b8 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:25.344900 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bedef-26d3-48d9-a7fc-2410c7fc12b8 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:25.354000 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe94c4e-b743-45f8-9316-3d21eb984126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:25.354987 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe94c4e-b743-45f8-9316-3d21eb984126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:25.355375 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe94c4e-b743-45f8-9316-3d21eb984126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:25.355686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe94c4e-b743-45f8-9316-3d21eb984126 admin admin] PATH_INFO: `/v3/users/da2f01007359416c8955c81c814e7bc9` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:25.357179 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe94c4e-b743-45f8-9316-3d21eb984126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da2f01007359416c8955c81c814e7bc9)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:25.359182 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe94c4e-b743-45f8-9316-3d21eb984126 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:25.363363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0b62e-98ba-4005-ad35-2b48e644ed84 service cinder] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:25.364966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-06b0b62e-98ba-4005-ad35-2b48e644ed84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:25.377381 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0b62e-98ba-4005-ad35-2b48e644ed84 service cinder] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:25.382402 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c557e1-62fc-4281-8502-4ca1df01d3dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:25.383045 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c557e1-62fc-4281-8502-4ca1df01d3dc service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:25.383325 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c557e1-62fc-4281-8502-4ca1df01d3dc service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:25.383629 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c557e1-62fc-4281-8502-4ca1df01d3dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:25.386274 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-52c557e1-62fc-4281-8502-4ca1df01d3dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:25.422555 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7fe94c4e-b743-45f8-9316-3d21eb984126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da2f01007359416c8955c81c814e7bc9'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:25.436154 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7fe94c4e-b743-45f8-9316-3d21eb984126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da2f01007359416c8955c81c814e7bc9'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:25.436965 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7fe94c4e-b743-45f8-9316-3d21eb984126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da2f01007359416c8955c81c814e7bc9'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:25.446249 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7fe94c4e-b743-45f8-9316-3d21eb984126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da2f01007359416c8955c81c814e7bc9'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:25.447499 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7fe94c4e-b743-45f8-9316-3d21eb984126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da2f01007359416c8955c81c814e7bc9'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:25.454481 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c557e1-62fc-4281-8502-4ca1df01d3dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:25.456069 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c557e1-62fc-4281-8502-4ca1df01d3dc service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:25.461720 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1062/2113] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:25 2022] DELETE /identity/v3/users/da2f01007359416c8955c81c814e7bc9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:25.462762 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe94c4e-b743-45f8-9316-3d21eb984126 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:25.464295 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-7fe94c4e-b743-45f8-9316-3d21eb984126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:25.467208 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1052/2114] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:16:25.468797 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8bd24-28d4-4337-ae1f-4a5f39a143d7 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:25.469134 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8bd24-28d4-4337-ae1f-4a5f39a143d7 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:25.469478 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8bd24-28d4-4337-ae1f-4a5f39a143d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:25.488743 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-fdd8bd24-28d4-4337-ae1f-4a5f39a143d7 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:25.489943 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-fdd8bd24-28d4-4337-ae1f-4a5f39a143d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:25.535753 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe94c4e-b743-45f8-9316-3d21eb984126 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:25.541750 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490b6fa-36d5-42a0-889b-690069efe0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:25.542671 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490b6fa-36d5-42a0-889b-690069efe0ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:25.542958 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490b6fa-36d5-42a0-889b-690069efe0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:25.543350 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490b6fa-36d5-42a0-889b-690069efe0ba admin admin] PATH_INFO: `/v3/projects/be7addaafa05418298fc0b845e457a4f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:25.544477 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490b6fa-36d5-42a0-889b-690069efe0ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=be7addaafa05418298fc0b845e457a4f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:25.547341 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490b6fa-36d5-42a0-889b-690069efe0ba admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:25.556135 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1053/2115] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:25.568024 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8bd24-28d4-4337-ae1f-4a5f39a143d7 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:25.570675 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-fdd8bd24-28d4-4337-ae1f-4a5f39a143d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:25.620632 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5490b6fa-36d5-42a0-889b-690069efe0ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be7addaafa05418298fc0b845e457a4f', 'request_id': 'req-5490b6fa-36d5-42a0-889b-690069efe0ba'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:25.628821 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5490b6fa-36d5-42a0-889b-690069efe0ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be7addaafa05418298fc0b845e457a4f', 'request_id': 'req-5490b6fa-36d5-42a0-889b-690069efe0ba'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:25.639948 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5490b6fa-36d5-42a0-889b-690069efe0ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be7addaafa05418298fc0b845e457a4f', 'request_id': 'req-5490b6fa-36d5-42a0-889b-690069efe0ba'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:25.643577 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8bd24-28d4-4337-ae1f-4a5f39a143d7 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:25.658801 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5490b6fa-36d5-42a0-889b-690069efe0ba admin admin] The token cache is being invalidate because project be7addaafa05418298fc0b845e457a4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:25.659689 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5490b6fa-36d5-42a0-889b-690069efe0ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:25.660402 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5490b6fa-36d5-42a0-889b-690069efe0ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:25.662548 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1063/2116] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:25 2022] DELETE /identity/v3/projects/be7addaafa05418298fc0b845e457a4f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:25.666343 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490b6fa-36d5-42a0-889b-690069efe0ba admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:25.667844 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-5490b6fa-36d5-42a0-889b-690069efe0ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:25.714332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf934b-ed8b-456f-8ef8-7967ddfcfe77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:25.715214 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf934b-ed8b-456f-8ef8-7967ddfcfe77 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:25.715587 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf934b-ed8b-456f-8ef8-7967ddfcfe77 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:25.715955 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf934b-ed8b-456f-8ef8-7967ddfcfe77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:25.717906 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-addf934b-ed8b-456f-8ef8-7967ddfcfe77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:25.736746 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490b6fa-36d5-42a0-889b-690069efe0ba admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:25.744363 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62952605-21f7-4a92-8913-dea38d6396d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:25.745324 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62952605-21f7-4a92-8913-dea38d6396d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:25.745792 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62952605-21f7-4a92-8913-dea38d6396d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:25.746142 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62952605-21f7-4a92-8913-dea38d6396d8 admin admin] PATH_INFO: `/v3/users/f80829257a9d4730890acfbe3fb8c0ea` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:25.747541 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62952605-21f7-4a92-8913-dea38d6396d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80829257a9d4730890acfbe3fb8c0ea)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:25.757866 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62952605-21f7-4a92-8913-dea38d6396d8 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:25.804458 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf934b-ed8b-456f-8ef8-7967ddfcfe77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:25.806165 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf934b-ed8b-456f-8ef8-7967ddfcfe77 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:25.818041 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1054/2117] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:25.837896 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-62952605-21f7-4a92-8913-dea38d6396d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80829257a9d4730890acfbe3fb8c0ea'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:25.852441 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-62952605-21f7-4a92-8913-dea38d6396d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80829257a9d4730890acfbe3fb8c0ea'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:25.853285 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-62952605-21f7-4a92-8913-dea38d6396d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80829257a9d4730890acfbe3fb8c0ea'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:25.862436 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-62952605-21f7-4a92-8913-dea38d6396d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80829257a9d4730890acfbe3fb8c0ea'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:25.863239 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-62952605-21f7-4a92-8913-dea38d6396d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80829257a9d4730890acfbe3fb8c0ea'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:25.880882 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1064/2118] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:25 2022] DELETE /identity/v3/users/f80829257a9d4730890acfbe3fb8c0ea => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:26.095013 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d958e-bbe0-4192-ab31-5e35b8a806dd None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:26.096300 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d958e-bbe0-4192-ab31-5e35b8a806dd None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:26.096680 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d958e-bbe0-4192-ab31-5e35b8a806dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:26.117116 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-251d958e-bbe0-4192-ab31-5e35b8a806dd None None] MFA Rules not processed for user `3da4e93429a84af6ba36fc0fbc544a16`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:26.119209 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-251d958e-bbe0-4192-ab31-5e35b8a806dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:26.171723 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62952605-21f7-4a92-8913-dea38d6396d8 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:26.173691 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-62952605-21f7-4a92-8913-dea38d6396d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:26.189652 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1055/2119] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:26.232517 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d958e-bbe0-4192-ab31-5e35b8a806dd None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:26.233921 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-251d958e-bbe0-4192-ab31-5e35b8a806dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:26.278232 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62952605-21f7-4a92-8913-dea38d6396d8 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:26.285780 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea739ee-fdd3-441b-8fce-b077ba388276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:26.286592 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea739ee-fdd3-441b-8fce-b077ba388276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:26.286875 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea739ee-fdd3-441b-8fce-b077ba388276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:26.287293 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea739ee-fdd3-441b-8fce-b077ba388276 admin admin] PATH_INFO: `/v3/projects/ea6f270a6c54471dbcca5ab4488d1e08` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:26.288624 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea739ee-fdd3-441b-8fce-b077ba388276 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea6f270a6c54471dbcca5ab4488d1e08)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:26.298822 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea739ee-fdd3-441b-8fce-b077ba388276 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:26.329562 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d958e-bbe0-4192-ab31-5e35b8a806dd None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:26.334365 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ef4b1-c836-4692-89a5-06fec10c91c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:26.335324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ef4b1-c836-4692-89a5-06fec10c91c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:26.335631 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ef4b1-c836-4692-89a5-06fec10c91c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:26.335902 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ef4b1-c836-4692-89a5-06fec10c91c7 admin admin] PATH_INFO: `/v3/projects/9f811a0d45b8454bbf6a8ac245fbbf99` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:26.337267 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ef4b1-c836-4692-89a5-06fec10c91c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f811a0d45b8454bbf6a8ac245fbbf99)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:26.339162 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ef4b1-c836-4692-89a5-06fec10c91c7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:26.344759 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-cea739ee-fdd3-441b-8fce-b077ba388276 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea6f270a6c54471dbcca5ab4488d1e08', 'request_id': 'req-cea739ee-fdd3-441b-8fce-b077ba388276'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:26.352087 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-cea739ee-fdd3-441b-8fce-b077ba388276 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea6f270a6c54471dbcca5ab4488d1e08', 'request_id': 'req-cea739ee-fdd3-441b-8fce-b077ba388276'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:26.361356 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-cea739ee-fdd3-441b-8fce-b077ba388276 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea6f270a6c54471dbcca5ab4488d1e08', 'request_id': 'req-cea739ee-fdd3-441b-8fce-b077ba388276'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:26.374968 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-cea739ee-fdd3-441b-8fce-b077ba388276 admin admin] The token cache is being invalidate because project ea6f270a6c54471dbcca5ab4488d1e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:26.375263 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-cea739ee-fdd3-441b-8fce-b077ba388276 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:26.375946 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-cea739ee-fdd3-441b-8fce-b077ba388276 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:26.388163 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1065/2120] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:26 2022] DELETE /identity/v3/projects/ea6f270a6c54471dbcca5ab4488d1e08 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:26.398721 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cd0ef4b1-c836-4692-89a5-06fec10c91c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f811a0d45b8454bbf6a8ac245fbbf99', 'request_id': 'req-cd0ef4b1-c836-4692-89a5-06fec10c91c7'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:26.404793 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cd0ef4b1-c836-4692-89a5-06fec10c91c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f811a0d45b8454bbf6a8ac245fbbf99', 'request_id': 'req-cd0ef4b1-c836-4692-89a5-06fec10c91c7'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:26.412329 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cd0ef4b1-c836-4692-89a5-06fec10c91c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f811a0d45b8454bbf6a8ac245fbbf99', 'request_id': 'req-cd0ef4b1-c836-4692-89a5-06fec10c91c7'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:26.425703 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cd0ef4b1-c836-4692-89a5-06fec10c91c7 admin admin] The token cache is being invalidate because project 9f811a0d45b8454bbf6a8ac245fbbf99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:26.425994 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cd0ef4b1-c836-4692-89a5-06fec10c91c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:26.426809 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cd0ef4b1-c836-4692-89a5-06fec10c91c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:26.429201 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1056/2121] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:26 2022] DELETE /identity/v3/projects/9f811a0d45b8454bbf6a8ac245fbbf99 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:26.434310 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b3b5-fd8e-450b-b9d8-f26649408f21 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:26.434603 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b3b5-fd8e-450b-b9d8-f26649408f21 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:26.434883 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b3b5-fd8e-450b-b9d8-f26649408f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:26.455539 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-c1a9b3b5-fd8e-450b-b9d8-f26649408f21 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:26.457106 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-c1a9b3b5-fd8e-450b-b9d8-f26649408f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:26.542202 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1066/2122] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:26.549940 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64701c88-70c9-44df-bd03-17e42ebe1374 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:26.550268 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64701c88-70c9-44df-bd03-17e42ebe1374 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:26.550836 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64701c88-70c9-44df-bd03-17e42ebe1374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:26.569146 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-64701c88-70c9-44df-bd03-17e42ebe1374 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:26.570410 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-64701c88-70c9-44df-bd03-17e42ebe1374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:26.581348 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1057/2123] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:26.585683 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9b3b5-fd8e-450b-b9d8-f26649408f21 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:26.595547 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9b3b5-fd8e-450b-b9d8-f26649408f21 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:26.601058 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108047e7-0890-439c-a297-fa2ce1bb04f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:26.601721 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108047e7-0890-439c-a297-fa2ce1bb04f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:26.602089 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108047e7-0890-439c-a297-fa2ce1bb04f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:26.602367 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108047e7-0890-439c-a297-fa2ce1bb04f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:26.603355 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108047e7-0890-439c-a297-fa2ce1bb04f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:16:26.603661 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108047e7-0890-439c-a297-fa2ce1bb04f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:26.605266 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108047e7-0890-439c-a297-fa2ce1bb04f7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:26.620755 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1067/2124] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:16:26.621863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64701c88-70c9-44df-bd03-17e42ebe1374 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:26.630834 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64701c88-70c9-44df-bd03-17e42ebe1374 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:26.635446 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f06ac-f82c-4636-8ec6-afcfc6b204f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:26.636121 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f06ac-f82c-4636-8ec6-afcfc6b204f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:26.636398 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f06ac-f82c-4636-8ec6-afcfc6b204f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:26.636669 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f06ac-f82c-4636-8ec6-afcfc6b204f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:26.637495 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f06ac-f82c-4636-8ec6-afcfc6b204f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:26.639231 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f06ac-f82c-4636-8ec6-afcfc6b204f2 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:26.665641 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1058/2125] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:26 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:26.669204 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108047e7-0890-439c-a297-fa2ce1bb04f7 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:26.681608 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108047e7-0890-439c-a297-fa2ce1bb04f7 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:26.748894 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271d965-80ff-40c4-b364-c7ec78bd87ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:26.749561 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271d965-80ff-40c4-b364-c7ec78bd87ea admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:26.749966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271d965-80ff-40c4-b364-c7ec78bd87ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:26.750240 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271d965-80ff-40c4-b364-c7ec78bd87ea admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:26.750954 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271d965-80ff-40c4-b364-c7ec78bd87ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:26.752877 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271d965-80ff-40c4-b364-c7ec78bd87ea admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:26.783591 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1068/2126] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:26 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:26.785179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f06ac-f82c-4636-8ec6-afcfc6b204f2 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:26.805357 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f06ac-f82c-4636-8ec6-afcfc6b204f2 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:26.810455 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c90d45-e07f-4196-a521-af1b545cc837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:26.812223 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c90d45-e07f-4196-a521-af1b545cc837 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:26.812506 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c90d45-e07f-4196-a521-af1b545cc837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:26.812782 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c90d45-e07f-4196-a521-af1b545cc837 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:26.813528 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c90d45-e07f-4196-a521-af1b545cc837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:26.815511 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c90d45-e07f-4196-a521-af1b545cc837 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:26.832195 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1059/2127] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:26.833149 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271d965-80ff-40c4-b364-c7ec78bd87ea admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:26.847087 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271d965-80ff-40c4-b364-c7ec78bd87ea admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:26.854250 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f09bc1-ab51-411a-a727-44d1bc8c03e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:26.854918 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f09bc1-ab51-411a-a727-44d1bc8c03e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:26.855199 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f09bc1-ab51-411a-a727-44d1bc8c03e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:26.855474 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f09bc1-ab51-411a-a727-44d1bc8c03e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:26.856249 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f09bc1-ab51-411a-a727-44d1bc8c03e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:26.857850 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f09bc1-ab51-411a-a727-44d1bc8c03e2 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:26.889788 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1069/2128] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:16:26.890978 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c90d45-e07f-4196-a521-af1b545cc837 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:26.902485 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c90d45-e07f-4196-a521-af1b545cc837 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:26.907441 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8c352-ea36-459e-b128-e2518a386624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:26.908425 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8c352-ea36-459e-b128-e2518a386624 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:26.908823 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8c352-ea36-459e-b128-e2518a386624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:26.909101 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8c352-ea36-459e-b128-e2518a386624 admin admin] PATH_INFO: `/v3/projects/c611c7018f124b9792c90c06a0c2b25d/users/b592993511334af099958dff6d443a09/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:26.926740 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8c352-ea36-459e-b128-e2518a386624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c611c7018f124b9792c90c06a0c2b25d, user_id=b592993511334af099958dff6d443a09, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:26.929558 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8c352-ea36-459e-b128-e2518a386624 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:26.944068 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1060/2129] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:26 2022] PUT /identity/v3/projects/c611c7018f124b9792c90c06a0c2b25d/users/b592993511334af099958dff6d443a09/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:26.949207 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2efd94-751e-47fa-857c-e10db23accd9 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:26.949562 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2efd94-751e-47fa-857c-e10db23accd9 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:26.949906 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2efd94-751e-47fa-857c-e10db23accd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:26.970634 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-4f2efd94-751e-47fa-857c-e10db23accd9 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:26.971912 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-4f2efd94-751e-47fa-857c-e10db23accd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:27.060504 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1070/2130] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:27.070965 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8c352-ea36-459e-b128-e2518a386624 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:27.073040 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-00b8c352-ea36-459e-b128-e2518a386624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:27.144761 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8c352-ea36-459e-b128-e2518a386624 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:27.148502 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd66c21-1777-46be-8720-e5e13c3c0fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:27.149143 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd66c21-1777-46be-8720-e5e13c3c0fef service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:27.149423 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd66c21-1777-46be-8720-e5e13c3c0fef service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:27.149695 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd66c21-1777-46be-8720-e5e13c3c0fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:27.158483 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd66c21-1777-46be-8720-e5e13c3c0fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:27.159934 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd66c21-1777-46be-8720-e5e13c3c0fef service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:27.169904 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1061/2131] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:27.781289 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ed090-4fd9-4008-bf3b-c7a65a1dfd32 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:27.781579 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ed090-4fd9-4008-bf3b-c7a65a1dfd32 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:27.781853 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ed090-4fd9-4008-bf3b-c7a65a1dfd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:27.809663 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-5c1ed090-4fd9-4008-bf3b-c7a65a1dfd32 None None] MFA Rules not processed for user `b592993511334af099958dff6d443a09`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:27.810837 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-5c1ed090-4fd9-4008-bf3b-c7a65a1dfd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:27.876133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1071/2132] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:27.880418 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd66c21-1777-46be-8720-e5e13c3c0fef service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:27.893055 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd66c21-1777-46be-8720-e5e13c3c0fef service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:27.901333 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5c532-391a-49dd-8780-58b019d2c5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:27.902076 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5c532-391a-49dd-8780-58b019d2c5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:27.902434 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5c532-391a-49dd-8780-58b019d2c5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:27.902783 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5c532-391a-49dd-8780-58b019d2c5c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:27.903594 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5c532-391a-49dd-8780-58b019d2c5c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:27.906372 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5c532-391a-49dd-8780-58b019d2c5c7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:27.938991 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1062/2133] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:27 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:27.943969 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ed090-4fd9-4008-bf3b-c7a65a1dfd32 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:27.954586 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ed090-4fd9-4008-bf3b-c7a65a1dfd32 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:28.025595 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ac297-b965-4db0-a751-e4b2129b9cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:28.026276 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ac297-b965-4db0-a751-e4b2129b9cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:28.026565 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ac297-b965-4db0-a751-e4b2129b9cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:28.026823 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ac297-b965-4db0-a751-e4b2129b9cb1 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:28.027671 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ac297-b965-4db0-a751-e4b2129b9cb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:28.029637 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ac297-b965-4db0-a751-e4b2129b9cb1 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:28.052952 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1072/2134] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:27 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:28.057018 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5c532-391a-49dd-8780-58b019d2c5c7 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:28.076249 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5c532-391a-49dd-8780-58b019d2c5c7 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:28.081229 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3cb8e-6046-4601-a107-1cbf4f4974a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:28.081902 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3cb8e-6046-4601-a107-1cbf4f4974a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:28.082186 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3cb8e-6046-4601-a107-1cbf4f4974a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:28.082460 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3cb8e-6046-4601-a107-1cbf4f4974a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:28.083196 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3cb8e-6046-4601-a107-1cbf4f4974a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:28.087175 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3cb8e-6046-4601-a107-1cbf4f4974a1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:28.101931 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1063/2135] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:16:28.103039 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ac297-b965-4db0-a751-e4b2129b9cb1 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:28.118042 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ac297-b965-4db0-a751-e4b2129b9cb1 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:28.124114 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c8ec9-3d0c-4e2c-ba24-584ccac4a0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:28.125012 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c8ec9-3d0c-4e2c-ba24-584ccac4a0ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:28.125300 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c8ec9-3d0c-4e2c-ba24-584ccac4a0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:28.125675 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c8ec9-3d0c-4e2c-ba24-584ccac4a0ab admin admin] PATH_INFO: `/v3/projects/0873f13f36e7452ea0b6a94427ad9ed5/users/bfa87d757bac46bb80deb4be93d5124d/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:28.144893 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c8ec9-3d0c-4e2c-ba24-584ccac4a0ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0873f13f36e7452ea0b6a94427ad9ed5, user_id=bfa87d757bac46bb80deb4be93d5124d, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:28.148624 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c8ec9-3d0c-4e2c-ba24-584ccac4a0ab admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:28.167755 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1073/2136] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:28 2022] PUT /identity/v3/projects/0873f13f36e7452ea0b6a94427ad9ed5/users/bfa87d757bac46bb80deb4be93d5124d/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:28.171616 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3cb8e-6046-4601-a107-1cbf4f4974a1 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:28.185584 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3cb8e-6046-4601-a107-1cbf4f4974a1 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:28.259673 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38765ca-b4de-4fd9-a320-d5c61446ac57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:28.260428 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38765ca-b4de-4fd9-a320-d5c61446ac57 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:28.260673 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38765ca-b4de-4fd9-a320-d5c61446ac57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:28.261570 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38765ca-b4de-4fd9-a320-d5c61446ac57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:28.261686 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38765ca-b4de-4fd9-a320-d5c61446ac57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:28.263475 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38765ca-b4de-4fd9-a320-d5c61446ac57 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:28.275376 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1064/2137] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:28.279248 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c8ec9-3d0c-4e2c-ba24-584ccac4a0ab admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:28.291339 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c8ec9-3d0c-4e2c-ba24-584ccac4a0ab admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:28.296221 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029af2b0-d1ab-4abc-ab6d-dd7c15ea1ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:28.297093 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029af2b0-d1ab-4abc-ab6d-dd7c15ea1ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:28.297371 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029af2b0-d1ab-4abc-ab6d-dd7c15ea1ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:28.297645 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029af2b0-d1ab-4abc-ab6d-dd7c15ea1ef3 admin admin] PATH_INFO: `/v3/projects/0873f13f36e7452ea0b6a94427ad9ed5/users/bfa87d757bac46bb80deb4be93d5124d/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:28.299609 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029af2b0-d1ab-4abc-ab6d-dd7c15ea1ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0873f13f36e7452ea0b6a94427ad9ed5, user_id=bfa87d757bac46bb80deb4be93d5124d, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:28.302258 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029af2b0-d1ab-4abc-ab6d-dd7c15ea1ef3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:28.313576 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1074/2138] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:28 2022] PUT /identity/v3/projects/0873f13f36e7452ea0b6a94427ad9ed5/users/bfa87d757bac46bb80deb4be93d5124d/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:29.038181 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e2a33-1402-4cbc-8f24-bbf4354aa0fe None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:29.038656 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e2a33-1402-4cbc-8f24-bbf4354aa0fe None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:29.039038 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e2a33-1402-4cbc-8f24-bbf4354aa0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:29.074584 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-3a7e2a33-1402-4cbc-8f24-bbf4354aa0fe None None] MFA Rules not processed for user `bfa87d757bac46bb80deb4be93d5124d`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:29.076084 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-3a7e2a33-1402-4cbc-8f24-bbf4354aa0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:29.183305 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1065/2139] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:29.195196 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029af2b0-d1ab-4abc-ab6d-dd7c15ea1ef3 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:29.197835 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-029af2b0-d1ab-4abc-ab6d-dd7c15ea1ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:29.282813 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029af2b0-d1ab-4abc-ab6d-dd7c15ea1ef3 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:29.289026 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56134c75-062e-4e4c-9637-3a893debaaea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:29.289686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56134c75-062e-4e4c-9637-3a893debaaea service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:29.289965 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56134c75-062e-4e4c-9637-3a893debaaea service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:29.290239 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56134c75-062e-4e4c-9637-3a893debaaea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:29.365498 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56134c75-062e-4e4c-9637-3a893debaaea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:29.369259 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56134c75-062e-4e4c-9637-3a893debaaea service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:29.379505 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1075/2140] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:29.886263 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e2a33-1402-4cbc-8f24-bbf4354aa0fe None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:29.899053 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e2a33-1402-4cbc-8f24-bbf4354aa0fe None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:29.904333 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d01511-7484-4624-be0f-def68265fa9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:29.905570 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d01511-7484-4624-be0f-def68265fa9c service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:29.906102 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d01511-7484-4624-be0f-def68265fa9c service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:29.906415 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d01511-7484-4624-be0f-def68265fa9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:29.909554 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-10d01511-7484-4624-be0f-def68265fa9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:29.972852 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d01511-7484-4624-be0f-def68265fa9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:29.974218 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d01511-7484-4624-be0f-def68265fa9c service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:29.983721 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1066/2141] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:31.940020 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56134c75-062e-4e4c-9637-3a893debaaea service cinder] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:31.954642 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56134c75-062e-4e4c-9637-3a893debaaea service cinder] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:31.958318 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f288122-9969-4dca-ba25-e7ab5b7f0374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:31.958949 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f288122-9969-4dca-ba25-e7ab5b7f0374 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:31.959234 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f288122-9969-4dca-ba25-e7ab5b7f0374 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:31.959506 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f288122-9969-4dca-ba25-e7ab5b7f0374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:31.969862 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f288122-9969-4dca-ba25-e7ab5b7f0374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:31.971296 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f288122-9969-4dca-ba25-e7ab5b7f0374 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:31.981786 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1076/2142] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:32.136507 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d01511-7484-4624-be0f-def68265fa9c service cinder] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:32.137965 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-10d01511-7484-4624-be0f-def68265fa9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:32.204413 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d01511-7484-4624-be0f-def68265fa9c service cinder] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:32.209268 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb58fb8-735f-4bc6-916c-fc1c60753308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:32.210138 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb58fb8-735f-4bc6-916c-fc1c60753308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:32.210452 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb58fb8-735f-4bc6-916c-fc1c60753308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:32.210732 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb58fb8-735f-4bc6-916c-fc1c60753308 admin admin] PATH_INFO: `/v3/users/1e6c8a8fa3ec4d10a23eee48422ef73d` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:32.211968 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb58fb8-735f-4bc6-916c-fc1c60753308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e6c8a8fa3ec4d10a23eee48422ef73d)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:32.213870 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb58fb8-735f-4bc6-916c-fc1c60753308 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:32.258689 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-6fb58fb8-735f-4bc6-916c-fc1c60753308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e6c8a8fa3ec4d10a23eee48422ef73d'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:32.271259 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-6fb58fb8-735f-4bc6-916c-fc1c60753308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e6c8a8fa3ec4d10a23eee48422ef73d'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:32.272011 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-6fb58fb8-735f-4bc6-916c-fc1c60753308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e6c8a8fa3ec4d10a23eee48422ef73d'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:32.272631 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-6fb58fb8-735f-4bc6-916c-fc1c60753308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e6c8a8fa3ec4d10a23eee48422ef73d'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:32.279773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-6fb58fb8-735f-4bc6-916c-fc1c60753308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e6c8a8fa3ec4d10a23eee48422ef73d'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:32.292275 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1067/2143] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:32 2022] DELETE /identity/v3/users/1e6c8a8fa3ec4d10a23eee48422ef73d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:32.296893 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc3475-39c7-4ca5-822a-d4f16ad27d8c None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:32.297187 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc3475-39c7-4ca5-822a-d4f16ad27d8c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:32.297472 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc3475-39c7-4ca5-822a-d4f16ad27d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:32.315402 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-41cc3475-39c7-4ca5-822a-d4f16ad27d8c None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:32.316629 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-41cc3475-39c7-4ca5-822a-d4f16ad27d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:32.376135 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1077/2144] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:16:32.394643 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb58fb8-735f-4bc6-916c-fc1c60753308 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:32.396607 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-6fb58fb8-735f-4bc6-916c-fc1c60753308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:32.454545 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb58fb8-735f-4bc6-916c-fc1c60753308 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:32.458170 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f2e9c-1ad8-4006-965e-a82211ef7091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:32.458846 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f2e9c-1ad8-4006-965e-a82211ef7091 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:32.459128 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f2e9c-1ad8-4006-965e-a82211ef7091 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:32.459403 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f2e9c-1ad8-4006-965e-a82211ef7091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:32.468956 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f2e9c-1ad8-4006-965e-a82211ef7091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:32.470467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f2e9c-1ad8-4006-965e-a82211ef7091 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:32.480525 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1068/2145] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:32.760322 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc3475-39c7-4ca5-822a-d4f16ad27d8c None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:32.762028 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-41cc3475-39c7-4ca5-822a-d4f16ad27d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:32.786120 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc3475-39c7-4ca5-822a-d4f16ad27d8c None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:32.792414 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43abbd9-b9b6-4195-bb1c-f2890a82d92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:32.793501 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43abbd9-b9b6-4195-bb1c-f2890a82d92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:32.793987 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43abbd9-b9b6-4195-bb1c-f2890a82d92e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:32.794447 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43abbd9-b9b6-4195-bb1c-f2890a82d92e admin admin] PATH_INFO: `/v3/projects/19e24f27bd11401fa1697076dae7d98b` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:32.795730 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43abbd9-b9b6-4195-bb1c-f2890a82d92e admin admin] RBAC: Authorizing `identity:delete_project(project_id=19e24f27bd11401fa1697076dae7d98b)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:32.797728 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43abbd9-b9b6-4195-bb1c-f2890a82d92e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:32.851336 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c43abbd9-b9b6-4195-bb1c-f2890a82d92e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19e24f27bd11401fa1697076dae7d98b', 'request_id': 'req-c43abbd9-b9b6-4195-bb1c-f2890a82d92e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:32.860841 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c43abbd9-b9b6-4195-bb1c-f2890a82d92e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19e24f27bd11401fa1697076dae7d98b', 'request_id': 'req-c43abbd9-b9b6-4195-bb1c-f2890a82d92e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:32.869931 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c43abbd9-b9b6-4195-bb1c-f2890a82d92e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19e24f27bd11401fa1697076dae7d98b', 'request_id': 'req-c43abbd9-b9b6-4195-bb1c-f2890a82d92e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:32.889048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c43abbd9-b9b6-4195-bb1c-f2890a82d92e admin admin] The token cache is being invalidate because project 19e24f27bd11401fa1697076dae7d98b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:32.889411 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c43abbd9-b9b6-4195-bb1c-f2890a82d92e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:32.890128 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c43abbd9-b9b6-4195-bb1c-f2890a82d92e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:32.891860 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1078/2146] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:32 2022] DELETE /identity/v3/projects/19e24f27bd11401fa1697076dae7d98b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:32.895655 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f2e9c-1ad8-4006-965e-a82211ef7091 service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:32.907469 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f2e9c-1ad8-4006-965e-a82211ef7091 service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:32.964680 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf80cd-73ae-4044-88c4-9dc305bae92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:32.965465 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf80cd-73ae-4044-88c4-9dc305bae92a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:32.965748 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf80cd-73ae-4044-88c4-9dc305bae92a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:32.966025 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf80cd-73ae-4044-88c4-9dc305bae92a admin admin] PATH_INFO: `/v3/users/0fe33d9310764bda9143437b9f72551b` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:32.967210 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf80cd-73ae-4044-88c4-9dc305bae92a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe33d9310764bda9143437b9f72551b)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:32.969145 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf80cd-73ae-4044-88c4-9dc305bae92a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:33.014895 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-07cf80cd-73ae-4044-88c4-9dc305bae92a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe33d9310764bda9143437b9f72551b'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:33.026440 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-07cf80cd-73ae-4044-88c4-9dc305bae92a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe33d9310764bda9143437b9f72551b'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:33.027090 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-07cf80cd-73ae-4044-88c4-9dc305bae92a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe33d9310764bda9143437b9f72551b'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:33.027681 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-07cf80cd-73ae-4044-88c4-9dc305bae92a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe33d9310764bda9143437b9f72551b'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:33.034464 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-07cf80cd-73ae-4044-88c4-9dc305bae92a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe33d9310764bda9143437b9f72551b'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:33.046271 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1069/2147] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:32 2022] DELETE /identity/v3/users/0fe33d9310764bda9143437b9f72551b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:33.320054 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43abbd9-b9b6-4195-bb1c-f2890a82d92e admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:33.321502 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-c43abbd9-b9b6-4195-bb1c-f2890a82d92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:33.346795 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43abbd9-b9b6-4195-bb1c-f2890a82d92e admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:33.420498 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb083f9-3aa4-4749-9d95-da30c6f953c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:33.422373 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb083f9-3aa4-4749-9d95-da30c6f953c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:33.422556 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb083f9-3aa4-4749-9d95-da30c6f953c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:33.423098 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb083f9-3aa4-4749-9d95-da30c6f953c6 admin admin] PATH_INFO: `/v3/projects/fc1da23324e94c50ab096dc265a2286b` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:33.424590 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb083f9-3aa4-4749-9d95-da30c6f953c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc1da23324e94c50ab096dc265a2286b)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:33.427075 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb083f9-3aa4-4749-9d95-da30c6f953c6 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:33.483331 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6bb083f9-3aa4-4749-9d95-da30c6f953c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc1da23324e94c50ab096dc265a2286b', 'request_id': 'req-6bb083f9-3aa4-4749-9d95-da30c6f953c6'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:33.491227 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6bb083f9-3aa4-4749-9d95-da30c6f953c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc1da23324e94c50ab096dc265a2286b', 'request_id': 'req-6bb083f9-3aa4-4749-9d95-da30c6f953c6'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:33.498954 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6bb083f9-3aa4-4749-9d95-da30c6f953c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc1da23324e94c50ab096dc265a2286b', 'request_id': 'req-6bb083f9-3aa4-4749-9d95-da30c6f953c6'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:33.521459 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6bb083f9-3aa4-4749-9d95-da30c6f953c6 admin admin] The token cache is being invalidate because project fc1da23324e94c50ab096dc265a2286b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:33.521744 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6bb083f9-3aa4-4749-9d95-da30c6f953c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:33.522555 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6bb083f9-3aa4-4749-9d95-da30c6f953c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:33.525302 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1079/2148] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:33 2022] DELETE /identity/v3/projects/fc1da23324e94c50ab096dc265a2286b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:33.528942 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf80cd-73ae-4044-88c4-9dc305bae92a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:33.530384 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-07cf80cd-73ae-4044-88c4-9dc305bae92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:33.545072 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf80cd-73ae-4044-88c4-9dc305bae92a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:33.608617 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b3df7-cb87-4c8a-a353-6fc904f371bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:33.609491 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b3df7-cb87-4c8a-a353-6fc904f371bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:33.609820 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b3df7-cb87-4c8a-a353-6fc904f371bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:33.610107 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b3df7-cb87-4c8a-a353-6fc904f371bd admin admin] PATH_INFO: `/v3/users/f1080e8b0cf0480a9e2b415d38264fd0` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:33.611307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b3df7-cb87-4c8a-a353-6fc904f371bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1080e8b0cf0480a9e2b415d38264fd0)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:33.613346 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b3df7-cb87-4c8a-a353-6fc904f371bd admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:33.669222 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-666b3df7-cb87-4c8a-a353-6fc904f371bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1080e8b0cf0480a9e2b415d38264fd0'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:33.683276 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-666b3df7-cb87-4c8a-a353-6fc904f371bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1080e8b0cf0480a9e2b415d38264fd0'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:33.684190 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-666b3df7-cb87-4c8a-a353-6fc904f371bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1080e8b0cf0480a9e2b415d38264fd0'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:33.684901 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-666b3df7-cb87-4c8a-a353-6fc904f371bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1080e8b0cf0480a9e2b415d38264fd0'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:33.693753 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-666b3df7-cb87-4c8a-a353-6fc904f371bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1080e8b0cf0480a9e2b415d38264fd0'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:33.708411 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1070/2149] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:33 2022] DELETE /identity/v3/users/f1080e8b0cf0480a9e2b415d38264fd0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:34.246811 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb083f9-3aa4-4749-9d95-da30c6f953c6 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:34.248918 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-6bb083f9-3aa4-4749-9d95-da30c6f953c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:34.261281 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb083f9-3aa4-4749-9d95-da30c6f953c6 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:34.325810 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36dc6e-9768-45d2-ba3c-35d05989a033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:34.326777 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36dc6e-9768-45d2-ba3c-35d05989a033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:34.327277 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36dc6e-9768-45d2-ba3c-35d05989a033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:34.327754 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36dc6e-9768-45d2-ba3c-35d05989a033 admin admin] PATH_INFO: `/v3/projects/407b483e8f844441b0552578f263f1fa` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:34.329112 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36dc6e-9768-45d2-ba3c-35d05989a033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=407b483e8f844441b0552578f263f1fa)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:34.331161 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36dc6e-9768-45d2-ba3c-35d05989a033 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:34.384079 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5d36dc6e-9768-45d2-ba3c-35d05989a033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '407b483e8f844441b0552578f263f1fa', 'request_id': 'req-5d36dc6e-9768-45d2-ba3c-35d05989a033'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:34.389356 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5d36dc6e-9768-45d2-ba3c-35d05989a033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '407b483e8f844441b0552578f263f1fa', 'request_id': 'req-5d36dc6e-9768-45d2-ba3c-35d05989a033'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:34.395855 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5d36dc6e-9768-45d2-ba3c-35d05989a033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '407b483e8f844441b0552578f263f1fa', 'request_id': 'req-5d36dc6e-9768-45d2-ba3c-35d05989a033'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:34.411781 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5d36dc6e-9768-45d2-ba3c-35d05989a033 admin admin] The token cache is being invalidate because project 407b483e8f844441b0552578f263f1fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:34.412437 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5d36dc6e-9768-45d2-ba3c-35d05989a033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:34.413108 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5d36dc6e-9768-45d2-ba3c-35d05989a033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:34.420190 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1080/2150] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:34 2022] DELETE /identity/v3/projects/407b483e8f844441b0552578f263f1fa => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:34.422200 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082d73b-8f0e-4c1e-8dd6-27c053202433 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:34.422498 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082d73b-8f0e-4c1e-8dd6-27c053202433 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:34.422827 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082d73b-8f0e-4c1e-8dd6-27c053202433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:34.442012 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-f082d73b-8f0e-4c1e-8dd6-27c053202433 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:34.443214 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-f082d73b-8f0e-4c1e-8dd6-27c053202433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:34.514736 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1071/2151] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:34.516358 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eddea-5d73-42c6-be2b-5131f148015c None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:34.516813 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eddea-5d73-42c6-be2b-5131f148015c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:34.517571 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eddea-5d73-42c6-be2b-5131f148015c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:34.541259 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-192eddea-5d73-42c6-be2b-5131f148015c None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:34.542453 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-192eddea-5d73-42c6-be2b-5131f148015c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:34.557927 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1081/2152] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:34.561881 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082d73b-8f0e-4c1e-8dd6-27c053202433 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:34.575734 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082d73b-8f0e-4c1e-8dd6-27c053202433 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:34.581455 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df25fc-82eb-43d6-8d42-5fbf8c5b3528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:34.582273 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df25fc-82eb-43d6-8d42-5fbf8c5b3528 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:34.582631 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df25fc-82eb-43d6-8d42-5fbf8c5b3528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:34.582980 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df25fc-82eb-43d6-8d42-5fbf8c5b3528 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:34.583856 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df25fc-82eb-43d6-8d42-5fbf8c5b3528 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:16:34.584246 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df25fc-82eb-43d6-8d42-5fbf8c5b3528 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:34.586089 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df25fc-82eb-43d6-8d42-5fbf8c5b3528 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:34.600710 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1072/2153] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:16:34.604776 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192eddea-5d73-42c6-be2b-5131f148015c None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:34.618699 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192eddea-5d73-42c6-be2b-5131f148015c None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:34.623806 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2813759-ae7f-4567-97dd-da4b6b8680c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:34.624637 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2813759-ae7f-4567-97dd-da4b6b8680c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:34.625020 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2813759-ae7f-4567-97dd-da4b6b8680c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:34.625422 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2813759-ae7f-4567-97dd-da4b6b8680c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:34.627241 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2813759-ae7f-4567-97dd-da4b6b8680c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:34.629675 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2813759-ae7f-4567-97dd-da4b6b8680c4 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:34.668734 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1082/2154] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:34 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:16:34.673303 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df25fc-82eb-43d6-8d42-5fbf8c5b3528 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:34.689764 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df25fc-82eb-43d6-8d42-5fbf8c5b3528 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:34.779248 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917a940-d143-4268-a38d-fad760d6c244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:34.779248 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917a940-d143-4268-a38d-fad760d6c244 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:34.779248 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917a940-d143-4268-a38d-fad760d6c244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:34.779533 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917a940-d143-4268-a38d-fad760d6c244 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:34.780202 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917a940-d143-4268-a38d-fad760d6c244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:34.782479 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917a940-d143-4268-a38d-fad760d6c244 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:34.805502 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1073/2155] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:34 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:34.809631 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2813759-ae7f-4567-97dd-da4b6b8680c4 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:34.822818 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2813759-ae7f-4567-97dd-da4b6b8680c4 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:34.828125 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096c46f-5aed-4d38-92a9-b511073e3692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:34.828865 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096c46f-5aed-4d38-92a9-b511073e3692 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:34.829209 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096c46f-5aed-4d38-92a9-b511073e3692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:34.829593 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096c46f-5aed-4d38-92a9-b511073e3692 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:34.830413 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096c46f-5aed-4d38-92a9-b511073e3692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:34.832076 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096c46f-5aed-4d38-92a9-b511073e3692 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:34.842628 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1083/2156] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:34.846576 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917a940-d143-4268-a38d-fad760d6c244 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:34.857074 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917a940-d143-4268-a38d-fad760d6c244 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:34.861612 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb5c8f-89cf-4ba6-a40f-e244d0c47ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:34.862281 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb5c8f-89cf-4ba6-a40f-e244d0c47ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:34.862565 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb5c8f-89cf-4ba6-a40f-e244d0c47ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:34.862840 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb5c8f-89cf-4ba6-a40f-e244d0c47ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:34.863572 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb5c8f-89cf-4ba6-a40f-e244d0c47ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:34.865211 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb5c8f-89cf-4ba6-a40f-e244d0c47ed1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:34.875644 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1074/2157] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:34.879979 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096c46f-5aed-4d38-92a9-b511073e3692 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:34.889912 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096c46f-5aed-4d38-92a9-b511073e3692 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:34.894522 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4e189-b8b4-464f-b99e-32b207d32f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:34.895435 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4e189-b8b4-464f-b99e-32b207d32f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:34.895737 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4e189-b8b4-464f-b99e-32b207d32f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:34.896030 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4e189-b8b4-464f-b99e-32b207d32f2a admin admin] PATH_INFO: `/v3/projects/ef68c4cf4a724555bdc59d6f5ac08f23/users/b9273105723042388794eda88ac2cbb9/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:34.909978 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4e189-b8b4-464f-b99e-32b207d32f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef68c4cf4a724555bdc59d6f5ac08f23, user_id=b9273105723042388794eda88ac2cbb9, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:34.912640 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4e189-b8b4-464f-b99e-32b207d32f2a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:34.926162 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1084/2158] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:34 2022] PUT /identity/v3/projects/ef68c4cf4a724555bdc59d6f5ac08f23/users/b9273105723042388794eda88ac2cbb9/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:34.937736 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eddf34-924b-42cd-8fbc-dd16fa309b83 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:34.938028 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eddf34-924b-42cd-8fbc-dd16fa309b83 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:34.938328 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eddf34-924b-42cd-8fbc-dd16fa309b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:34.963594 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-d4eddf34-924b-42cd-8fbc-dd16fa309b83 None None] MFA Rules not processed for user `b9273105723042388794eda88ac2cbb9`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:34.964830 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-d4eddf34-924b-42cd-8fbc-dd16fa309b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:35.035129 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1075/2159] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:35.047382 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4e189-b8b4-464f-b99e-32b207d32f2a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:35.049188 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-0af4e189-b8b4-464f-b99e-32b207d32f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:35.122968 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4e189-b8b4-464f-b99e-32b207d32f2a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:35.126775 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccaeeff-2ca8-4c37-8512-6dfe527fc3c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:35.127483 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaeeff-2ca8-4c37-8512-6dfe527fc3c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:35.127775 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaeeff-2ca8-4c37-8512-6dfe527fc3c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:35.128117 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaeeff-2ca8-4c37-8512-6dfe527fc3c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:35.137842 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccaeeff-2ca8-4c37-8512-6dfe527fc3c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:35.139363 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccaeeff-2ca8-4c37-8512-6dfe527fc3c9 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:35.150883 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1085/2160] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:40.064437 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed9345-b960-4174-a5ee-91dc3339f8be None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:40.064897 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed9345-b960-4174-a5ee-91dc3339f8be None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:40.064983 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed9345-b960-4174-a5ee-91dc3339f8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:40.082970 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-35ed9345-b960-4174-a5ee-91dc3339f8be None None] MFA Rules not processed for user `bf4571d4a93246429874fb6bced95c85`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:40.084104 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-35ed9345-b960-4174-a5ee-91dc3339f8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:40.140830 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1076/2161] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:44.102681 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccaeeff-2ca8-4c37-8512-6dfe527fc3c9 service cinder] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:44.104546 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-cccaeeff-2ca8-4c37-8512-6dfe527fc3c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:44.177804 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccaeeff-2ca8-4c37-8512-6dfe527fc3c9 service cinder] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:44.182459 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64718bc-3022-4746-bfe4-a66931959b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:44.183312 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64718bc-3022-4746-bfe4-a66931959b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:44.183591 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64718bc-3022-4746-bfe4-a66931959b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:44.183891 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64718bc-3022-4746-bfe4-a66931959b58 admin admin] PATH_INFO: `/v3/users/3fc84b127fde4ce4a262e4786acfd7ce` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:44.185117 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64718bc-3022-4746-bfe4-a66931959b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc84b127fde4ce4a262e4786acfd7ce)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:44.187228 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64718bc-3022-4746-bfe4-a66931959b58 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:44.235390 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-b64718bc-3022-4746-bfe4-a66931959b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc84b127fde4ce4a262e4786acfd7ce'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:44.246995 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-b64718bc-3022-4746-bfe4-a66931959b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc84b127fde4ce4a262e4786acfd7ce'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:44.247592 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-b64718bc-3022-4746-bfe4-a66931959b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc84b127fde4ce4a262e4786acfd7ce'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:44.254766 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-b64718bc-3022-4746-bfe4-a66931959b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc84b127fde4ce4a262e4786acfd7ce'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:44.255375 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-b64718bc-3022-4746-bfe4-a66931959b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc84b127fde4ce4a262e4786acfd7ce'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:44.267527 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1086/2162] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:44 2022] DELETE /identity/v3/users/3fc84b127fde4ce4a262e4786acfd7ce => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:44.460696 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed9345-b960-4174-a5ee-91dc3339f8be None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:44.479797 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed9345-b960-4174-a5ee-91dc3339f8be None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:44.554686 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb41b8-8a40-4c5d-9081-e8e0afa5a000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:44.555783 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb41b8-8a40-4c5d-9081-e8e0afa5a000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:44.556249 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb41b8-8a40-4c5d-9081-e8e0afa5a000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:44.556670 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb41b8-8a40-4c5d-9081-e8e0afa5a000 admin admin] PATH_INFO: `/v3/projects/98ae7c6136b94b51bd44fa33e0d225fc` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:44.558868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb41b8-8a40-4c5d-9081-e8e0afa5a000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98ae7c6136b94b51bd44fa33e0d225fc)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:44.560867 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb41b8-8a40-4c5d-9081-e8e0afa5a000 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:44.622522 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f2fb41b8-8a40-4c5d-9081-e8e0afa5a000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98ae7c6136b94b51bd44fa33e0d225fc', 'request_id': 'req-f2fb41b8-8a40-4c5d-9081-e8e0afa5a000'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:44.631529 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f2fb41b8-8a40-4c5d-9081-e8e0afa5a000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98ae7c6136b94b51bd44fa33e0d225fc', 'request_id': 'req-f2fb41b8-8a40-4c5d-9081-e8e0afa5a000'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:44.638645 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f2fb41b8-8a40-4c5d-9081-e8e0afa5a000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98ae7c6136b94b51bd44fa33e0d225fc', 'request_id': 'req-f2fb41b8-8a40-4c5d-9081-e8e0afa5a000'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:44.652003 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f2fb41b8-8a40-4c5d-9081-e8e0afa5a000 admin admin] The token cache is being invalidate because project 98ae7c6136b94b51bd44fa33e0d225fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:44.652301 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f2fb41b8-8a40-4c5d-9081-e8e0afa5a000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:44.653185 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f2fb41b8-8a40-4c5d-9081-e8e0afa5a000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:44.655070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1077/2163] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:44 2022] DELETE /identity/v3/projects/98ae7c6136b94b51bd44fa33e0d225fc => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:44.660011 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2fa8-dc63-4513-808d-849f9e1a1eaa None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:44.660334 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2fa8-dc63-4513-808d-849f9e1a1eaa None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:44.660617 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2fa8-dc63-4513-808d-849f9e1a1eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:44.680732 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-7f6d2fa8-dc63-4513-808d-849f9e1a1eaa None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:44.682291 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-7f6d2fa8-dc63-4513-808d-849f9e1a1eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:44.753622 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1087/2164] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:44.762568 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fdfd9-5730-4987-a73a-4b3aa77b2d76 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:44.762854 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fdfd9-5730-4987-a73a-4b3aa77b2d76 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:44.763133 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fdfd9-5730-4987-a73a-4b3aa77b2d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:44.781763 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-1c4fdfd9-5730-4987-a73a-4b3aa77b2d76 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:44.782959 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-1c4fdfd9-5730-4987-a73a-4b3aa77b2d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:44.791692 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1078/2165] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:44.795954 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d2fa8-dc63-4513-808d-849f9e1a1eaa None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:44.806369 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d2fa8-dc63-4513-808d-849f9e1a1eaa None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:44.811568 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b3f92-ca69-4a49-b2ea-fe54ea81e4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:44.812548 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b3f92-ca69-4a49-b2ea-fe54ea81e4ee admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:44.812903 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b3f92-ca69-4a49-b2ea-fe54ea81e4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:44.813244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b3f92-ca69-4a49-b2ea-fe54ea81e4ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:44.814061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b3f92-ca69-4a49-b2ea-fe54ea81e4ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:16:44.814549 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b3f92-ca69-4a49-b2ea-fe54ea81e4ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:44.816244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b3f92-ca69-4a49-b2ea-fe54ea81e4ee admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:44.829921 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1088/2166] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:16:44.834285 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fdfd9-5730-4987-a73a-4b3aa77b2d76 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:44.843904 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fdfd9-5730-4987-a73a-4b3aa77b2d76 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:44.848706 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b4a81-4ec2-4dc2-a6fc-4a3f9ae7c1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:44.849358 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b4a81-4ec2-4dc2-a6fc-4a3f9ae7c1cc admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:44.849639 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b4a81-4ec2-4dc2-a6fc-4a3f9ae7c1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:44.849934 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b4a81-4ec2-4dc2-a6fc-4a3f9ae7c1cc admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:44.850714 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b4a81-4ec2-4dc2-a6fc-4a3f9ae7c1cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:44.852808 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b4a81-4ec2-4dc2-a6fc-4a3f9ae7c1cc admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:44.883537 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1079/2167] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:44 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:44.888268 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b3f92-ca69-4a49-b2ea-fe54ea81e4ee admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:44.900413 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b3f92-ca69-4a49-b2ea-fe54ea81e4ee admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:44.962453 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74a454-d866-4c9a-abd8-09d20fc23d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:44.963295 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74a454-d866-4c9a-abd8-09d20fc23d52 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:44.963722 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74a454-d866-4c9a-abd8-09d20fc23d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:44.964132 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74a454-d866-4c9a-abd8-09d20fc23d52 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:44.965015 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74a454-d866-4c9a-abd8-09d20fc23d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:44.967187 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74a454-d866-4c9a-abd8-09d20fc23d52 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:44.992438 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1089/2168] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:44 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:44.993937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b4a81-4ec2-4dc2-a6fc-4a3f9ae7c1cc admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:45.004239 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b4a81-4ec2-4dc2-a6fc-4a3f9ae7c1cc admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:45.012107 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e494d-e396-4839-ade2-d1781f2b24d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:45.012924 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e494d-e396-4839-ade2-d1781f2b24d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:45.013305 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e494d-e396-4839-ade2-d1781f2b24d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:45.013680 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e494d-e396-4839-ade2-d1781f2b24d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:45.014661 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e494d-e396-4839-ade2-d1781f2b24d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:45.016400 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e494d-e396-4839-ade2-d1781f2b24d0 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:45.027960 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1080/2169] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:45.033196 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74a454-d866-4c9a-abd8-09d20fc23d52 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:45.042579 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74a454-d866-4c9a-abd8-09d20fc23d52 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:45.058870 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed131dd-5deb-43ad-83ca-da564c107909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:45.059696 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed131dd-5deb-43ad-83ca-da564c107909 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:45.060103 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed131dd-5deb-43ad-83ca-da564c107909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:45.060480 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed131dd-5deb-43ad-83ca-da564c107909 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:45.061337 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed131dd-5deb-43ad-83ca-da564c107909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:45.063152 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed131dd-5deb-43ad-83ca-da564c107909 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:45.077062 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1090/2170] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:16:45.081156 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e494d-e396-4839-ade2-d1781f2b24d0 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:45.092350 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e494d-e396-4839-ade2-d1781f2b24d0 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:45.100049 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088c729-3350-4c6d-84be-34c5c77d1a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:45.101965 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088c729-3350-4c6d-84be-34c5c77d1a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:45.102228 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088c729-3350-4c6d-84be-34c5c77d1a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:45.102483 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088c729-3350-4c6d-84be-34c5c77d1a11 admin admin] PATH_INFO: `/v3/projects/893cb9e5a3dd4f8cbc746a73b7c03f74/users/d9ec05486d1f427c9dc6ef2fe1fe7469/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:45.119868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088c729-3350-4c6d-84be-34c5c77d1a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=893cb9e5a3dd4f8cbc746a73b7c03f74, user_id=d9ec05486d1f427c9dc6ef2fe1fe7469, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:45.122528 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088c729-3350-4c6d-84be-34c5c77d1a11 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:45.135936 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1081/2171] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:45 2022] PUT /identity/v3/projects/893cb9e5a3dd4f8cbc746a73b7c03f74/users/d9ec05486d1f427c9dc6ef2fe1fe7469/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:45.141003 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a231e-e605-40b2-b847-4ded7d1c7a8e None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:45.143142 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a231e-e605-40b2-b847-4ded7d1c7a8e None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:45.143643 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a231e-e605-40b2-b847-4ded7d1c7a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:45.178090 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-a23a231e-e605-40b2-b847-4ded7d1c7a8e None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:45.179502 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a23a231e-e605-40b2-b847-4ded7d1c7a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:45.279919 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1091/2172] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:16:45.292991 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088c729-3350-4c6d-84be-34c5c77d1a11 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:45.294786 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-d088c729-3350-4c6d-84be-34c5c77d1a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:45.388647 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088c729-3350-4c6d-84be-34c5c77d1a11 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:45.400703 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472aa527-62ec-40d8-bbb7-626914cba0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:45.401462 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa527-62ec-40d8-bbb7-626914cba0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:45.401816 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa527-62ec-40d8-bbb7-626914cba0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:45.402624 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa527-62ec-40d8-bbb7-626914cba0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:45.412925 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472aa527-62ec-40d8-bbb7-626914cba0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:45.414502 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472aa527-62ec-40d8-bbb7-626914cba0c4 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:45.424117 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1082/2173] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:45.735090 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a231e-e605-40b2-b847-4ded7d1c7a8e None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:45.736641 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a23a231e-e605-40b2-b847-4ded7d1c7a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:45.752250 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a231e-e605-40b2-b847-4ded7d1c7a8e None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:45.757083 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77accebc-5fd1-4986-a94b-5de1d2e29e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:45.758377 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77accebc-5fd1-4986-a94b-5de1d2e29e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:45.758804 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77accebc-5fd1-4986-a94b-5de1d2e29e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:45.759222 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77accebc-5fd1-4986-a94b-5de1d2e29e2f admin admin] PATH_INFO: `/v3/users/b9273105723042388794eda88ac2cbb9` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:45.760916 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77accebc-5fd1-4986-a94b-5de1d2e29e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9273105723042388794eda88ac2cbb9)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:45.763951 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77accebc-5fd1-4986-a94b-5de1d2e29e2f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:45.865411 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-77accebc-5fd1-4986-a94b-5de1d2e29e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9273105723042388794eda88ac2cbb9'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:45.884151 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-77accebc-5fd1-4986-a94b-5de1d2e29e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9273105723042388794eda88ac2cbb9'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:45.884904 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-77accebc-5fd1-4986-a94b-5de1d2e29e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9273105723042388794eda88ac2cbb9'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:45.899385 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-77accebc-5fd1-4986-a94b-5de1d2e29e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9273105723042388794eda88ac2cbb9'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:45.901249 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-77accebc-5fd1-4986-a94b-5de1d2e29e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9273105723042388794eda88ac2cbb9'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:45.935912 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1092/2174] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:45 2022] DELETE /identity/v3/users/b9273105723042388794eda88ac2cbb9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:45.937906 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915d47f-05b8-4538-9fad-f59b6fcdaa54 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:45.938363 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915d47f-05b8-4538-9fad-f59b6fcdaa54 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:45.938526 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915d47f-05b8-4538-9fad-f59b6fcdaa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:45.957962 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-e915d47f-05b8-4538-9fad-f59b6fcdaa54 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:45.959402 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e915d47f-05b8-4538-9fad-f59b6fcdaa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:46.044152 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1083/2175] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:46.054947 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77accebc-5fd1-4986-a94b-5de1d2e29e2f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:46.056452 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-77accebc-5fd1-4986-a94b-5de1d2e29e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:46.143337 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77accebc-5fd1-4986-a94b-5de1d2e29e2f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:46.149165 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9418de1-4e8c-4f83-a2b6-60c0c5886d59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:46.149649 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9418de1-4e8c-4f83-a2b6-60c0c5886d59 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:46.150250 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9418de1-4e8c-4f83-a2b6-60c0c5886d59 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:46.150535 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9418de1-4e8c-4f83-a2b6-60c0c5886d59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:46.160724 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9418de1-4e8c-4f83-a2b6-60c0c5886d59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:46.162159 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9418de1-4e8c-4f83-a2b6-60c0c5886d59 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:46.175804 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1093/2176] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:46.764162 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915d47f-05b8-4538-9fad-f59b6fcdaa54 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:46.765885 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e915d47f-05b8-4538-9fad-f59b6fcdaa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:46.794646 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915d47f-05b8-4538-9fad-f59b6fcdaa54 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:46.801063 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64cc94-c18e-410d-8e71-629c81f45599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:46.802007 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64cc94-c18e-410d-8e71-629c81f45599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:46.802361 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64cc94-c18e-410d-8e71-629c81f45599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:46.803180 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64cc94-c18e-410d-8e71-629c81f45599 admin admin] PATH_INFO: `/v3/projects/ef68c4cf4a724555bdc59d6f5ac08f23` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:46.805053 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64cc94-c18e-410d-8e71-629c81f45599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef68c4cf4a724555bdc59d6f5ac08f23)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:46.807163 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64cc94-c18e-410d-8e71-629c81f45599 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:46.884039 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4c64cc94-c18e-410d-8e71-629c81f45599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef68c4cf4a724555bdc59d6f5ac08f23', 'request_id': 'req-4c64cc94-c18e-410d-8e71-629c81f45599'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:46.896307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4c64cc94-c18e-410d-8e71-629c81f45599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef68c4cf4a724555bdc59d6f5ac08f23', 'request_id': 'req-4c64cc94-c18e-410d-8e71-629c81f45599'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:46.904409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4c64cc94-c18e-410d-8e71-629c81f45599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef68c4cf4a724555bdc59d6f5ac08f23', 'request_id': 'req-4c64cc94-c18e-410d-8e71-629c81f45599'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:46.920834 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4c64cc94-c18e-410d-8e71-629c81f45599 admin admin] The token cache is being invalidate because project ef68c4cf4a724555bdc59d6f5ac08f23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:46.921164 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4c64cc94-c18e-410d-8e71-629c81f45599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:46.921934 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4c64cc94-c18e-410d-8e71-629c81f45599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:46.928625 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1084/2177] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:46 2022] DELETE /identity/v3/projects/ef68c4cf4a724555bdc59d6f5ac08f23 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:46.930408 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5bd52-bdc2-4efc-888a-5bdc64e9b20c None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:46.930978 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5bd52-bdc2-4efc-888a-5bdc64e9b20c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:46.931253 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5bd52-bdc2-4efc-888a-5bdc64e9b20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:46.957115 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-38e5bd52-bdc2-4efc-888a-5bdc64e9b20c None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:46.959664 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-38e5bd52-bdc2-4efc-888a-5bdc64e9b20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:47.059369 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1094/2178] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:47.067330 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6895fab-52fc-4801-850b-b2721f1efc34 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:47.067853 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6895fab-52fc-4801-850b-b2721f1efc34 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:47.068646 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6895fab-52fc-4801-850b-b2721f1efc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:47.100180 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-f6895fab-52fc-4801-850b-b2721f1efc34 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:47.102269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-f6895fab-52fc-4801-850b-b2721f1efc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:47.110474 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1085/2179] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:47.114996 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5bd52-bdc2-4efc-888a-5bdc64e9b20c None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:47.127700 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5bd52-bdc2-4efc-888a-5bdc64e9b20c None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:47.135751 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ee0f3-4bae-441e-8f39-8743bbd1e03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:47.136392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ee0f3-4bae-441e-8f39-8743bbd1e03d admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:47.136673 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ee0f3-4bae-441e-8f39-8743bbd1e03d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:47.136942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ee0f3-4bae-441e-8f39-8743bbd1e03d admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:47.137689 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ee0f3-4bae-441e-8f39-8743bbd1e03d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:16:47.137991 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ee0f3-4bae-441e-8f39-8743bbd1e03d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:47.139583 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ee0f3-4bae-441e-8f39-8743bbd1e03d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:47.155728 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1095/2180] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:16:47.160758 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6895fab-52fc-4801-850b-b2721f1efc34 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:47.170406 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6895fab-52fc-4801-850b-b2721f1efc34 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:47.176022 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b6c0c-80fb-408f-baa9-789368dc4b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:47.176948 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b6c0c-80fb-408f-baa9-789368dc4b00 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:47.177305 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b6c0c-80fb-408f-baa9-789368dc4b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:47.177796 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b6c0c-80fb-408f-baa9-789368dc4b00 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:47.178362 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b6c0c-80fb-408f-baa9-789368dc4b00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:47.181179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b6c0c-80fb-408f-baa9-789368dc4b00 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:47.222187 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1086/2181] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:47 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:47.226025 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ee0f3-4bae-441e-8f39-8743bbd1e03d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:47.246153 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ee0f3-4bae-441e-8f39-8743bbd1e03d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:47.318126 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d11b89-5e25-491e-b0f0-d00d5f14693d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:47.319073 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d11b89-5e25-491e-b0f0-d00d5f14693d admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:47.320203 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d11b89-5e25-491e-b0f0-d00d5f14693d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:47.320631 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d11b89-5e25-491e-b0f0-d00d5f14693d admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:47.321496 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d11b89-5e25-491e-b0f0-d00d5f14693d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:47.323658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d11b89-5e25-491e-b0f0-d00d5f14693d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:47.354246 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1096/2182] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:47 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:47.358941 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b6c0c-80fb-408f-baa9-789368dc4b00 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:47.372914 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b6c0c-80fb-408f-baa9-789368dc4b00 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:47.378459 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a2890-2f20-4ba3-8989-5374ec0f8fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:47.384770 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a2890-2f20-4ba3-8989-5374ec0f8fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:47.385121 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a2890-2f20-4ba3-8989-5374ec0f8fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:47.385411 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a2890-2f20-4ba3-8989-5374ec0f8fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:47.386271 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a2890-2f20-4ba3-8989-5374ec0f8fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:47.388062 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a2890-2f20-4ba3-8989-5374ec0f8fe8 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:47.405816 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1087/2183] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:47.410185 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d11b89-5e25-491e-b0f0-d00d5f14693d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:47.422329 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d11b89-5e25-491e-b0f0-d00d5f14693d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:47.427434 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a3894-4d4d-4dc8-94f6-2d3c1830fa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:47.428504 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a3894-4d4d-4dc8-94f6-2d3c1830fa59 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:47.429217 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a3894-4d4d-4dc8-94f6-2d3c1830fa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:47.429634 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a3894-4d4d-4dc8-94f6-2d3c1830fa59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:47.430540 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a3894-4d4d-4dc8-94f6-2d3c1830fa59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:47.432581 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a3894-4d4d-4dc8-94f6-2d3c1830fa59 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:47.449325 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1097/2184] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:47.450929 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a2890-2f20-4ba3-8989-5374ec0f8fe8 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:47.465747 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a2890-2f20-4ba3-8989-5374ec0f8fe8 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:47.479116 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941f630-6109-4ac2-907d-21c56a4290d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:47.480053 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941f630-6109-4ac2-907d-21c56a4290d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:47.480332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941f630-6109-4ac2-907d-21c56a4290d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:47.480605 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941f630-6109-4ac2-907d-21c56a4290d4 admin admin] PATH_INFO: `/v3/projects/9f679cfd97e94f858269279bae942084/users/a5e18068d73b4fabb0a0f4ee76a623f5/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:47.508909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941f630-6109-4ac2-907d-21c56a4290d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f679cfd97e94f858269279bae942084, user_id=a5e18068d73b4fabb0a0f4ee76a623f5, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:47.511417 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941f630-6109-4ac2-907d-21c56a4290d4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:47.541443 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1088/2185] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:47 2022] PUT /identity/v3/projects/9f679cfd97e94f858269279bae942084/users/a5e18068d73b4fabb0a0f4ee76a623f5/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:47.552724 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dab3ab-5cfb-4d9f-9f65-19e6a6c001f5 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:47.553207 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dab3ab-5cfb-4d9f-9f65-19e6a6c001f5 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:47.554389 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dab3ab-5cfb-4d9f-9f65-19e6a6c001f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:47.676839 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-78dab3ab-5cfb-4d9f-9f65-19e6a6c001f5 None None] MFA Rules not processed for user `a5e18068d73b4fabb0a0f4ee76a623f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:47.685280 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-78dab3ab-5cfb-4d9f-9f65-19e6a6c001f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:47.807436 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1098/2186] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:47.817442 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941f630-6109-4ac2-907d-21c56a4290d4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:47.820171 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-4941f630-6109-4ac2-907d-21c56a4290d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:47.904773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941f630-6109-4ac2-907d-21c56a4290d4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:47.908818 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315980af-0dc1-4f54-aad4-29ca29531379 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:47.909467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315980af-0dc1-4f54-aad4-29ca29531379 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:47.909907 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315980af-0dc1-4f54-aad4-29ca29531379 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:47.910183 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315980af-0dc1-4f54-aad4-29ca29531379 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:47.931431 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315980af-0dc1-4f54-aad4-29ca29531379 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:47.933054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315980af-0dc1-4f54-aad4-29ca29531379 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:47.946351 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1089/2187] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:50.500128 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e9ad0-02a2-405b-8c37-9cf49b08ec05 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:50.501059 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e9ad0-02a2-405b-8c37-9cf49b08ec05 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:50.501485 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e9ad0-02a2-405b-8c37-9cf49b08ec05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:50.524200 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-443e9ad0-02a2-405b-8c37-9cf49b08ec05 None None] MFA Rules not processed for user `3da4e93429a84af6ba36fc0fbc544a16`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:50.525599 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-443e9ad0-02a2-405b-8c37-9cf49b08ec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:50.613990 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1099/2188] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:51.460568 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fdf98-fe83-4879-b3a8-95cdf2d1af71 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:51.460568 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fdf98-fe83-4879-b3a8-95cdf2d1af71 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:51.460568 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fdf98-fe83-4879-b3a8-95cdf2d1af71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:51.493104 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-844fdf98-fe83-4879-b3a8-95cdf2d1af71 None None] MFA Rules not processed for user `d9ec05486d1f427c9dc6ef2fe1fe7469`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:51.494999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-844fdf98-fe83-4879-b3a8-95cdf2d1af71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:51.603552 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1090/2189] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:51.613333 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e9ad0-02a2-405b-8c37-9cf49b08ec05 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:51.614940 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-443e9ad0-02a2-405b-8c37-9cf49b08ec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:51.767095 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e9ad0-02a2-405b-8c37-9cf49b08ec05 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:51.796738 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ceac36-16eb-4fc8-a144-31fad1235688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:51.797728 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceac36-16eb-4fc8-a144-31fad1235688 service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:51.798157 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceac36-16eb-4fc8-a144-31fad1235688 service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:51.798598 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceac36-16eb-4fc8-a144-31fad1235688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:51.810298 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ceac36-16eb-4fc8-a144-31fad1235688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:51.811922 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ceac36-16eb-4fc8-a144-31fad1235688 service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:51.823120 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1100/2190] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:52.489405 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fdf98-fe83-4879-b3a8-95cdf2d1af71 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:52.579213 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fdf98-fe83-4879-b3a8-95cdf2d1af71 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:52.585488 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cdebb-3d80-4ce8-a36a-ef538d3aca32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:52.586788 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cdebb-3d80-4ce8-a36a-ef538d3aca32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:52.587176 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cdebb-3d80-4ce8-a36a-ef538d3aca32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:52.587550 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cdebb-3d80-4ce8-a36a-ef538d3aca32 admin admin] PATH_INFO: `/v3/users/a5e18068d73b4fabb0a0f4ee76a623f5` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:52.589180 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cdebb-3d80-4ce8-a36a-ef538d3aca32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e18068d73b4fabb0a0f4ee76a623f5)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:52.591865 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cdebb-3d80-4ce8-a36a-ef538d3aca32 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:52.670010 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a95cdebb-3d80-4ce8-a36a-ef538d3aca32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e18068d73b4fabb0a0f4ee76a623f5'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:52.689354 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a95cdebb-3d80-4ce8-a36a-ef538d3aca32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e18068d73b4fabb0a0f4ee76a623f5'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:52.690098 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a95cdebb-3d80-4ce8-a36a-ef538d3aca32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e18068d73b4fabb0a0f4ee76a623f5'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:52.690878 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a95cdebb-3d80-4ce8-a36a-ef538d3aca32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e18068d73b4fabb0a0f4ee76a623f5'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:52.702455 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a95cdebb-3d80-4ce8-a36a-ef538d3aca32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e18068d73b4fabb0a0f4ee76a623f5'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:52.716135 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1091/2191] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:52 2022] DELETE /identity/v3/users/a5e18068d73b4fabb0a0f4ee76a623f5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:52.720747 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a36412-ce4f-4269-8603-a04be8461e8f None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:52.721249 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a36412-ce4f-4269-8603-a04be8461e8f None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:52.721344 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a36412-ce4f-4269-8603-a04be8461e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:52.744133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-86a36412-ce4f-4269-8603-a04be8461e8f None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:52.746093 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-86a36412-ce4f-4269-8603-a04be8461e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:52.822723 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1101/2192] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:52.838707 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cdebb-3d80-4ce8-a36a-ef538d3aca32 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:52.840912 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a95cdebb-3d80-4ce8-a36a-ef538d3aca32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:52.974450 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cdebb-3d80-4ce8-a36a-ef538d3aca32 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:52.980278 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a75d4-a740-4776-b5b3-b6a62b44048d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:52.981866 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a75d4-a740-4776-b5b3-b6a62b44048d service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:52.982418 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a75d4-a740-4776-b5b3-b6a62b44048d service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:52.982898 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a75d4-a740-4776-b5b3-b6a62b44048d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:52.996809 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a75d4-a740-4776-b5b3-b6a62b44048d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:52.998937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a75d4-a740-4776-b5b3-b6a62b44048d service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:53.013559 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1092/2193] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:16:54.360037 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a36412-ce4f-4269-8603-a04be8461e8f None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:54.363114 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-86a36412-ce4f-4269-8603-a04be8461e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:54.385308 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a36412-ce4f-4269-8603-a04be8461e8f None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:54.390573 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc936a-8523-4c27-ac1b-2aac47703f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:54.391682 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc936a-8523-4c27-ac1b-2aac47703f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:54.392329 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc936a-8523-4c27-ac1b-2aac47703f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:54.393478 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc936a-8523-4c27-ac1b-2aac47703f0a admin admin] PATH_INFO: `/v3/users/b592993511334af099958dff6d443a09` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:54.394907 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc936a-8523-4c27-ac1b-2aac47703f0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b592993511334af099958dff6d443a09)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:54.397113 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc936a-8523-4c27-ac1b-2aac47703f0a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:54.470058 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-76bc936a-8523-4c27-ac1b-2aac47703f0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b592993511334af099958dff6d443a09'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:54.495480 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-76bc936a-8523-4c27-ac1b-2aac47703f0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b592993511334af099958dff6d443a09'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:54.497291 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-76bc936a-8523-4c27-ac1b-2aac47703f0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b592993511334af099958dff6d443a09'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:54.508016 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-76bc936a-8523-4c27-ac1b-2aac47703f0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b592993511334af099958dff6d443a09'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:54.509099 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-76bc936a-8523-4c27-ac1b-2aac47703f0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b592993511334af099958dff6d443a09'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:54.525876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1102/2194] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:54 2022] DELETE /identity/v3/users/b592993511334af099958dff6d443a09 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:54.579300 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a75d4-a740-4776-b5b3-b6a62b44048d service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:54.581197 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e24a75d4-a740-4776-b5b3-b6a62b44048d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:54.609235 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a75d4-a740-4776-b5b3-b6a62b44048d service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:54.744030 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99042f2d-54d9-4d6f-a2ad-a259c4887962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:54.766849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99042f2d-54d9-4d6f-a2ad-a259c4887962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:54.766849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99042f2d-54d9-4d6f-a2ad-a259c4887962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:54.766849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99042f2d-54d9-4d6f-a2ad-a259c4887962 admin admin] PATH_INFO: `/v3/projects/9f679cfd97e94f858269279bae942084` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:54.766849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99042f2d-54d9-4d6f-a2ad-a259c4887962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f679cfd97e94f858269279bae942084)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:54.766849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99042f2d-54d9-4d6f-a2ad-a259c4887962 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:54.843416 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-99042f2d-54d9-4d6f-a2ad-a259c4887962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f679cfd97e94f858269279bae942084', 'request_id': 'req-99042f2d-54d9-4d6f-a2ad-a259c4887962'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:54.854544 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-99042f2d-54d9-4d6f-a2ad-a259c4887962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f679cfd97e94f858269279bae942084', 'request_id': 'req-99042f2d-54d9-4d6f-a2ad-a259c4887962'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:54.873980 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-99042f2d-54d9-4d6f-a2ad-a259c4887962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f679cfd97e94f858269279bae942084', 'request_id': 'req-99042f2d-54d9-4d6f-a2ad-a259c4887962'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:54.909216 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-99042f2d-54d9-4d6f-a2ad-a259c4887962 admin admin] The token cache is being invalidate because project 9f679cfd97e94f858269279bae942084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:54.909517 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-99042f2d-54d9-4d6f-a2ad-a259c4887962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:54.913682 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-99042f2d-54d9-4d6f-a2ad-a259c4887962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:54.925652 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c67ef-82a9-4cf2-a96f-5b5d2b0f89dd None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:54.926318 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c67ef-82a9-4cf2-a96f-5b5d2b0f89dd None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:54.926844 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c67ef-82a9-4cf2-a96f-5b5d2b0f89dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:54.928000 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1093/2195] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:54 2022] DELETE /identity/v3/projects/9f679cfd97e94f858269279bae942084 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:55.003594 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-e43c67ef-82a9-4cf2-a96f-5b5d2b0f89dd None None] MFA Rules not processed for user `d9ec05486d1f427c9dc6ef2fe1fe7469`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:55.007633 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e43c67ef-82a9-4cf2-a96f-5b5d2b0f89dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:55.157864 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99042f2d-54d9-4d6f-a2ad-a259c4887962 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:55.159375 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-99042f2d-54d9-4d6f-a2ad-a259c4887962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:55.186497 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1103/2196] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:55.258134 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99042f2d-54d9-4d6f-a2ad-a259c4887962 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:55.265519 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657eec94-e9c3-493d-a7f5-4dfbcaf720c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:55.266909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eec94-e9c3-493d-a7f5-4dfbcaf720c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:55.267731 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eec94-e9c3-493d-a7f5-4dfbcaf720c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:55.267937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eec94-e9c3-493d-a7f5-4dfbcaf720c6 admin admin] PATH_INFO: `/v3/projects/c611c7018f124b9792c90c06a0c2b25d` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:55.270179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657eec94-e9c3-493d-a7f5-4dfbcaf720c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c611c7018f124b9792c90c06a0c2b25d)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:55.273251 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657eec94-e9c3-493d-a7f5-4dfbcaf720c6 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:55.348554 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-657eec94-e9c3-493d-a7f5-4dfbcaf720c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c611c7018f124b9792c90c06a0c2b25d', 'request_id': 'req-657eec94-e9c3-493d-a7f5-4dfbcaf720c6'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:55.362892 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-657eec94-e9c3-493d-a7f5-4dfbcaf720c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c611c7018f124b9792c90c06a0c2b25d', 'request_id': 'req-657eec94-e9c3-493d-a7f5-4dfbcaf720c6'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:55.377243 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-657eec94-e9c3-493d-a7f5-4dfbcaf720c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c611c7018f124b9792c90c06a0c2b25d', 'request_id': 'req-657eec94-e9c3-493d-a7f5-4dfbcaf720c6'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:55.396284 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-657eec94-e9c3-493d-a7f5-4dfbcaf720c6 admin admin] The token cache is being invalidate because project c611c7018f124b9792c90c06a0c2b25d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:55.396480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-657eec94-e9c3-493d-a7f5-4dfbcaf720c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:55.397704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-657eec94-e9c3-493d-a7f5-4dfbcaf720c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:55.402870 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1094/2197] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:55 2022] DELETE /identity/v3/projects/c611c7018f124b9792c90c06a0c2b25d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:16:55.404276 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c67ef-82a9-4cf2-a96f-5b5d2b0f89dd None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:55.435019 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c67ef-82a9-4cf2-a96f-5b5d2b0f89dd None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:55.561686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117948a1-cad6-45b2-b67d-f53139d16b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:55.562735 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117948a1-cad6-45b2-b67d-f53139d16b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:55.563276 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117948a1-cad6-45b2-b67d-f53139d16b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:55.563897 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117948a1-cad6-45b2-b67d-f53139d16b00 admin admin] PATH_INFO: `/v3/users/bfa87d757bac46bb80deb4be93d5124d` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:55.566288 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117948a1-cad6-45b2-b67d-f53139d16b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfa87d757bac46bb80deb4be93d5124d)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:55.569924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117948a1-cad6-45b2-b67d-f53139d16b00 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:55.657736 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-117948a1-cad6-45b2-b67d-f53139d16b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfa87d757bac46bb80deb4be93d5124d'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:55.674268 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-117948a1-cad6-45b2-b67d-f53139d16b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfa87d757bac46bb80deb4be93d5124d'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:55.675005 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-117948a1-cad6-45b2-b67d-f53139d16b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfa87d757bac46bb80deb4be93d5124d'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:55.702056 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-117948a1-cad6-45b2-b67d-f53139d16b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfa87d757bac46bb80deb4be93d5124d'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:55.703722 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-117948a1-cad6-45b2-b67d-f53139d16b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfa87d757bac46bb80deb4be93d5124d'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:55.734156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1104/2198] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:16:55 2022] DELETE /identity/v3/users/bfa87d757bac46bb80deb4be93d5124d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:56.068743 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657eec94-e9c3-493d-a7f5-4dfbcaf720c6 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:56.071635 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-657eec94-e9c3-493d-a7f5-4dfbcaf720c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:56.089523 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657eec94-e9c3-493d-a7f5-4dfbcaf720c6 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:56.170878 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e1ef8-01b5-4ec4-b127-a272cb012557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:56.171652 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e1ef8-01b5-4ec4-b127-a272cb012557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:56.171974 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e1ef8-01b5-4ec4-b127-a272cb012557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:56.172251 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e1ef8-01b5-4ec4-b127-a272cb012557 admin admin] PATH_INFO: `/v3/projects/0873f13f36e7452ea0b6a94427ad9ed5` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:56.173610 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e1ef8-01b5-4ec4-b127-a272cb012557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0873f13f36e7452ea0b6a94427ad9ed5)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:56.175543 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e1ef8-01b5-4ec4-b127-a272cb012557 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:56.229657 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1a8e1ef8-01b5-4ec4-b127-a272cb012557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0873f13f36e7452ea0b6a94427ad9ed5', 'request_id': 'req-1a8e1ef8-01b5-4ec4-b127-a272cb012557'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:56.237615 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1a8e1ef8-01b5-4ec4-b127-a272cb012557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0873f13f36e7452ea0b6a94427ad9ed5', 'request_id': 'req-1a8e1ef8-01b5-4ec4-b127-a272cb012557'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:56.244053 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1a8e1ef8-01b5-4ec4-b127-a272cb012557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0873f13f36e7452ea0b6a94427ad9ed5', 'request_id': 'req-1a8e1ef8-01b5-4ec4-b127-a272cb012557'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:56.255000 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1a8e1ef8-01b5-4ec4-b127-a272cb012557 admin admin] The token cache is being invalidate because project 0873f13f36e7452ea0b6a94427ad9ed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:16:56.255291 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1a8e1ef8-01b5-4ec4-b127-a272cb012557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:56.255990 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1a8e1ef8-01b5-4ec4-b127-a272cb012557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:16:56.259852 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1095/2199] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:16:56 2022] DELETE /identity/v3/projects/0873f13f36e7452ea0b6a94427ad9ed5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:56.263099 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b67a8-e8ab-4ac4-a0cc-b0e492691fe9 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:56.263393 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b67a8-e8ab-4ac4-a0cc-b0e492691fe9 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:56.263676 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b67a8-e8ab-4ac4-a0cc-b0e492691fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:56.282741 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-de4b67a8-e8ab-4ac4-a0cc-b0e492691fe9 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:56.284180 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-de4b67a8-e8ab-4ac4-a0cc-b0e492691fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:56.362391 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1105/2200] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:16:56.364113 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c663e-24f9-44ea-baa8-8dec7051b542 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:56.364629 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c663e-24f9-44ea-baa8-8dec7051b542 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:56.364748 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c663e-24f9-44ea-baa8-8dec7051b542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:56.387506 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-f04c663e-24f9-44ea-baa8-8dec7051b542 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:56.389017 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-f04c663e-24f9-44ea-baa8-8dec7051b542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:56.405335 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1096/2201] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:56.406552 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b67a8-e8ab-4ac4-a0cc-b0e492691fe9 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:56.420107 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b67a8-e8ab-4ac4-a0cc-b0e492691fe9 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:56.426037 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520cd05-62b1-4e27-8036-accef6d9f6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:56.426938 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520cd05-62b1-4e27-8036-accef6d9f6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:56.427393 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520cd05-62b1-4e27-8036-accef6d9f6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:56.427871 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520cd05-62b1-4e27-8036-accef6d9f6b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:56.429588 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520cd05-62b1-4e27-8036-accef6d9f6b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:16:56.430213 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520cd05-62b1-4e27-8036-accef6d9f6b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:56.433542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520cd05-62b1-4e27-8036-accef6d9f6b2 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:56.488189 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1106/2202] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:16:56.493513 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c663e-24f9-44ea-baa8-8dec7051b542 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:56.505082 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c663e-24f9-44ea-baa8-8dec7051b542 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:56.517320 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43378463-0ae6-4c73-85fe-cfd2162df69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:56.518445 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43378463-0ae6-4c73-85fe-cfd2162df69f admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:56.518949 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43378463-0ae6-4c73-85fe-cfd2162df69f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:56.519441 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43378463-0ae6-4c73-85fe-cfd2162df69f admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:56.520588 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43378463-0ae6-4c73-85fe-cfd2162df69f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:56.523798 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43378463-0ae6-4c73-85fe-cfd2162df69f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:56.565604 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1097/2203] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:16:56 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:16:56.566744 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520cd05-62b1-4e27-8036-accef6d9f6b2 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:56.577770 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520cd05-62b1-4e27-8036-accef6d9f6b2 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:56.649491 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24fbab-fd0b-487d-81ec-1683335a9b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:56.650169 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24fbab-fd0b-487d-81ec-1683335a9b92 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:56.650455 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24fbab-fd0b-487d-81ec-1683335a9b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:56.650735 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24fbab-fd0b-487d-81ec-1683335a9b92 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:56.651447 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24fbab-fd0b-487d-81ec-1683335a9b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:56.654089 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24fbab-fd0b-487d-81ec-1683335a9b92 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:56.679025 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1107/2204] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:16:56 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:16:56.684089 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43378463-0ae6-4c73-85fe-cfd2162df69f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:56.697593 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43378463-0ae6-4c73-85fe-cfd2162df69f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:56.705505 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f061f2-84fd-4419-afd8-c615116a7415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:56.706190 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f061f2-84fd-4419-afd8-c615116a7415 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:56.706481 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f061f2-84fd-4419-afd8-c615116a7415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:56.707141 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f061f2-84fd-4419-afd8-c615116a7415 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:56.707584 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f061f2-84fd-4419-afd8-c615116a7415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:56.709927 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f061f2-84fd-4419-afd8-c615116a7415 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:56.727847 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1098/2205] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:56.732948 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24fbab-fd0b-487d-81ec-1683335a9b92 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:56.745554 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24fbab-fd0b-487d-81ec-1683335a9b92 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:56.752505 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3984ae5-33db-4b61-a05d-f720c4b777ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:56.753253 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3984ae5-33db-4b61-a05d-f720c4b777ed admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:56.753615 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3984ae5-33db-4b61-a05d-f720c4b777ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:56.753975 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3984ae5-33db-4b61-a05d-f720c4b777ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:56.754966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3984ae5-33db-4b61-a05d-f720c4b777ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:56.757493 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3984ae5-33db-4b61-a05d-f720c4b777ed admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:56.774533 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1108/2206] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:16:56.776225 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f061f2-84fd-4419-afd8-c615116a7415 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:56.791962 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f061f2-84fd-4419-afd8-c615116a7415 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:56.806823 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd891eb-62a1-4ef5-8f8f-c9d146859313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:56.807736 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd891eb-62a1-4ef5-8f8f-c9d146859313 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:56.808054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd891eb-62a1-4ef5-8f8f-c9d146859313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:56.808467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd891eb-62a1-4ef5-8f8f-c9d146859313 admin admin] PATH_INFO: `/v3/projects/57b30b6322204e2fb323f296ad072aac/users/eb8d121db53343e680e90e4e9bb267ae/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:56.837671 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd891eb-62a1-4ef5-8f8f-c9d146859313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b30b6322204e2fb323f296ad072aac, user_id=eb8d121db53343e680e90e4e9bb267ae, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:56.840390 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd891eb-62a1-4ef5-8f8f-c9d146859313 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:56.857279 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1099/2207] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:16:56 2022] PUT /identity/v3/projects/57b30b6322204e2fb323f296ad072aac/users/eb8d121db53343e680e90e4e9bb267ae/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:16:56.867473 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed43160-48ed-4d07-bd8a-a5c8aaea4a42 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:56.867769 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed43160-48ed-4d07-bd8a-a5c8aaea4a42 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:56.868338 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed43160-48ed-4d07-bd8a-a5c8aaea4a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:56.907049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-4ed43160-48ed-4d07-bd8a-a5c8aaea4a42 None None] MFA Rules not processed for user `eb8d121db53343e680e90e4e9bb267ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:16:56.908295 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-4ed43160-48ed-4d07-bd8a-a5c8aaea4a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:56.983401 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1109/2208] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:16:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:16:56.994824 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd891eb-62a1-4ef5-8f8f-c9d146859313 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:16:56.996532 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-bfd891eb-62a1-4ef5-8f8f-c9d146859313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:16:57.071633 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd891eb-62a1-4ef5-8f8f-c9d146859313 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:16:57.091206 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77006bc-4992-498a-afa7-aa1f9ef5661a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:16:57.091971 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77006bc-4992-498a-afa7-aa1f9ef5661a service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:16:57.092524 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77006bc-4992-498a-afa7-aa1f9ef5661a service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:16:57.092949 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77006bc-4992-498a-afa7-aa1f9ef5661a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:16:57.106876 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77006bc-4992-498a-afa7-aa1f9ef5661a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:16:57.110137 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77006bc-4992-498a-afa7-aa1f9ef5661a service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:16:57.121900 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1100/2209] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:16:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:17:11.046337 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100f646-c93a-4e6a-b981-3c26465892fe None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:11.046876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100f646-c93a-4e6a-b981-3c26465892fe None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:11.046876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100f646-c93a-4e6a-b981-3c26465892fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:11.065479 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-e100f646-c93a-4e6a-b981-3c26465892fe None None] MFA Rules not processed for user `bf4571d4a93246429874fb6bced95c85`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:17:11.066690 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e100f646-c93a-4e6a-b981-3c26465892fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:17:11.127690 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1110/2210] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:17:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:17:23.995179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77006bc-4992-498a-afa7-aa1f9ef5661a service cinder] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:24.062252 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77006bc-4992-498a-afa7-aa1f9ef5661a service cinder] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:24.066793 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03d3f3-e19e-4633-bdef-6b04f282cfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:24.067650 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03d3f3-e19e-4633-bdef-6b04f282cfb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:24.067966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03d3f3-e19e-4633-bdef-6b04f282cfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:24.068240 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03d3f3-e19e-4633-bdef-6b04f282cfb7 admin admin] PATH_INFO: `/v3/users/eb8d121db53343e680e90e4e9bb267ae` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:24.069501 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03d3f3-e19e-4633-bdef-6b04f282cfb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb8d121db53343e680e90e4e9bb267ae)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:24.071434 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03d3f3-e19e-4633-bdef-6b04f282cfb7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:24.122999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cd03d3f3-e19e-4633-bdef-6b04f282cfb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb8d121db53343e680e90e4e9bb267ae'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:24.134941 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cd03d3f3-e19e-4633-bdef-6b04f282cfb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb8d121db53343e680e90e4e9bb267ae'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:24.135631 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cd03d3f3-e19e-4633-bdef-6b04f282cfb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb8d121db53343e680e90e4e9bb267ae'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:24.136561 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cd03d3f3-e19e-4633-bdef-6b04f282cfb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb8d121db53343e680e90e4e9bb267ae'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:24.144596 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cd03d3f3-e19e-4633-bdef-6b04f282cfb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb8d121db53343e680e90e4e9bb267ae'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:24.157425 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1101/2211] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:17:23 2022] DELETE /identity/v3/users/eb8d121db53343e680e90e4e9bb267ae => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:17:24.161916 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb2899-e030-424e-a29a-94fb2ec17f00 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:24.162389 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb2899-e030-424e-a29a-94fb2ec17f00 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:24.162480 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb2899-e030-424e-a29a-94fb2ec17f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:24.180934 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-4ffb2899-e030-424e-a29a-94fb2ec17f00 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:17:24.182041 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-4ffb2899-e030-424e-a29a-94fb2ec17f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:17:24.238116 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1111/2212] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:17:24.248060 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03d3f3-e19e-4633-bdef-6b04f282cfb7 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:24.249502 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-cd03d3f3-e19e-4633-bdef-6b04f282cfb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:17:24.304411 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03d3f3-e19e-4633-bdef-6b04f282cfb7 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:24.308215 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f4e58-e37e-42cf-ae10-aa8e36e4aa8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:24.308862 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f4e58-e37e-42cf-ae10-aa8e36e4aa8f service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:24.309146 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f4e58-e37e-42cf-ae10-aa8e36e4aa8f service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:24.309431 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f4e58-e37e-42cf-ae10-aa8e36e4aa8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:24.320890 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f4e58-e37e-42cf-ae10-aa8e36e4aa8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:24.322269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f4e58-e37e-42cf-ae10-aa8e36e4aa8f service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:24.332060 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1102/2213] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:17:24.697076 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb2899-e030-424e-a29a-94fb2ec17f00 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:24.698470 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-4ffb2899-e030-424e-a29a-94fb2ec17f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:17:24.710025 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb2899-e030-424e-a29a-94fb2ec17f00 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:24.715428 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e852d01-22cd-4ae6-b791-c8ebc5514c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:24.716354 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e852d01-22cd-4ae6-b791-c8ebc5514c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:24.716631 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e852d01-22cd-4ae6-b791-c8ebc5514c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:24.717013 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e852d01-22cd-4ae6-b791-c8ebc5514c22 admin admin] PATH_INFO: `/v3/projects/57b30b6322204e2fb323f296ad072aac` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:24.718126 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e852d01-22cd-4ae6-b791-c8ebc5514c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57b30b6322204e2fb323f296ad072aac)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:24.720260 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e852d01-22cd-4ae6-b791-c8ebc5514c22 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:24.769303 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4e852d01-22cd-4ae6-b791-c8ebc5514c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57b30b6322204e2fb323f296ad072aac', 'request_id': 'req-4e852d01-22cd-4ae6-b791-c8ebc5514c22'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:24.775108 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4e852d01-22cd-4ae6-b791-c8ebc5514c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57b30b6322204e2fb323f296ad072aac', 'request_id': 'req-4e852d01-22cd-4ae6-b791-c8ebc5514c22'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:24.781139 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4e852d01-22cd-4ae6-b791-c8ebc5514c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57b30b6322204e2fb323f296ad072aac', 'request_id': 'req-4e852d01-22cd-4ae6-b791-c8ebc5514c22'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:24.794568 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4e852d01-22cd-4ae6-b791-c8ebc5514c22 admin admin] The token cache is being invalidate because project 57b30b6322204e2fb323f296ad072aac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:17:24.794858 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4e852d01-22cd-4ae6-b791-c8ebc5514c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:24.795476 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4e852d01-22cd-4ae6-b791-c8ebc5514c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:24.797096 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1112/2214] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:17:24 2022] DELETE /identity/v3/projects/57b30b6322204e2fb323f296ad072aac => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:17:24.801995 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214c654-34fc-44d0-8695-7655f292e10e None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:24.802295 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214c654-34fc-44d0-8695-7655f292e10e None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:24.802580 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214c654-34fc-44d0-8695-7655f292e10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:24.820929 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-a214c654-34fc-44d0-8695-7655f292e10e None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:17:24.822129 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a214c654-34fc-44d0-8695-7655f292e10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:17:24.890871 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1103/2215] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:17:24.899029 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9efad-75d8-4743-aa22-099cdff03149 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:24.899330 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9efad-75d8-4743-aa22-099cdff03149 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:24.899606 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9efad-75d8-4743-aa22-099cdff03149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:24.918828 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-7cc9efad-75d8-4743-aa22-099cdff03149 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:17:24.920061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-7cc9efad-75d8-4743-aa22-099cdff03149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:17:24.930006 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1113/2216] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:17:24.938749 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214c654-34fc-44d0-8695-7655f292e10e None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:24.949414 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214c654-34fc-44d0-8695-7655f292e10e None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:24.954416 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27974f-d476-401e-9b0e-2f882c486852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:24.955183 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27974f-d476-401e-9b0e-2f882c486852 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:24.955671 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27974f-d476-401e-9b0e-2f882c486852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:24.956078 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27974f-d476-401e-9b0e-2f882c486852 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:24.956930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27974f-d476-401e-9b0e-2f882c486852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:17:24.957329 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27974f-d476-401e-9b0e-2f882c486852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:24.959095 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27974f-d476-401e-9b0e-2f882c486852 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:24.975192 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1104/2217] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:17:24.978506 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9efad-75d8-4743-aa22-099cdff03149 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:25.005675 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9efad-75d8-4743-aa22-099cdff03149 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:25.018008 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680949f9-6c9b-4844-b9ae-234a07d2192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:25.018720 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680949f9-6c9b-4844-b9ae-234a07d2192c admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:25.019010 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680949f9-6c9b-4844-b9ae-234a07d2192c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:25.019285 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680949f9-6c9b-4844-b9ae-234a07d2192c admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:25.020036 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680949f9-6c9b-4844-b9ae-234a07d2192c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:25.021974 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680949f9-6c9b-4844-b9ae-234a07d2192c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:25.058997 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1114/2218] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:17:24 2022] POST /identity/v3/projects => generated 399 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:17:25.062980 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27974f-d476-401e-9b0e-2f882c486852 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:25.073754 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27974f-d476-401e-9b0e-2f882c486852 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:25.167422 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575aa070-c31a-4fe5-a05d-5e6052a476ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:25.168351 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575aa070-c31a-4fe5-a05d-5e6052a476ee admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:25.168646 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575aa070-c31a-4fe5-a05d-5e6052a476ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:25.168927 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575aa070-c31a-4fe5-a05d-5e6052a476ee admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:25.169690 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575aa070-c31a-4fe5-a05d-5e6052a476ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:25.177174 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575aa070-c31a-4fe5-a05d-5e6052a476ee admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:25.202925 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1105/2219] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:17:25 2022] POST /identity/v3/users => generated 300 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:17:25.206948 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680949f9-6c9b-4844-b9ae-234a07d2192c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:25.221364 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680949f9-6c9b-4844-b9ae-234a07d2192c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:25.227474 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5297f-98c0-4011-9b73-5558ae669c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:25.228255 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5297f-98c0-4011-9b73-5558ae669c95 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:25.228537 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5297f-98c0-4011-9b73-5558ae669c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:25.228807 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5297f-98c0-4011-9b73-5558ae669c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:25.229951 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5297f-98c0-4011-9b73-5558ae669c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:25.232211 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5297f-98c0-4011-9b73-5558ae669c95 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:25.245488 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1115/2220] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:17:25.249642 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575aa070-c31a-4fe5-a05d-5e6052a476ee admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:25.262746 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575aa070-c31a-4fe5-a05d-5e6052a476ee admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:25.268301 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c533a4a-3abd-4c69-9d9b-b1d5f3e3b71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:25.269030 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c533a4a-3abd-4c69-9d9b-b1d5f3e3b71c admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:25.269487 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c533a4a-3abd-4c69-9d9b-b1d5f3e3b71c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:25.270335 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c533a4a-3abd-4c69-9d9b-b1d5f3e3b71c admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:25.270901 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c533a4a-3abd-4c69-9d9b-b1d5f3e3b71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:25.272999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c533a4a-3abd-4c69-9d9b-b1d5f3e3b71c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:25.288047 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1106/2221] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:17:25.291022 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5297f-98c0-4011-9b73-5558ae669c95 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:25.301039 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5297f-98c0-4011-9b73-5558ae669c95 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:25.306397 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b573b71-e314-443b-a9ba-84b513a0eaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:25.307480 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b573b71-e314-443b-a9ba-84b513a0eaf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:25.307754 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b573b71-e314-443b-a9ba-84b513a0eaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:25.308244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b573b71-e314-443b-a9ba-84b513a0eaf7 admin admin] PATH_INFO: `/v3/projects/f94c1d288ec148138781cf25246546fb/users/567fadf3a2464e758f4a35eb0174f93e/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:25.327864 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b573b71-e314-443b-a9ba-84b513a0eaf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f94c1d288ec148138781cf25246546fb, user_id=567fadf3a2464e758f4a35eb0174f93e, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:25.330499 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b573b71-e314-443b-a9ba-84b513a0eaf7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:25.343687 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1116/2222] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:17:25 2022] PUT /identity/v3/projects/f94c1d288ec148138781cf25246546fb/users/567fadf3a2464e758f4a35eb0174f93e/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:17:25.354512 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a406c8-4296-46f9-8e5d-4c5cb84e5a6b None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:25.354838 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a406c8-4296-46f9-8e5d-4c5cb84e5a6b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:25.355216 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a406c8-4296-46f9-8e5d-4c5cb84e5a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:25.386140 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-85a406c8-4296-46f9-8e5d-4c5cb84e5a6b None None] MFA Rules not processed for user `567fadf3a2464e758f4a35eb0174f93e`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:17:25.387413 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-85a406c8-4296-46f9-8e5d-4c5cb84e5a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:17:25.453902 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1107/2223] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:17:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:17:25.464361 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b573b71-e314-443b-a9ba-84b513a0eaf7 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:25.466007 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-8b573b71-e314-443b-a9ba-84b513a0eaf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:17:25.527294 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b573b71-e314-443b-a9ba-84b513a0eaf7 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:25.530918 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32aa588-229a-429e-ae55-b663e37f5cb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:25.531590 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32aa588-229a-429e-ae55-b663e37f5cb7 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:25.531905 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32aa588-229a-429e-ae55-b663e37f5cb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:25.532237 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32aa588-229a-429e-ae55-b663e37f5cb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:25.541340 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32aa588-229a-429e-ae55-b663e37f5cb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:25.542790 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32aa588-229a-429e-ae55-b663e37f5cb7 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:25.551916 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1117/2224] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:17:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:17:39.883792 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2ab06-a9c9-4805-a98c-380bd8fb5915 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:39.884261 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2ab06-a9c9-4805-a98c-380bd8fb5915 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:39.884399 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2ab06-a9c9-4805-a98c-380bd8fb5915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:39.902683 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-7ca2ab06-a9c9-4805-a98c-380bd8fb5915 None None] MFA Rules not processed for user `9dca4ea4f2c8490e823a73dca6c303ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:17:39.903917 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-7ca2ab06-a9c9-4805-a98c-380bd8fb5915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:17:39.957175 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1108/2225] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Feb 10 23:17:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:17:39.999375 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32aa588-229a-429e-ae55-b663e37f5cb7 service cinder] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:40.000908 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a32aa588-229a-429e-ae55-b663e37f5cb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:17:40.084989 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32aa588-229a-429e-ae55-b663e37f5cb7 service cinder] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:40.096026 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e40fb-e9e3-4360-bf3e-4d14ffd652ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce55b64dc528447993e32b00ae4d3a2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:40.096683 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e40fb-e9e3-4360-bf3e-4d14ffd652ba service swift] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:40.096962 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e40fb-e9e3-4360-bf3e-4d14ffd652ba service swift] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:40.097232 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e40fb-e9e3-4360-bf3e-4d14ffd652ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:40.106263 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e40fb-e9e3-4360-bf3e-4d14ffd652ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:40.107870 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e40fb-e9e3-4360-bf3e-4d14ffd652ba service swift] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:40.116606 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1118/2226] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Feb 10 23:17:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 23:17:41.940342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2ab06-a9c9-4805-a98c-380bd8fb5915 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:42.021343 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2ab06-a9c9-4805-a98c-380bd8fb5915 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:42.027737 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda57907-b710-4327-8089-6e0f31a96812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:42.028835 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda57907-b710-4327-8089-6e0f31a96812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:42.029246 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda57907-b710-4327-8089-6e0f31a96812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:42.029490 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda57907-b710-4327-8089-6e0f31a96812 admin admin] PATH_INFO: `/v3/users/567fadf3a2464e758f4a35eb0174f93e` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:42.031400 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda57907-b710-4327-8089-6e0f31a96812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=567fadf3a2464e758f4a35eb0174f93e)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:42.033333 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda57907-b710-4327-8089-6e0f31a96812 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:42.113329 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cda57907-b710-4327-8089-6e0f31a96812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '567fadf3a2464e758f4a35eb0174f93e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:42.143678 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cda57907-b710-4327-8089-6e0f31a96812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '567fadf3a2464e758f4a35eb0174f93e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:42.144566 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cda57907-b710-4327-8089-6e0f31a96812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '567fadf3a2464e758f4a35eb0174f93e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:42.146731 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cda57907-b710-4327-8089-6e0f31a96812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '567fadf3a2464e758f4a35eb0174f93e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:42.170537 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cda57907-b710-4327-8089-6e0f31a96812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '567fadf3a2464e758f4a35eb0174f93e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:42.186395 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1109/2227] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:17:41 2022] DELETE /identity/v3/users/567fadf3a2464e758f4a35eb0174f93e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:17:42.190880 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d04c29-3c9c-4299-8ec0-d9c60a082098 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:42.191391 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d04c29-3c9c-4299-8ec0-d9c60a082098 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:42.191490 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d04c29-3c9c-4299-8ec0-d9c60a082098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:42.209144 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-34d04c29-3c9c-4299-8ec0-d9c60a082098 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:17:42.210358 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-34d04c29-3c9c-4299-8ec0-d9c60a082098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:17:42.290250 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1119/2228] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:17:42.309336 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda57907-b710-4327-8089-6e0f31a96812 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:42.310930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-cda57907-b710-4327-8089-6e0f31a96812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:17:42.377373 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda57907-b710-4327-8089-6e0f31a96812 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:42.381427 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81411f6-0a5a-43f9-80a0-e9a295d83cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:42.382348 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81411f6-0a5a-43f9-80a0-e9a295d83cef service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:42.382996 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81411f6-0a5a-43f9-80a0-e9a295d83cef service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:42.383345 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81411f6-0a5a-43f9-80a0-e9a295d83cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:42.393570 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81411f6-0a5a-43f9-80a0-e9a295d83cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:42.395008 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81411f6-0a5a-43f9-80a0-e9a295d83cef service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:42.405942 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1110/2229] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:17:42.793542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d04c29-3c9c-4299-8ec0-d9c60a082098 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:42.795301 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-34d04c29-3c9c-4299-8ec0-d9c60a082098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:17:42.808386 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d04c29-3c9c-4299-8ec0-d9c60a082098 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:42.813875 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcb2c5-a464-4932-8fcb-5c3212a54c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:42.820353 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcb2c5-a464-4932-8fcb-5c3212a54c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:42.820353 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcb2c5-a464-4932-8fcb-5c3212a54c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:42.820353 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcb2c5-a464-4932-8fcb-5c3212a54c98 admin admin] PATH_INFO: `/v3/projects/f94c1d288ec148138781cf25246546fb` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:42.820353 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcb2c5-a464-4932-8fcb-5c3212a54c98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f94c1d288ec148138781cf25246546fb)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:42.820353 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcb2c5-a464-4932-8fcb-5c3212a54c98 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:42.897718 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e8dcb2c5-a464-4932-8fcb-5c3212a54c98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f94c1d288ec148138781cf25246546fb', 'request_id': 'req-e8dcb2c5-a464-4932-8fcb-5c3212a54c98'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:42.906922 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e8dcb2c5-a464-4932-8fcb-5c3212a54c98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f94c1d288ec148138781cf25246546fb', 'request_id': 'req-e8dcb2c5-a464-4932-8fcb-5c3212a54c98'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:42.913389 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e8dcb2c5-a464-4932-8fcb-5c3212a54c98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f94c1d288ec148138781cf25246546fb', 'request_id': 'req-e8dcb2c5-a464-4932-8fcb-5c3212a54c98'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:42.929908 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e8dcb2c5-a464-4932-8fcb-5c3212a54c98 admin admin] The token cache is being invalidate because project f94c1d288ec148138781cf25246546fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:17:42.930315 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e8dcb2c5-a464-4932-8fcb-5c3212a54c98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:42.931026 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e8dcb2c5-a464-4932-8fcb-5c3212a54c98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:42.933049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1120/2230] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:17:42 2022] DELETE /identity/v3/projects/f94c1d288ec148138781cf25246546fb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:17:54.965264 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff8bb2-b81c-47d5-a89a-20db588f2604 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:54.966107 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff8bb2-b81c-47d5-a89a-20db588f2604 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:54.966107 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff8bb2-b81c-47d5-a89a-20db588f2604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:54.986227 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-07ff8bb2-b81c-47d5-a89a-20db588f2604 None None] MFA Rules not processed for user `bf4571d4a93246429874fb6bced95c85`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:17:54.986538 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-07ff8bb2-b81c-47d5-a89a-20db588f2604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:17:55.049546 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1111/2231] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:17:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:17:56.930770 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012cc3e-9316-444b-a878-b13a4cc703c8 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:56.931610 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012cc3e-9316-444b-a878-b13a4cc703c8 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:56.932079 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012cc3e-9316-444b-a878-b13a4cc703c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:56.951408 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-1012cc3e-9316-444b-a878-b13a4cc703c8 None None] MFA Rules not processed for user `9dca4ea4f2c8490e823a73dca6c303ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:17:56.952897 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-1012cc3e-9316-444b-a878-b13a4cc703c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:17:57.014515 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1121/2232] 10.222.0.77 () {58 vars in 967 bytes} [Thu Feb 10 23:17:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:17:57.028739 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff8bb2-b81c-47d5-a89a-20db588f2604 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:57.031309 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-07ff8bb2-b81c-47d5-a89a-20db588f2604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:17:57.112483 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff8bb2-b81c-47d5-a89a-20db588f2604 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:57.118008 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8553f18-aff7-45f6-a1fa-b1d65417f15d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce55b64dc528447993e32b00ae4d3a2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:57.118890 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8553f18-aff7-45f6-a1fa-b1d65417f15d service swift] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:57.119168 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8553f18-aff7-45f6-a1fa-b1d65417f15d service swift] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:57.119441 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8553f18-aff7-45f6-a1fa-b1d65417f15d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:57.128090 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8553f18-aff7-45f6-a1fa-b1d65417f15d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:57.129660 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8553f18-aff7-45f6-a1fa-b1d65417f15d service swift] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:57.138475 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1112/2233] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Feb 10 23:17:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:17:59.124626 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012cc3e-9316-444b-a878-b13a4cc703c8 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:59.126085 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-1012cc3e-9316-444b-a878-b13a4cc703c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:17:59.205466 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012cc3e-9316-444b-a878-b13a4cc703c8 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:59.210986 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71f18e-5c78-44c1-9ae9-d550148c5f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:59.211945 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71f18e-5c78-44c1-9ae9-d550148c5f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:59.212229 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71f18e-5c78-44c1-9ae9-d550148c5f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:59.212497 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71f18e-5c78-44c1-9ae9-d550148c5f35 admin admin] PATH_INFO: `/v3/users/3da4e93429a84af6ba36fc0fbc544a16` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:59.214004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71f18e-5c78-44c1-9ae9-d550148c5f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3da4e93429a84af6ba36fc0fbc544a16)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:59.216125 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71f18e-5c78-44c1-9ae9-d550148c5f35 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:59.274595 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ef71f18e-5c78-44c1-9ae9-d550148c5f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3da4e93429a84af6ba36fc0fbc544a16'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:59.289392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ef71f18e-5c78-44c1-9ae9-d550148c5f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3da4e93429a84af6ba36fc0fbc544a16'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:59.298836 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ef71f18e-5c78-44c1-9ae9-d550148c5f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3da4e93429a84af6ba36fc0fbc544a16'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:59.299490 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ef71f18e-5c78-44c1-9ae9-d550148c5f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3da4e93429a84af6ba36fc0fbc544a16'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:59.300229 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ef71f18e-5c78-44c1-9ae9-d550148c5f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3da4e93429a84af6ba36fc0fbc544a16'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:59.313344 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1122/2234] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:17:59 2022] DELETE /identity/v3/users/3da4e93429a84af6ba36fc0fbc544a16 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:17:59.484762 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8553f18-aff7-45f6-a1fa-b1d65417f15d service swift] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:59.496925 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8553f18-aff7-45f6-a1fa-b1d65417f15d service swift] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:59.556497 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b149cf-4540-413a-b119-53591fa7f47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:59.557349 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b149cf-4540-413a-b119-53591fa7f47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:59.557633 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b149cf-4540-413a-b119-53591fa7f47e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:59.557913 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b149cf-4540-413a-b119-53591fa7f47e admin admin] PATH_INFO: `/v3/projects/9ab827d79cef43f39e5dcc8f7d9bfe28` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:59.559085 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b149cf-4540-413a-b119-53591fa7f47e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ab827d79cef43f39e5dcc8f7d9bfe28)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:59.561169 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b149cf-4540-413a-b119-53591fa7f47e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:59.605818 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-92b149cf-4540-413a-b119-53591fa7f47e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ab827d79cef43f39e5dcc8f7d9bfe28', 'request_id': 'req-92b149cf-4540-413a-b119-53591fa7f47e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:59.613098 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-92b149cf-4540-413a-b119-53591fa7f47e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ab827d79cef43f39e5dcc8f7d9bfe28', 'request_id': 'req-92b149cf-4540-413a-b119-53591fa7f47e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:59.619968 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-92b149cf-4540-413a-b119-53591fa7f47e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ab827d79cef43f39e5dcc8f7d9bfe28', 'request_id': 'req-92b149cf-4540-413a-b119-53591fa7f47e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:59.630856 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-92b149cf-4540-413a-b119-53591fa7f47e admin admin] The token cache is being invalidate because project 9ab827d79cef43f39e5dcc8f7d9bfe28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:17:59.631143 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-92b149cf-4540-413a-b119-53591fa7f47e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:59.631845 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-92b149cf-4540-413a-b119-53591fa7f47e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:17:59.633541 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1113/2235] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:17:59 2022] DELETE /identity/v3/projects/9ab827d79cef43f39e5dcc8f7d9bfe28 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:17:59.638437 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4519a-8a1a-4284-96b0-f0da8b9439b5 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:59.638728 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4519a-8a1a-4284-96b0-f0da8b9439b5 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:59.639012 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4519a-8a1a-4284-96b0-f0da8b9439b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:59.656839 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-2da4519a-8a1a-4284-96b0-f0da8b9439b5 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:17:59.658007 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2da4519a-8a1a-4284-96b0-f0da8b9439b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:17:59.717067 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1123/2236] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:17:59.724464 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231fd87-1c1a-4ada-b4d4-ce6c94564d22 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:59.724751 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231fd87-1c1a-4ada-b4d4-ce6c94564d22 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:59.725062 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231fd87-1c1a-4ada-b4d4-ce6c94564d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:59.744193 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-f231fd87-1c1a-4ada-b4d4-ce6c94564d22 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:17:59.745294 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-f231fd87-1c1a-4ada-b4d4-ce6c94564d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:17:59.753020 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1114/2237] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:17:59.757205 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4519a-8a1a-4284-96b0-f0da8b9439b5 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:59.766607 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4519a-8a1a-4284-96b0-f0da8b9439b5 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:59.771141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f9c2b-3782-43e5-aeae-d48787a92a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:59.771776 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f9c2b-3782-43e5-aeae-d48787a92a79 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:59.772086 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f9c2b-3782-43e5-aeae-d48787a92a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:59.772388 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f9c2b-3782-43e5-aeae-d48787a92a79 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:59.773118 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f9c2b-3782-43e5-aeae-d48787a92a79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:17:59.773416 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f9c2b-3782-43e5-aeae-d48787a92a79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:59.774977 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f9c2b-3782-43e5-aeae-d48787a92a79 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:59.785935 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1124/2238] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:17:59.790753 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231fd87-1c1a-4ada-b4d4-ce6c94564d22 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:59.799725 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231fd87-1c1a-4ada-b4d4-ce6c94564d22 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:59.805122 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22978fe4-16ef-4c70-a04f-8b46cc32b839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:59.805754 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22978fe4-16ef-4c70-a04f-8b46cc32b839 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:59.806034 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22978fe4-16ef-4c70-a04f-8b46cc32b839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:59.806306 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22978fe4-16ef-4c70-a04f-8b46cc32b839 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:59.807000 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22978fe4-16ef-4c70-a04f-8b46cc32b839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:59.808915 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22978fe4-16ef-4c70-a04f-8b46cc32b839 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:59.832625 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1115/2239] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:17:59 2022] POST /identity/v3/projects => generated 385 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:17:59.837446 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f9c2b-3782-43e5-aeae-d48787a92a79 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:59.846981 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f9c2b-3782-43e5-aeae-d48787a92a79 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:59.900319 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715cff6-8641-499d-96da-d7198801774f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:59.900968 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715cff6-8641-499d-96da-d7198801774f admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:59.901249 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715cff6-8641-499d-96da-d7198801774f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:59.901524 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715cff6-8641-499d-96da-d7198801774f admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:59.902214 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715cff6-8641-499d-96da-d7198801774f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:59.904109 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715cff6-8641-499d-96da-d7198801774f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:59.922477 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1125/2240] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:17:59 2022] POST /identity/v3/users => generated 293 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:17:59.926555 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22978fe4-16ef-4c70-a04f-8b46cc32b839 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:59.937095 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22978fe4-16ef-4c70-a04f-8b46cc32b839 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:59.941662 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b400571-9119-458f-b57a-cdf77f232f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:59.942309 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b400571-9119-458f-b57a-cdf77f232f5a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:59.942589 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b400571-9119-458f-b57a-cdf77f232f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:59.942868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b400571-9119-458f-b57a-cdf77f232f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:59.943591 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b400571-9119-458f-b57a-cdf77f232f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:59.945245 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b400571-9119-458f-b57a-cdf77f232f5a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:59.955335 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1116/2241] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:17:59.959026 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715cff6-8641-499d-96da-d7198801774f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:17:59.969192 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715cff6-8641-499d-96da-d7198801774f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:17:59.973771 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7eea9-afcc-48d6-9c4d-f9ae5a5242a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:17:59.974408 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7eea9-afcc-48d6-9c4d-f9ae5a5242a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:17:59.974690 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7eea9-afcc-48d6-9c4d-f9ae5a5242a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:17:59.974962 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7eea9-afcc-48d6-9c4d-f9ae5a5242a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:17:59.976368 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af7eea9-afcc-48d6-9c4d-f9ae5a5242a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:17:59.977941 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af7eea9-afcc-48d6-9c4d-f9ae5a5242a6 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:17:59.987403 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1126/2242] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:17:59.991207 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b400571-9119-458f-b57a-cdf77f232f5a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:00.001011 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b400571-9119-458f-b57a-cdf77f232f5a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:00.005458 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534f48c-22a6-4c0a-9221-fcf43f50ea9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:00.006317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534f48c-22a6-4c0a-9221-fcf43f50ea9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:00.006601 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534f48c-22a6-4c0a-9221-fcf43f50ea9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:00.006988 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534f48c-22a6-4c0a-9221-fcf43f50ea9e admin admin] PATH_INFO: `/v3/projects/5181d78cbbe84470b05000a5038ab3c7/users/7b13612d8ab84f6faad1d8e4032caf7e/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:00.023388 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534f48c-22a6-4c0a-9221-fcf43f50ea9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5181d78cbbe84470b05000a5038ab3c7, user_id=7b13612d8ab84f6faad1d8e4032caf7e, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:00.026239 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534f48c-22a6-4c0a-9221-fcf43f50ea9e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:00.039209 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1117/2243] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:17:59 2022] PUT /identity/v3/projects/5181d78cbbe84470b05000a5038ab3c7/users/7b13612d8ab84f6faad1d8e4032caf7e/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:18:00.049684 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dd042-7ead-48a5-89e1-46a487ed712d None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:00.049977 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dd042-7ead-48a5-89e1-46a487ed712d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:00.050255 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dd042-7ead-48a5-89e1-46a487ed712d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:00.076276 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-e29dd042-7ead-48a5-89e1-46a487ed712d None None] MFA Rules not processed for user `7b13612d8ab84f6faad1d8e4032caf7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:18:00.077540 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e29dd042-7ead-48a5-89e1-46a487ed712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:00.141973 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1127/2244] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:18:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:18:00.152317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534f48c-22a6-4c0a-9221-fcf43f50ea9e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:00.154059 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-5534f48c-22a6-4c0a-9221-fcf43f50ea9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:00.208337 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534f48c-22a6-4c0a-9221-fcf43f50ea9e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:00.212532 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b4b1c-2618-4371-ae81-07e9b794c50b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:00.213167 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b4b1c-2618-4371-ae81-07e9b794c50b service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:00.213449 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b4b1c-2618-4371-ae81-07e9b794c50b service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:00.213747 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b4b1c-2618-4371-ae81-07e9b794c50b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:00.221617 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b4b1c-2618-4371-ae81-07e9b794c50b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:00.223011 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b4b1c-2618-4371-ae81-07e9b794c50b service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:00.231512 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1118/2245] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:18:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:18:02.751239 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29dd042-7ead-48a5-89e1-46a487ed712d None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:02.812895 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29dd042-7ead-48a5-89e1-46a487ed712d None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:02.817380 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb380e0-141a-4c1d-b374-04341f75558f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:02.818246 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb380e0-141a-4c1d-b374-04341f75558f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:02.818527 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb380e0-141a-4c1d-b374-04341f75558f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:02.818800 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb380e0-141a-4c1d-b374-04341f75558f admin admin] PATH_INFO: `/v3/users/7b13612d8ab84f6faad1d8e4032caf7e` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:02.820778 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb380e0-141a-4c1d-b374-04341f75558f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b13612d8ab84f6faad1d8e4032caf7e)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:02.822728 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb380e0-141a-4c1d-b374-04341f75558f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:02.883900 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ccb380e0-141a-4c1d-b374-04341f75558f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b13612d8ab84f6faad1d8e4032caf7e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:02.895835 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ccb380e0-141a-4c1d-b374-04341f75558f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b13612d8ab84f6faad1d8e4032caf7e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:02.896608 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ccb380e0-141a-4c1d-b374-04341f75558f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b13612d8ab84f6faad1d8e4032caf7e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:02.904189 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ccb380e0-141a-4c1d-b374-04341f75558f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b13612d8ab84f6faad1d8e4032caf7e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:02.904885 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ccb380e0-141a-4c1d-b374-04341f75558f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b13612d8ab84f6faad1d8e4032caf7e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:02.917878 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1128/2246] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:18:02 2022] DELETE /identity/v3/users/7b13612d8ab84f6faad1d8e4032caf7e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:18:02.922284 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413ced-b299-4b19-ab5c-2769c0a3e372 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:02.922745 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413ced-b299-4b19-ab5c-2769c0a3e372 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:02.922992 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413ced-b299-4b19-ab5c-2769c0a3e372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:02.940663 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-2f413ced-b299-4b19-ab5c-2769c0a3e372 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:18:02.941838 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-2f413ced-b299-4b19-ab5c-2769c0a3e372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:02.999349 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1119/2247] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:18:03.009012 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb380e0-141a-4c1d-b374-04341f75558f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:03.010369 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-ccb380e0-141a-4c1d-b374-04341f75558f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:03.065423 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb380e0-141a-4c1d-b374-04341f75558f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:03.069250 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907c7fa-1607-4d50-a250-a16c82cb06bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:03.069881 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907c7fa-1607-4d50-a250-a16c82cb06bf service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:03.070157 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907c7fa-1607-4d50-a250-a16c82cb06bf service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:03.070426 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907c7fa-1607-4d50-a250-a16c82cb06bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:03.079418 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907c7fa-1607-4d50-a250-a16c82cb06bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:03.080867 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907c7fa-1607-4d50-a250-a16c82cb06bf service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:03.091986 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1129/2248] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:18:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:18:03.429595 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f413ced-b299-4b19-ab5c-2769c0a3e372 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:03.431009 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-2f413ced-b299-4b19-ab5c-2769c0a3e372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:03.443727 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f413ced-b299-4b19-ab5c-2769c0a3e372 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:03.451003 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf36761-61b9-48e5-95eb-7745b6db940f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:03.451902 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf36761-61b9-48e5-95eb-7745b6db940f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:03.452193 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf36761-61b9-48e5-95eb-7745b6db940f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:03.452467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf36761-61b9-48e5-95eb-7745b6db940f admin admin] PATH_INFO: `/v3/projects/5181d78cbbe84470b05000a5038ab3c7` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:03.453682 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf36761-61b9-48e5-95eb-7745b6db940f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5181d78cbbe84470b05000a5038ab3c7)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:03.455803 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf36761-61b9-48e5-95eb-7745b6db940f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:03.501671 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-9cf36761-61b9-48e5-95eb-7745b6db940f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5181d78cbbe84470b05000a5038ab3c7', 'request_id': 'req-9cf36761-61b9-48e5-95eb-7745b6db940f'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:03.509226 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-9cf36761-61b9-48e5-95eb-7745b6db940f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5181d78cbbe84470b05000a5038ab3c7', 'request_id': 'req-9cf36761-61b9-48e5-95eb-7745b6db940f'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:03.514567 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-9cf36761-61b9-48e5-95eb-7745b6db940f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5181d78cbbe84470b05000a5038ab3c7', 'request_id': 'req-9cf36761-61b9-48e5-95eb-7745b6db940f'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:03.525732 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-9cf36761-61b9-48e5-95eb-7745b6db940f admin admin] The token cache is being invalidate because project 5181d78cbbe84470b05000a5038ab3c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:18:03.526018 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-9cf36761-61b9-48e5-95eb-7745b6db940f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:03.526635 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-9cf36761-61b9-48e5-95eb-7745b6db940f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:03.528179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1120/2249] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:18:03 2022] DELETE /identity/v3/projects/5181d78cbbe84470b05000a5038ab3c7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:18:03.533121 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84c174-9cde-4f09-8a0f-79535390c4cf None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:03.533410 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84c174-9cde-4f09-8a0f-79535390c4cf None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:03.533687 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84c174-9cde-4f09-8a0f-79535390c4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:03.551760 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-aa84c174-9cde-4f09-8a0f-79535390c4cf None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:18:03.552968 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-aa84c174-9cde-4f09-8a0f-79535390c4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:03.611127 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1130/2250] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:18:03.619854 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144f1ea-19cc-461c-852a-b7100956d70a None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:03.620161 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144f1ea-19cc-461c-852a-b7100956d70a None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:03.620476 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144f1ea-19cc-461c-852a-b7100956d70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:03.639128 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-1144f1ea-19cc-461c-852a-b7100956d70a None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:18:03.640365 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-1144f1ea-19cc-461c-852a-b7100956d70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:03.648484 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1121/2251] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:18:03.652639 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84c174-9cde-4f09-8a0f-79535390c4cf None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:03.661865 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84c174-9cde-4f09-8a0f-79535390c4cf None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:03.666764 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9b675-251f-419d-8157-abb2c72826c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:03.667415 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b675-251f-419d-8157-abb2c72826c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:03.667697 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b675-251f-419d-8157-abb2c72826c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:03.668015 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b675-251f-419d-8157-abb2c72826c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:03.668782 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9b675-251f-419d-8157-abb2c72826c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:18:03.669084 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9b675-251f-419d-8157-abb2c72826c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:03.670658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9b675-251f-419d-8157-abb2c72826c0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:03.682448 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1131/2252] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:18:03.686390 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144f1ea-19cc-461c-852a-b7100956d70a None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:03.696184 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144f1ea-19cc-461c-852a-b7100956d70a None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:03.700844 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719de9b3-80da-455a-8d3f-b361ab0372da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:03.701481 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719de9b3-80da-455a-8d3f-b361ab0372da admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:03.701759 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719de9b3-80da-455a-8d3f-b361ab0372da admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:03.702028 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719de9b3-80da-455a-8d3f-b361ab0372da admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:03.702720 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719de9b3-80da-455a-8d3f-b361ab0372da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:03.704607 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719de9b3-80da-455a-8d3f-b361ab0372da admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:03.729060 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1122/2253] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:18:03 2022] POST /identity/v3/projects => generated 363 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:18:03.733088 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9b675-251f-419d-8157-abb2c72826c0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:03.743473 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9b675-251f-419d-8157-abb2c72826c0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:03.796870 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903de70c-e771-47d6-b30f-83b1f3e1447d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:03.797536 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903de70c-e771-47d6-b30f-83b1f3e1447d admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:03.797822 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903de70c-e771-47d6-b30f-83b1f3e1447d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:03.798099 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903de70c-e771-47d6-b30f-83b1f3e1447d admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:03.799037 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903de70c-e771-47d6-b30f-83b1f3e1447d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:03.801002 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903de70c-e771-47d6-b30f-83b1f3e1447d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:03.824898 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1132/2254] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:18:03 2022] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:18:03.829010 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719de9b3-80da-455a-8d3f-b361ab0372da admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:03.839874 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719de9b3-80da-455a-8d3f-b361ab0372da admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:03.844485 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56fca8-90f8-4f00-a2a7-12d67fb97176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:03.845153 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56fca8-90f8-4f00-a2a7-12d67fb97176 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:03.845438 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56fca8-90f8-4f00-a2a7-12d67fb97176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:03.845719 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56fca8-90f8-4f00-a2a7-12d67fb97176 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:03.846459 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56fca8-90f8-4f00-a2a7-12d67fb97176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:03.848071 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56fca8-90f8-4f00-a2a7-12d67fb97176 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:03.858737 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1123/2255] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:18:03.862778 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903de70c-e771-47d6-b30f-83b1f3e1447d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:03.873260 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903de70c-e771-47d6-b30f-83b1f3e1447d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:03.877950 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac0f19-4895-4181-8e44-bc96da5872c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:03.878604 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac0f19-4895-4181-8e44-bc96da5872c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:03.878898 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac0f19-4895-4181-8e44-bc96da5872c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:03.879182 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac0f19-4895-4181-8e44-bc96da5872c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:03.879971 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac0f19-4895-4181-8e44-bc96da5872c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:03.881559 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac0f19-4895-4181-8e44-bc96da5872c2 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:03.892089 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1133/2256] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:18:03.896052 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56fca8-90f8-4f00-a2a7-12d67fb97176 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:03.907146 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56fca8-90f8-4f00-a2a7-12d67fb97176 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:03.912157 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf3b7a-f09b-4f4e-8bd7-eac052d53f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:03.914320 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf3b7a-f09b-4f4e-8bd7-eac052d53f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:03.914320 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf3b7a-f09b-4f4e-8bd7-eac052d53f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:03.914320 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf3b7a-f09b-4f4e-8bd7-eac052d53f52 admin admin] PATH_INFO: `/v3/projects/c72431de1bac496ba088201151e402aa/users/faefcf27ac824799b6b8e0059b3b3062/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:03.929301 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf3b7a-f09b-4f4e-8bd7-eac052d53f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c72431de1bac496ba088201151e402aa, user_id=faefcf27ac824799b6b8e0059b3b3062, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:03.931974 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf3b7a-f09b-4f4e-8bd7-eac052d53f52 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:03.948042 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1124/2257] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:18:03 2022] PUT /identity/v3/projects/c72431de1bac496ba088201151e402aa/users/faefcf27ac824799b6b8e0059b3b3062/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:18:03.958341 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b0529-65de-4dfa-8c61-a655fe4d083b None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:03.958633 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b0529-65de-4dfa-8c61-a655fe4d083b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:03.958912 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b0529-65de-4dfa-8c61-a655fe4d083b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:03.987038 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-ee5b0529-65de-4dfa-8c61-a655fe4d083b None None] MFA Rules not processed for user `faefcf27ac824799b6b8e0059b3b3062`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:18:03.988546 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-ee5b0529-65de-4dfa-8c61-a655fe4d083b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:04.061595 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1134/2258] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:18:03 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:18:04.072332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf3b7a-f09b-4f4e-8bd7-eac052d53f52 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:04.074393 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-0cbf3b7a-f09b-4f4e-8bd7-eac052d53f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:04.141016 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf3b7a-f09b-4f4e-8bd7-eac052d53f52 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:04.144882 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e427139-2770-4552-8c8b-999dafba28c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:04.145516 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e427139-2770-4552-8c8b-999dafba28c8 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:04.145799 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e427139-2770-4552-8c8b-999dafba28c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:04.146074 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e427139-2770-4552-8c8b-999dafba28c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:04.155395 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e427139-2770-4552-8c8b-999dafba28c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:04.156853 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e427139-2770-4552-8c8b-999dafba28c8 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:04.168981 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1125/2259] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:18:04 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:18:44.036023 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe930afe-8477-4cda-8260-e2db2440b54f None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:44.036503 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe930afe-8477-4cda-8260-e2db2440b54f None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:44.036597 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe930afe-8477-4cda-8260-e2db2440b54f None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:44.038380 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1135/2260] 10.222.0.77 () {54 vars in 960 bytes} [Thu Feb 10 23:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:18:44.044179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b971d-8349-4400-9f25-c7ad499433b2 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:44.044656 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b971d-8349-4400-9f25-c7ad499433b2 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:44.044656 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b971d-8349-4400-9f25-c7ad499433b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:44.121691 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-505b971d-8349-4400-9f25-c7ad499433b2 None None] MFA Rules not processed for user `0f5243eef2a24a518b30526425c0b2c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:18:44.122907 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-505b971d-8349-4400-9f25-c7ad499433b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:44.236634 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1126/2261] 10.222.0.77 () {58 vars in 1057 bytes} [Thu Feb 10 23:18:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:18:44.244553 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe930afe-8477-4cda-8260-e2db2440b54f None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:44.257488 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe930afe-8477-4cda-8260-e2db2440b54f None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:44.262472 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f8c12-d04a-45ee-8e54-9ea7af3b9514 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f5243eef2a24a518b30526425c0b2c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:44.263091 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f8c12-d04a-45ee-8e54-9ea7af3b9514 service placement] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:44.263372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f8c12-d04a-45ee-8e54-9ea7af3b9514 service placement] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:44.263643 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f8c12-d04a-45ee-8e54-9ea7af3b9514 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:44.265375 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-647f8c12-d04a-45ee-8e54-9ea7af3b9514 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:44.276432 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f8c12-d04a-45ee-8e54-9ea7af3b9514 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:44.278572 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f8c12-d04a-45ee-8e54-9ea7af3b9514 service placement] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:44.288357 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1136/2262] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:18:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:18:52.025094 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b971d-8349-4400-9f25-c7ad499433b2 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:52.026802 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-505b971d-8349-4400-9f25-c7ad499433b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:52.127909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b971d-8349-4400-9f25-c7ad499433b2 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:52.132872 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34434ebe-55b6-466c-b31b-2e3f44f8105f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:52.133767 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34434ebe-55b6-466c-b31b-2e3f44f8105f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:52.135460 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34434ebe-55b6-466c-b31b-2e3f44f8105f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:52.135757 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34434ebe-55b6-466c-b31b-2e3f44f8105f admin admin] PATH_INFO: `/v3/users/bf4571d4a93246429874fb6bced95c85` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:52.137060 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34434ebe-55b6-466c-b31b-2e3f44f8105f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf4571d4a93246429874fb6bced95c85)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:52.139529 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34434ebe-55b6-466c-b31b-2e3f44f8105f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:52.190936 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-34434ebe-55b6-466c-b31b-2e3f44f8105f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf4571d4a93246429874fb6bced95c85'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:52.204467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-34434ebe-55b6-466c-b31b-2e3f44f8105f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf4571d4a93246429874fb6bced95c85'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:52.205241 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-34434ebe-55b6-466c-b31b-2e3f44f8105f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf4571d4a93246429874fb6bced95c85'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:52.205828 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-34434ebe-55b6-466c-b31b-2e3f44f8105f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf4571d4a93246429874fb6bced95c85'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:52.213652 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-34434ebe-55b6-466c-b31b-2e3f44f8105f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf4571d4a93246429874fb6bced95c85'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:52.229423 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1127/2263] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:18:52 2022] DELETE /identity/v3/users/bf4571d4a93246429874fb6bced95c85 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:18:52.413135 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f8c12-d04a-45ee-8e54-9ea7af3b9514 service placement] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:52.424497 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f8c12-d04a-45ee-8e54-9ea7af3b9514 service placement] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:52.487101 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa873ce5-fa4b-4db7-903b-244aedaccd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:52.487988 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa873ce5-fa4b-4db7-903b-244aedaccd79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:52.488270 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa873ce5-fa4b-4db7-903b-244aedaccd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:52.488539 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa873ce5-fa4b-4db7-903b-244aedaccd79 admin admin] PATH_INFO: `/v3/projects/9ab12603f3ae4b098df08267be769e7a` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:52.489707 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa873ce5-fa4b-4db7-903b-244aedaccd79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ab12603f3ae4b098df08267be769e7a)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:52.492735 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa873ce5-fa4b-4db7-903b-244aedaccd79 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:52.538230 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-aa873ce5-fa4b-4db7-903b-244aedaccd79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ab12603f3ae4b098df08267be769e7a', 'request_id': 'req-aa873ce5-fa4b-4db7-903b-244aedaccd79'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:52.544173 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-aa873ce5-fa4b-4db7-903b-244aedaccd79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ab12603f3ae4b098df08267be769e7a', 'request_id': 'req-aa873ce5-fa4b-4db7-903b-244aedaccd79'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:52.550482 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-aa873ce5-fa4b-4db7-903b-244aedaccd79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ab12603f3ae4b098df08267be769e7a', 'request_id': 'req-aa873ce5-fa4b-4db7-903b-244aedaccd79'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:52.562508 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-aa873ce5-fa4b-4db7-903b-244aedaccd79 admin admin] The token cache is being invalidate because project 9ab12603f3ae4b098df08267be769e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:18:52.562794 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-aa873ce5-fa4b-4db7-903b-244aedaccd79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:52.563405 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-aa873ce5-fa4b-4db7-903b-244aedaccd79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:52.565076 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1137/2264] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:18:52 2022] DELETE /identity/v3/projects/9ab12603f3ae4b098df08267be769e7a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:18:52.570154 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fc5e6-4487-4913-a401-d3b0cb1c5c9a None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:52.570439 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fc5e6-4487-4913-a401-d3b0cb1c5c9a None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:52.570714 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fc5e6-4487-4913-a401-d3b0cb1c5c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:52.616341 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-eb3fc5e6-4487-4913-a401-d3b0cb1c5c9a None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:18:52.617511 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-eb3fc5e6-4487-4913-a401-d3b0cb1c5c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:52.674918 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1128/2265] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:18:52.682589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caff6db-16fd-4a03-9aba-fe2d00ef708c None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:52.682880 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caff6db-16fd-4a03-9aba-fe2d00ef708c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:52.683157 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caff6db-16fd-4a03-9aba-fe2d00ef708c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:52.706546 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-0caff6db-16fd-4a03-9aba-fe2d00ef708c None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:18:52.707750 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-0caff6db-16fd-4a03-9aba-fe2d00ef708c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:52.716366 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1138/2266] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:18:52.720687 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fc5e6-4487-4913-a401-d3b0cb1c5c9a None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:52.730030 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fc5e6-4487-4913-a401-d3b0cb1c5c9a None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:52.734563 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d21ce2-a206-4e26-b6c8-e1ea6d80570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:52.735198 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d21ce2-a206-4e26-b6c8-e1ea6d80570b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:52.735477 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d21ce2-a206-4e26-b6c8-e1ea6d80570b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:52.735750 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d21ce2-a206-4e26-b6c8-e1ea6d80570b admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:52.736549 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d21ce2-a206-4e26-b6c8-e1ea6d80570b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:18:52.736848 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d21ce2-a206-4e26-b6c8-e1ea6d80570b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:52.738417 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d21ce2-a206-4e26-b6c8-e1ea6d80570b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:52.749838 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1129/2267] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:18:52.754029 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caff6db-16fd-4a03-9aba-fe2d00ef708c None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:52.763609 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caff6db-16fd-4a03-9aba-fe2d00ef708c None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:52.768244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50adcd0-be47-4a7c-badf-9979bcc5c7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:52.768879 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50adcd0-be47-4a7c-badf-9979bcc5c7fd admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:52.769161 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50adcd0-be47-4a7c-badf-9979bcc5c7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:52.769465 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50adcd0-be47-4a7c-badf-9979bcc5c7fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:52.770170 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50adcd0-be47-4a7c-badf-9979bcc5c7fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:52.772070 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50adcd0-be47-4a7c-badf-9979bcc5c7fd admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:52.797522 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1139/2268] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:18:52 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:18:52.801703 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d21ce2-a206-4e26-b6c8-e1ea6d80570b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:52.811961 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d21ce2-a206-4e26-b6c8-e1ea6d80570b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:52.864225 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f69461-f68d-4826-a28a-3ede3ad59178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:52.864874 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f69461-f68d-4826-a28a-3ede3ad59178 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:52.865156 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f69461-f68d-4826-a28a-3ede3ad59178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:52.865427 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f69461-f68d-4826-a28a-3ede3ad59178 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:52.866110 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f69461-f68d-4826-a28a-3ede3ad59178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:52.868038 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f69461-f68d-4826-a28a-3ede3ad59178 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:52.887516 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1130/2269] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:18:52 2022] POST /identity/v3/users => generated 303 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:18:52.891735 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50adcd0-be47-4a7c-badf-9979bcc5c7fd admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:52.901697 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50adcd0-be47-4a7c-badf-9979bcc5c7fd admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:52.906248 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28c47d-ee2e-4640-9c2c-b2e1ab14196a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:52.906891 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28c47d-ee2e-4640-9c2c-b2e1ab14196a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:52.907174 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28c47d-ee2e-4640-9c2c-b2e1ab14196a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:52.907452 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28c47d-ee2e-4640-9c2c-b2e1ab14196a admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:52.908223 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28c47d-ee2e-4640-9c2c-b2e1ab14196a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:52.909870 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28c47d-ee2e-4640-9c2c-b2e1ab14196a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:52.924043 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1140/2270] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:18:52.928121 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f69461-f68d-4826-a28a-3ede3ad59178 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:52.938933 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f69461-f68d-4826-a28a-3ede3ad59178 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:52.943617 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5f86a-6700-4bf4-a3ba-b00a006b1b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:52.944309 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5f86a-6700-4bf4-a3ba-b00a006b1b12 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:52.944760 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5f86a-6700-4bf4-a3ba-b00a006b1b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:52.945044 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5f86a-6700-4bf4-a3ba-b00a006b1b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:52.945779 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5f86a-6700-4bf4-a3ba-b00a006b1b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:52.947355 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5f86a-6700-4bf4-a3ba-b00a006b1b12 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:52.957737 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1131/2271] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:18:52.962050 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28c47d-ee2e-4640-9c2c-b2e1ab14196a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:52.973041 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28c47d-ee2e-4640-9c2c-b2e1ab14196a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:52.977968 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c49c8c-645d-4bd2-a3fd-69088f227b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:52.979091 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c49c8c-645d-4bd2-a3fd-69088f227b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:52.979378 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c49c8c-645d-4bd2-a3fd-69088f227b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:52.979653 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c49c8c-645d-4bd2-a3fd-69088f227b2a admin admin] PATH_INFO: `/v3/projects/80ef65617c414b45972ebb21c2d7ce7a/users/987ddbf1ff79404babe05dfc6f91c67b/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:52.995300 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c49c8c-645d-4bd2-a3fd-69088f227b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ef65617c414b45972ebb21c2d7ce7a, user_id=987ddbf1ff79404babe05dfc6f91c67b, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:52.998264 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c49c8c-645d-4bd2-a3fd-69088f227b2a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:53.011045 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1141/2272] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:18:52 2022] PUT /identity/v3/projects/80ef65617c414b45972ebb21c2d7ce7a/users/987ddbf1ff79404babe05dfc6f91c67b/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:18:53.021811 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e9c6c-d982-4f8e-98bb-d199424fda25 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:53.022117 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e9c6c-d982-4f8e-98bb-d199424fda25 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:53.022397 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e9c6c-d982-4f8e-98bb-d199424fda25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:53.050193 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-3f6e9c6c-d982-4f8e-98bb-d199424fda25 None None] MFA Rules not processed for user `987ddbf1ff79404babe05dfc6f91c67b`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:18:53.051343 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-3f6e9c6c-d982-4f8e-98bb-d199424fda25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:53.116409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1132/2273] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:18:53 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:18:53.121578 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c49c8c-645d-4bd2-a3fd-69088f227b2a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:53.182071 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c49c8c-645d-4bd2-a3fd-69088f227b2a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:53.187437 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94380761-231d-4ec2-87a2-faf3d326313b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:53.188209 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94380761-231d-4ec2-87a2-faf3d326313b admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:53.188566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94380761-231d-4ec2-87a2-faf3d326313b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:53.188914 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94380761-231d-4ec2-87a2-faf3d326313b admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:53.189827 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94380761-231d-4ec2-87a2-faf3d326313b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:53.191808 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94380761-231d-4ec2-87a2-faf3d326313b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:53.217749 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1142/2274] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:18:53 2022] POST /identity/v3/projects => generated 403 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:18:53.221559 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e9c6c-d982-4f8e-98bb-d199424fda25 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:53.232277 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e9c6c-d982-4f8e-98bb-d199424fda25 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:53.289153 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a98120-eab5-40f4-aa95-9ecfb8fef455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:53.289834 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a98120-eab5-40f4-aa95-9ecfb8fef455 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:53.290123 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a98120-eab5-40f4-aa95-9ecfb8fef455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:53.290401 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a98120-eab5-40f4-aa95-9ecfb8fef455 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:53.291126 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a98120-eab5-40f4-aa95-9ecfb8fef455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:53.293787 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a98120-eab5-40f4-aa95-9ecfb8fef455 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:53.318318 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1133/2275] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:18:53 2022] POST /identity/v3/users => generated 308 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:18:53.321875 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94380761-231d-4ec2-87a2-faf3d326313b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:53.332865 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94380761-231d-4ec2-87a2-faf3d326313b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:53.338010 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442f406-70ea-4430-8033-14c374ddeb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:53.338538 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442f406-70ea-4430-8033-14c374ddeb55 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:53.339156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442f406-70ea-4430-8033-14c374ddeb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:53.339156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442f406-70ea-4430-8033-14c374ddeb55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:53.340097 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442f406-70ea-4430-8033-14c374ddeb55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:53.341643 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442f406-70ea-4430-8033-14c374ddeb55 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:53.360421 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1143/2276] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:18:53.375975 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a98120-eab5-40f4-aa95-9ecfb8fef455 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:53.390412 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a98120-eab5-40f4-aa95-9ecfb8fef455 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:53.395495 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3105471-184b-4d22-a1b1-da36e9aeb4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:53.396507 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3105471-184b-4d22-a1b1-da36e9aeb4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:53.396856 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3105471-184b-4d22-a1b1-da36e9aeb4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:53.397165 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3105471-184b-4d22-a1b1-da36e9aeb4f1 admin admin] PATH_INFO: `/v3/projects/2d61d4a3cf2b49e1a29111a77830f54e/users/83b85417f189489eaa307a1ccf7e74b8/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:53.415577 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3105471-184b-4d22-a1b1-da36e9aeb4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d61d4a3cf2b49e1a29111a77830f54e, user_id=83b85417f189489eaa307a1ccf7e74b8, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:53.419008 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3105471-184b-4d22-a1b1-da36e9aeb4f1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:53.438125 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1134/2277] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:18:53 2022] PUT /identity/v3/projects/2d61d4a3cf2b49e1a29111a77830f54e/users/83b85417f189489eaa307a1ccf7e74b8/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:18:53.439142 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442f406-70ea-4430-8033-14c374ddeb55 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:53.454624 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442f406-70ea-4430-8033-14c374ddeb55 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:53.530818 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4c1c9-3697-4958-8132-01f20c33475c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:53.531514 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4c1c9-3697-4958-8132-01f20c33475c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:53.531794 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4c1c9-3697-4958-8132-01f20c33475c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:53.532106 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4c1c9-3697-4958-8132-01f20c33475c admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:53.532855 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4c1c9-3697-4958-8132-01f20c33475c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:53.534456 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4c1c9-3697-4958-8132-01f20c33475c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:53.547753 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1144/2278] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:18:53.551994 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3105471-184b-4d22-a1b1-da36e9aeb4f1 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:53.562580 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3105471-184b-4d22-a1b1-da36e9aeb4f1 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:53.567982 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b7b13-4ba0-4851-9655-17df375b7eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:53.569096 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b7b13-4ba0-4851-9655-17df375b7eea admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:53.569403 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b7b13-4ba0-4851-9655-17df375b7eea admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:53.569795 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b7b13-4ba0-4851-9655-17df375b7eea admin admin] PATH_INFO: `/v3/projects/2d61d4a3cf2b49e1a29111a77830f54e/users/83b85417f189489eaa307a1ccf7e74b8/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:53.572074 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b7b13-4ba0-4851-9655-17df375b7eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d61d4a3cf2b49e1a29111a77830f54e, user_id=83b85417f189489eaa307a1ccf7e74b8, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:53.575920 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b7b13-4ba0-4851-9655-17df375b7eea admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:53.588609 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1135/2279] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:18:53 2022] PUT /identity/v3/projects/2d61d4a3cf2b49e1a29111a77830f54e/users/83b85417f189489eaa307a1ccf7e74b8/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:18:53.599647 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb62d2e-de49-45c8-b2ae-214a7a40bda2 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:53.600065 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb62d2e-de49-45c8-b2ae-214a7a40bda2 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:53.600469 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb62d2e-de49-45c8-b2ae-214a7a40bda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:53.629902 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-acb62d2e-de49-45c8-b2ae-214a7a40bda2 None None] MFA Rules not processed for user `83b85417f189489eaa307a1ccf7e74b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:18:53.631096 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-acb62d2e-de49-45c8-b2ae-214a7a40bda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:53.698081 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1145/2280] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:18:53 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:18:53.707656 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b7b13-4ba0-4851-9655-17df375b7eea admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:53.709364 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-af3b7b13-4ba0-4851-9655-17df375b7eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:53.787502 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b7b13-4ba0-4851-9655-17df375b7eea admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:53.791318 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ff4fa-33c1-439a-876d-fb6ffe6599fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:53.791984 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ff4fa-33c1-439a-876d-fb6ffe6599fc service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:53.792268 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ff4fa-33c1-439a-876d-fb6ffe6599fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:53.792541 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ff4fa-33c1-439a-876d-fb6ffe6599fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:53.802595 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ff4fa-33c1-439a-876d-fb6ffe6599fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:53.804050 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ff4fa-33c1-439a-876d-fb6ffe6599fc service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:53.813378 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1136/2281] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:18:53 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:18:53.966974 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb62d2e-de49-45c8-b2ae-214a7a40bda2 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:54.032956 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb62d2e-de49-45c8-b2ae-214a7a40bda2 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:54.037429 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b95b0-11dd-479d-9522-47c2f9d40987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:54.038288 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b95b0-11dd-479d-9522-47c2f9d40987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:54.038572 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b95b0-11dd-479d-9522-47c2f9d40987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:54.038844 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b95b0-11dd-479d-9522-47c2f9d40987 admin admin] PATH_INFO: `/v3/users/987ddbf1ff79404babe05dfc6f91c67b` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:54.040073 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b95b0-11dd-479d-9522-47c2f9d40987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=987ddbf1ff79404babe05dfc6f91c67b)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:54.041963 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b95b0-11dd-479d-9522-47c2f9d40987 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:54.088459 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-518b95b0-11dd-479d-9522-47c2f9d40987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987ddbf1ff79404babe05dfc6f91c67b'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:54.101377 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-518b95b0-11dd-479d-9522-47c2f9d40987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987ddbf1ff79404babe05dfc6f91c67b'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:54.102092 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-518b95b0-11dd-479d-9522-47c2f9d40987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987ddbf1ff79404babe05dfc6f91c67b'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:54.109986 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-518b95b0-11dd-479d-9522-47c2f9d40987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987ddbf1ff79404babe05dfc6f91c67b'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:54.110680 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-518b95b0-11dd-479d-9522-47c2f9d40987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987ddbf1ff79404babe05dfc6f91c67b'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:54.123180 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1146/2282] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:18:53 2022] DELETE /identity/v3/users/987ddbf1ff79404babe05dfc6f91c67b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:18:54.127671 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb496b8-5bb5-47e7-9da5-c2abe58420b8 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:54.128160 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb496b8-5bb5-47e7-9da5-c2abe58420b8 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:54.128285 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb496b8-5bb5-47e7-9da5-c2abe58420b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:54.146212 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-3bb496b8-5bb5-47e7-9da5-c2abe58420b8 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:18:54.147411 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-3bb496b8-5bb5-47e7-9da5-c2abe58420b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:54.205025 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1137/2283] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:18:54.214518 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b95b0-11dd-479d-9522-47c2f9d40987 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:54.216572 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-518b95b0-11dd-479d-9522-47c2f9d40987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:54.292448 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b95b0-11dd-479d-9522-47c2f9d40987 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:54.296145 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77170c42-f475-4457-88e6-6c6997af718c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:54.296780 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77170c42-f475-4457-88e6-6c6997af718c service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:54.297065 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77170c42-f475-4457-88e6-6c6997af718c service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:54.297341 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77170c42-f475-4457-88e6-6c6997af718c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:54.306208 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77170c42-f475-4457-88e6-6c6997af718c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:54.307616 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77170c42-f475-4457-88e6-6c6997af718c service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:54.317090 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1147/2284] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:18:54.586314 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb496b8-5bb5-47e7-9da5-c2abe58420b8 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:54.587705 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-3bb496b8-5bb5-47e7-9da5-c2abe58420b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:54.600871 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb496b8-5bb5-47e7-9da5-c2abe58420b8 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:54.607994 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfad1c5-311b-446a-be45-ca9b8c3fb276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:54.609165 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfad1c5-311b-446a-be45-ca9b8c3fb276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:54.609701 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfad1c5-311b-446a-be45-ca9b8c3fb276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:54.610126 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfad1c5-311b-446a-be45-ca9b8c3fb276 admin admin] PATH_INFO: `/v3/projects/80ef65617c414b45972ebb21c2d7ce7a` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:54.611510 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfad1c5-311b-446a-be45-ca9b8c3fb276 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80ef65617c414b45972ebb21c2d7ce7a)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:54.613864 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfad1c5-311b-446a-be45-ca9b8c3fb276 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:54.670570 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cbfad1c5-311b-446a-be45-ca9b8c3fb276 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80ef65617c414b45972ebb21c2d7ce7a', 'request_id': 'req-cbfad1c5-311b-446a-be45-ca9b8c3fb276'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:54.681103 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cbfad1c5-311b-446a-be45-ca9b8c3fb276 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80ef65617c414b45972ebb21c2d7ce7a', 'request_id': 'req-cbfad1c5-311b-446a-be45-ca9b8c3fb276'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:54.687401 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cbfad1c5-311b-446a-be45-ca9b8c3fb276 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80ef65617c414b45972ebb21c2d7ce7a', 'request_id': 'req-cbfad1c5-311b-446a-be45-ca9b8c3fb276'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:54.699013 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cbfad1c5-311b-446a-be45-ca9b8c3fb276 admin admin] The token cache is being invalidate because project 80ef65617c414b45972ebb21c2d7ce7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:18:54.699509 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cbfad1c5-311b-446a-be45-ca9b8c3fb276 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:54.700251 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cbfad1c5-311b-446a-be45-ca9b8c3fb276 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:54.702743 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1138/2285] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:18:54 2022] DELETE /identity/v3/projects/80ef65617c414b45972ebb21c2d7ce7a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:18:54.706959 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77170c42-f475-4457-88e6-6c6997af718c service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:54.718123 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77170c42-f475-4457-88e6-6c6997af718c service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:54.775132 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb3477-99fa-4210-83af-4476a7b7b579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:54.776028 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb3477-99fa-4210-83af-4476a7b7b579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:54.776309 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb3477-99fa-4210-83af-4476a7b7b579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:54.776580 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb3477-99fa-4210-83af-4476a7b7b579 admin admin] PATH_INFO: `/v3/users/83b85417f189489eaa307a1ccf7e74b8` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:54.778302 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb3477-99fa-4210-83af-4476a7b7b579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83b85417f189489eaa307a1ccf7e74b8)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:54.780230 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb3477-99fa-4210-83af-4476a7b7b579 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:54.825685 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c4cb3477-99fa-4210-83af-4476a7b7b579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83b85417f189489eaa307a1ccf7e74b8'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:54.836696 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c4cb3477-99fa-4210-83af-4476a7b7b579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83b85417f189489eaa307a1ccf7e74b8'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:54.837364 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c4cb3477-99fa-4210-83af-4476a7b7b579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83b85417f189489eaa307a1ccf7e74b8'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:54.844691 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c4cb3477-99fa-4210-83af-4476a7b7b579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83b85417f189489eaa307a1ccf7e74b8'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:54.845300 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c4cb3477-99fa-4210-83af-4476a7b7b579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83b85417f189489eaa307a1ccf7e74b8'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:54.858630 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1148/2286] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:18:54 2022] DELETE /identity/v3/users/83b85417f189489eaa307a1ccf7e74b8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:18:55.141653 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfad1c5-311b-446a-be45-ca9b8c3fb276 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:55.143104 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-cbfad1c5-311b-446a-be45-ca9b8c3fb276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:55.156849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfad1c5-311b-446a-be45-ca9b8c3fb276 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:55.215347 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16a41f-24d6-436f-ba8a-8c0ba63bc048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:55.216239 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16a41f-24d6-436f-ba8a-8c0ba63bc048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:55.216520 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16a41f-24d6-436f-ba8a-8c0ba63bc048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:55.216789 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16a41f-24d6-436f-ba8a-8c0ba63bc048 admin admin] PATH_INFO: `/v3/projects/2d61d4a3cf2b49e1a29111a77830f54e` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:55.217964 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16a41f-24d6-436f-ba8a-8c0ba63bc048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d61d4a3cf2b49e1a29111a77830f54e)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:55.219846 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16a41f-24d6-436f-ba8a-8c0ba63bc048 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:55.270691 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-2d16a41f-24d6-436f-ba8a-8c0ba63bc048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d61d4a3cf2b49e1a29111a77830f54e', 'request_id': 'req-2d16a41f-24d6-436f-ba8a-8c0ba63bc048'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:55.278602 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-2d16a41f-24d6-436f-ba8a-8c0ba63bc048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d61d4a3cf2b49e1a29111a77830f54e', 'request_id': 'req-2d16a41f-24d6-436f-ba8a-8c0ba63bc048'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:55.284091 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-2d16a41f-24d6-436f-ba8a-8c0ba63bc048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d61d4a3cf2b49e1a29111a77830f54e', 'request_id': 'req-2d16a41f-24d6-436f-ba8a-8c0ba63bc048'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:55.296729 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-2d16a41f-24d6-436f-ba8a-8c0ba63bc048 admin admin] The token cache is being invalidate because project 2d61d4a3cf2b49e1a29111a77830f54e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:18:55.297042 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-2d16a41f-24d6-436f-ba8a-8c0ba63bc048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:55.297689 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-2d16a41f-24d6-436f-ba8a-8c0ba63bc048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:55.299214 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1139/2287] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:18:55 2022] DELETE /identity/v3/projects/2d61d4a3cf2b49e1a29111a77830f54e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:18:55.304321 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdbe15-f403-41ec-b037-1a287decc5de None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:55.304614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdbe15-f403-41ec-b037-1a287decc5de None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:55.304893 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdbe15-f403-41ec-b037-1a287decc5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:55.323662 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-78bdbe15-f403-41ec-b037-1a287decc5de None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:18:55.325749 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-78bdbe15-f403-41ec-b037-1a287decc5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:55.385248 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1149/2288] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:18:55.393473 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dd0c8-b640-47ae-b3d6-cc0eb622dc35 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:55.393776 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dd0c8-b640-47ae-b3d6-cc0eb622dc35 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:55.394054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dd0c8-b640-47ae-b3d6-cc0eb622dc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:55.411953 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-790dd0c8-b640-47ae-b3d6-cc0eb622dc35 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:18:55.413140 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-790dd0c8-b640-47ae-b3d6-cc0eb622dc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:55.421071 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1140/2289] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:18:55.425496 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdbe15-f403-41ec-b037-1a287decc5de None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:55.435586 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdbe15-f403-41ec-b037-1a287decc5de None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:55.440362 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69582360-0cc4-4728-acec-202bdf7b1d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:55.441020 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69582360-0cc4-4728-acec-202bdf7b1d8b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:55.441297 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69582360-0cc4-4728-acec-202bdf7b1d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:55.441567 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69582360-0cc4-4728-acec-202bdf7b1d8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:55.442341 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69582360-0cc4-4728-acec-202bdf7b1d8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:18:55.442765 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69582360-0cc4-4728-acec-202bdf7b1d8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:55.444438 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69582360-0cc4-4728-acec-202bdf7b1d8b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:55.456864 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1150/2290] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:18:55.461033 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dd0c8-b640-47ae-b3d6-cc0eb622dc35 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:55.470338 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dd0c8-b640-47ae-b3d6-cc0eb622dc35 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:55.475144 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026d45a-d07e-413a-b87a-7ec1bc0bbfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:55.475853 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026d45a-d07e-413a-b87a-7ec1bc0bbfce admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:55.476134 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026d45a-d07e-413a-b87a-7ec1bc0bbfce admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:55.476411 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026d45a-d07e-413a-b87a-7ec1bc0bbfce admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:55.477117 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026d45a-d07e-413a-b87a-7ec1bc0bbfce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:55.479005 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026d45a-d07e-413a-b87a-7ec1bc0bbfce admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:55.506419 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1141/2291] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:18:55 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:18:55.510669 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69582360-0cc4-4728-acec-202bdf7b1d8b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:55.521279 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69582360-0cc4-4728-acec-202bdf7b1d8b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:55.580660 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb8291-7131-45c2-b2fb-42f599b4171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:55.581331 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb8291-7131-45c2-b2fb-42f599b4171d admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:55.581618 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb8291-7131-45c2-b2fb-42f599b4171d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:55.581901 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb8291-7131-45c2-b2fb-42f599b4171d admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:55.582627 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb8291-7131-45c2-b2fb-42f599b4171d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:55.584561 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb8291-7131-45c2-b2fb-42f599b4171d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:55.606579 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1151/2292] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:18:55 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:18:55.610605 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026d45a-d07e-413a-b87a-7ec1bc0bbfce admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:55.621510 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026d45a-d07e-413a-b87a-7ec1bc0bbfce admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:55.625985 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1264060-3a0a-4fe2-9e18-f73f020c93ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:55.626725 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1264060-3a0a-4fe2-9e18-f73f020c93ce admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:55.627085 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1264060-3a0a-4fe2-9e18-f73f020c93ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:55.627449 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1264060-3a0a-4fe2-9e18-f73f020c93ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:55.628315 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1264060-3a0a-4fe2-9e18-f73f020c93ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:55.630150 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1264060-3a0a-4fe2-9e18-f73f020c93ce admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:55.641579 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1142/2293] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:18:55.645447 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb8291-7131-45c2-b2fb-42f599b4171d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:55.656431 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb8291-7131-45c2-b2fb-42f599b4171d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:55.661233 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0db37b-8db3-44dd-83de-690003b040ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:55.661909 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0db37b-8db3-44dd-83de-690003b040ce admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:55.662189 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0db37b-8db3-44dd-83de-690003b040ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:55.662460 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0db37b-8db3-44dd-83de-690003b040ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:55.663193 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0db37b-8db3-44dd-83de-690003b040ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:55.664827 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0db37b-8db3-44dd-83de-690003b040ce admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:55.678007 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1152/2294] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:18:55.679216 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1264060-3a0a-4fe2-9e18-f73f020c93ce admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:55.689193 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1264060-3a0a-4fe2-9e18-f73f020c93ce admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:55.693737 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb82d3-c610-46a3-9d80-1ba6bef95809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:55.695125 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb82d3-c610-46a3-9d80-1ba6bef95809 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:55.695407 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb82d3-c610-46a3-9d80-1ba6bef95809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:55.695684 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb82d3-c610-46a3-9d80-1ba6bef95809 admin admin] PATH_INFO: `/v3/projects/a380c6c81cee43c7a9e80a6750be0c57/users/907f02f7d77b45d5a4a1d39ec475b802/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:55.710425 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb82d3-c610-46a3-9d80-1ba6bef95809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a380c6c81cee43c7a9e80a6750be0c57, user_id=907f02f7d77b45d5a4a1d39ec475b802, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:55.713070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb82d3-c610-46a3-9d80-1ba6bef95809 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:55.726117 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1143/2295] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:18:55 2022] PUT /identity/v3/projects/a380c6c81cee43c7a9e80a6750be0c57/users/907f02f7d77b45d5a4a1d39ec475b802/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:18:55.737850 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba725f7-be68-4f9d-be5b-fe60a0702f29 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:55.738369 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba725f7-be68-4f9d-be5b-fe60a0702f29 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:55.738578 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba725f7-be68-4f9d-be5b-fe60a0702f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:55.775865 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-bba725f7-be68-4f9d-be5b-fe60a0702f29 None None] MFA Rules not processed for user `907f02f7d77b45d5a4a1d39ec475b802`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:18:55.776539 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-bba725f7-be68-4f9d-be5b-fe60a0702f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:55.853435 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1153/2296] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:18:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:18:55.858657 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb82d3-c610-46a3-9d80-1ba6bef95809 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:55.933285 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb82d3-c610-46a3-9d80-1ba6bef95809 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:55.938921 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47634adf-a3ab-4abc-99cf-ab0824480b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:55.939577 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47634adf-a3ab-4abc-99cf-ab0824480b36 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:55.939898 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47634adf-a3ab-4abc-99cf-ab0824480b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:55.940179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47634adf-a3ab-4abc-99cf-ab0824480b36 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:55.940929 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47634adf-a3ab-4abc-99cf-ab0824480b36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:55.942802 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47634adf-a3ab-4abc-99cf-ab0824480b36 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:55.969298 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1144/2297] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:18:55 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:18:55.973405 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba725f7-be68-4f9d-be5b-fe60a0702f29 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:55.984361 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba725f7-be68-4f9d-be5b-fe60a0702f29 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:56.039496 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf20ed-05c6-483b-99bd-034946aa23d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:56.040202 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf20ed-05c6-483b-99bd-034946aa23d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:56.040485 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf20ed-05c6-483b-99bd-034946aa23d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:56.040760 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf20ed-05c6-483b-99bd-034946aa23d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:56.041481 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf20ed-05c6-483b-99bd-034946aa23d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:56.044058 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf20ed-05c6-483b-99bd-034946aa23d7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:56.065416 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1154/2298] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:18:55 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:18:56.069640 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47634adf-a3ab-4abc-99cf-ab0824480b36 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:56.081619 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47634adf-a3ab-4abc-99cf-ab0824480b36 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:56.087061 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d7a03-9ca9-4101-ab03-466aaebc1dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:56.087743 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d7a03-9ca9-4101-ab03-466aaebc1dca admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:56.088083 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d7a03-9ca9-4101-ab03-466aaebc1dca admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:56.088361 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d7a03-9ca9-4101-ab03-466aaebc1dca admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:56.089117 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d7a03-9ca9-4101-ab03-466aaebc1dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:56.091275 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d7a03-9ca9-4101-ab03-466aaebc1dca admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:56.104546 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1145/2299] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:18:56.109298 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf20ed-05c6-483b-99bd-034946aa23d7 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:56.119944 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf20ed-05c6-483b-99bd-034946aa23d7 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:56.125923 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa40b79-011f-4a83-9e0e-cf453d73851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:56.126937 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa40b79-011f-4a83-9e0e-cf453d73851a admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:56.127310 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa40b79-011f-4a83-9e0e-cf453d73851a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:56.127585 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa40b79-011f-4a83-9e0e-cf453d73851a admin admin] PATH_INFO: `/v3/projects/d128902ba3d24bd8b1ff7b82b16e2b55/users/6a29e81c3d494fcc8e447c8e7c20472f/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:56.143701 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa40b79-011f-4a83-9e0e-cf453d73851a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d128902ba3d24bd8b1ff7b82b16e2b55, user_id=6a29e81c3d494fcc8e447c8e7c20472f, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:56.146376 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa40b79-011f-4a83-9e0e-cf453d73851a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:56.160457 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1155/2300] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:18:56 2022] PUT /identity/v3/projects/d128902ba3d24bd8b1ff7b82b16e2b55/users/6a29e81c3d494fcc8e447c8e7c20472f/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:18:56.164640 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d7a03-9ca9-4101-ab03-466aaebc1dca admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:56.176497 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d7a03-9ca9-4101-ab03-466aaebc1dca admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:56.233939 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa53bd-afd5-4542-bcba-8690790c5252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:56.234614 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa53bd-afd5-4542-bcba-8690790c5252 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:56.234900 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa53bd-afd5-4542-bcba-8690790c5252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:56.235184 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa53bd-afd5-4542-bcba-8690790c5252 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:56.235953 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa53bd-afd5-4542-bcba-8690790c5252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:56.237553 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa53bd-afd5-4542-bcba-8690790c5252 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:56.248074 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1146/2301] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:18:56.252351 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa40b79-011f-4a83-9e0e-cf453d73851a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:56.263425 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa40b79-011f-4a83-9e0e-cf453d73851a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:56.268206 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af5889-990a-4b7e-9c69-25be99134848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:56.269082 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af5889-990a-4b7e-9c69-25be99134848 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:56.269390 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af5889-990a-4b7e-9c69-25be99134848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:56.269659 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af5889-990a-4b7e-9c69-25be99134848 admin admin] PATH_INFO: `/v3/projects/d128902ba3d24bd8b1ff7b82b16e2b55/users/6a29e81c3d494fcc8e447c8e7c20472f/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:56.271653 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af5889-990a-4b7e-9c69-25be99134848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d128902ba3d24bd8b1ff7b82b16e2b55, user_id=6a29e81c3d494fcc8e447c8e7c20472f, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:56.274300 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af5889-990a-4b7e-9c69-25be99134848 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:56.284647 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1156/2302] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:18:56 2022] PUT /identity/v3/projects/d128902ba3d24bd8b1ff7b82b16e2b55/users/6a29e81c3d494fcc8e447c8e7c20472f/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:18:56.295643 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140d9b1-33c4-4d06-8a28-72197a69e26c None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:56.295971 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140d9b1-33c4-4d06-8a28-72197a69e26c None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:56.296254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140d9b1-33c4-4d06-8a28-72197a69e26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:56.323022 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-a140d9b1-33c4-4d06-8a28-72197a69e26c None None] MFA Rules not processed for user `6a29e81c3d494fcc8e447c8e7c20472f`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:18:56.324349 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a140d9b1-33c4-4d06-8a28-72197a69e26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:56.399492 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1147/2303] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:18:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:18:56.410347 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af5889-990a-4b7e-9c69-25be99134848 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:56.412164 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-41af5889-990a-4b7e-9c69-25be99134848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:56.473773 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af5889-990a-4b7e-9c69-25be99134848 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:56.477881 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9179cc-3352-4bf5-b9df-f995fafaccdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:56.478809 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9179cc-3352-4bf5-b9df-f995fafaccdf service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:56.479093 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9179cc-3352-4bf5-b9df-f995fafaccdf service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:56.479370 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9179cc-3352-4bf5-b9df-f995fafaccdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:56.489312 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9179cc-3352-4bf5-b9df-f995fafaccdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:56.491008 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9179cc-3352-4bf5-b9df-f995fafaccdf service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:56.501734 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1157/2304] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:18:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:18:56.579437 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140d9b1-33c4-4d06-8a28-72197a69e26c None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:56.596507 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140d9b1-33c4-4d06-8a28-72197a69e26c None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:56.600340 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb2c0d-4af6-4fb2-981e-21117366630a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:56.601070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb2c0d-4af6-4fb2-981e-21117366630a service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:56.601421 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb2c0d-4af6-4fb2-981e-21117366630a service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:56.601765 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb2c0d-4af6-4fb2-981e-21117366630a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:56.667502 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb2c0d-4af6-4fb2-981e-21117366630a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:56.669245 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb2c0d-4af6-4fb2-981e-21117366630a service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:56.688022 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1148/2305] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:18:56 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:18:56.901737 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9179cc-3352-4bf5-b9df-f995fafaccdf service cinder] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:56.904602 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-4f9179cc-3352-4bf5-b9df-f995fafaccdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:56.976084 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9179cc-3352-4bf5-b9df-f995fafaccdf service cinder] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:56.981523 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc5b84-2e34-4b3f-8993-e25a31ab47d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:56.982406 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5b84-2e34-4b3f-8993-e25a31ab47d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:56.982692 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5b84-2e34-4b3f-8993-e25a31ab47d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:56.982967 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5b84-2e34-4b3f-8993-e25a31ab47d7 admin admin] PATH_INFO: `/v3/users/faefcf27ac824799b6b8e0059b3b3062` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:56.984200 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc5b84-2e34-4b3f-8993-e25a31ab47d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faefcf27ac824799b6b8e0059b3b3062)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:56.986102 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc5b84-2e34-4b3f-8993-e25a31ab47d7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:57.032214 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-9bdc5b84-2e34-4b3f-8993-e25a31ab47d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faefcf27ac824799b6b8e0059b3b3062'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:57.044448 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-9bdc5b84-2e34-4b3f-8993-e25a31ab47d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faefcf27ac824799b6b8e0059b3b3062'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:57.045280 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-9bdc5b84-2e34-4b3f-8993-e25a31ab47d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faefcf27ac824799b6b8e0059b3b3062'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:57.053311 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-9bdc5b84-2e34-4b3f-8993-e25a31ab47d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faefcf27ac824799b6b8e0059b3b3062'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:57.054146 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-9bdc5b84-2e34-4b3f-8993-e25a31ab47d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faefcf27ac824799b6b8e0059b3b3062'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:57.066566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1158/2306] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:18:56 2022] DELETE /identity/v3/users/faefcf27ac824799b6b8e0059b3b3062 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:18:57.071118 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ed5b8-86e1-4ae2-82e0-7112b7118de3 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:57.071399 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ed5b8-86e1-4ae2-82e0-7112b7118de3 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:57.071673 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ed5b8-86e1-4ae2-82e0-7112b7118de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:57.095398 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-1e6ed5b8-86e1-4ae2-82e0-7112b7118de3 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:18:57.096626 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-1e6ed5b8-86e1-4ae2-82e0-7112b7118de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:57.155955 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1149/2307] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:18:57.165577 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc5b84-2e34-4b3f-8993-e25a31ab47d7 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:57.167071 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-9bdc5b84-2e34-4b3f-8993-e25a31ab47d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:57.225365 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc5b84-2e34-4b3f-8993-e25a31ab47d7 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:57.229097 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee42654-5b86-4051-a613-6501688335e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:57.229776 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42654-5b86-4051-a613-6501688335e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:57.230575 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42654-5b86-4051-a613-6501688335e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:57.230868 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42654-5b86-4051-a613-6501688335e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:57.250441 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee42654-5b86-4051-a613-6501688335e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:57.253981 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee42654-5b86-4051-a613-6501688335e2 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:57.268728 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1159/2308] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:18:57.730435 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ed5b8-86e1-4ae2-82e0-7112b7118de3 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:57.732030 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-1e6ed5b8-86e1-4ae2-82e0-7112b7118de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:57.747588 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ed5b8-86e1-4ae2-82e0-7112b7118de3 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:57.754002 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cf051-cf91-43ce-ad68-cc7c75b61484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:57.754794 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cf051-cf91-43ce-ad68-cc7c75b61484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:57.754958 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cf051-cf91-43ce-ad68-cc7c75b61484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:57.755232 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cf051-cf91-43ce-ad68-cc7c75b61484 admin admin] PATH_INFO: `/v3/projects/c72431de1bac496ba088201151e402aa` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:57.756492 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cf051-cf91-43ce-ad68-cc7c75b61484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c72431de1bac496ba088201151e402aa)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:57.760529 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cf051-cf91-43ce-ad68-cc7c75b61484 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:57.822619 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-dc7cf051-cf91-43ce-ad68-cc7c75b61484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c72431de1bac496ba088201151e402aa', 'request_id': 'req-dc7cf051-cf91-43ce-ad68-cc7c75b61484'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:57.837507 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee42654-5b86-4051-a613-6501688335e2 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:57.839207 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-aee42654-5b86-4051-a613-6501688335e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:57.845957 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-dc7cf051-cf91-43ce-ad68-cc7c75b61484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c72431de1bac496ba088201151e402aa', 'request_id': 'req-dc7cf051-cf91-43ce-ad68-cc7c75b61484'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:57.853545 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-dc7cf051-cf91-43ce-ad68-cc7c75b61484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c72431de1bac496ba088201151e402aa', 'request_id': 'req-dc7cf051-cf91-43ce-ad68-cc7c75b61484'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:57.857371 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee42654-5b86-4051-a613-6501688335e2 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:57.868546 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-dc7cf051-cf91-43ce-ad68-cc7c75b61484 admin admin] The token cache is being invalidate because project c72431de1bac496ba088201151e402aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:18:57.868833 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-dc7cf051-cf91-43ce-ad68-cc7c75b61484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:57.869803 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-dc7cf051-cf91-43ce-ad68-cc7c75b61484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:57.882149 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1150/2309] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:18:57 2022] DELETE /identity/v3/projects/c72431de1bac496ba088201151e402aa => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:18:57.973095 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928527bd-2fd4-46b3-a5ec-33e2ebf8a316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:57.974520 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928527bd-2fd4-46b3-a5ec-33e2ebf8a316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:57.974808 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928527bd-2fd4-46b3-a5ec-33e2ebf8a316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:57.975089 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928527bd-2fd4-46b3-a5ec-33e2ebf8a316 admin admin] PATH_INFO: `/v3/users/04d26b3aaeac4e6095755df3d9e34737` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:57.976543 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928527bd-2fd4-46b3-a5ec-33e2ebf8a316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04d26b3aaeac4e6095755df3d9e34737)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:57.978524 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928527bd-2fd4-46b3-a5ec-33e2ebf8a316 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:58.066072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-928527bd-2fd4-46b3-a5ec-33e2ebf8a316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04d26b3aaeac4e6095755df3d9e34737'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:58.085924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-928527bd-2fd4-46b3-a5ec-33e2ebf8a316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04d26b3aaeac4e6095755df3d9e34737'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:58.088224 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-928527bd-2fd4-46b3-a5ec-33e2ebf8a316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04d26b3aaeac4e6095755df3d9e34737'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:58.109338 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-928527bd-2fd4-46b3-a5ec-33e2ebf8a316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04d26b3aaeac4e6095755df3d9e34737'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:58.110299 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-928527bd-2fd4-46b3-a5ec-33e2ebf8a316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04d26b3aaeac4e6095755df3d9e34737'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:58.130274 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1160/2310] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:18:57 2022] DELETE /identity/v3/users/04d26b3aaeac4e6095755df3d9e34737 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:18:58.352707 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cf051-cf91-43ce-ad68-cc7c75b61484 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:58.354137 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-dc7cf051-cf91-43ce-ad68-cc7c75b61484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:58.369462 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cf051-cf91-43ce-ad68-cc7c75b61484 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:58.427217 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dde5f0-1c6e-41f6-956b-82979d15ffb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:58.428103 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dde5f0-1c6e-41f6-956b-82979d15ffb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:58.428387 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dde5f0-1c6e-41f6-956b-82979d15ffb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:58.428662 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dde5f0-1c6e-41f6-956b-82979d15ffb9 admin admin] PATH_INFO: `/v3/projects/0256f193432141a582df6c7960b3f1ce` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:58.429834 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dde5f0-1c6e-41f6-956b-82979d15ffb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0256f193432141a582df6c7960b3f1ce)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:58.431728 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dde5f0-1c6e-41f6-956b-82979d15ffb9 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:58.476483 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-54dde5f0-1c6e-41f6-956b-82979d15ffb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0256f193432141a582df6c7960b3f1ce', 'request_id': 'req-54dde5f0-1c6e-41f6-956b-82979d15ffb9'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:58.483660 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-54dde5f0-1c6e-41f6-956b-82979d15ffb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0256f193432141a582df6c7960b3f1ce', 'request_id': 'req-54dde5f0-1c6e-41f6-956b-82979d15ffb9'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:58.488982 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-54dde5f0-1c6e-41f6-956b-82979d15ffb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0256f193432141a582df6c7960b3f1ce', 'request_id': 'req-54dde5f0-1c6e-41f6-956b-82979d15ffb9'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:58.500306 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-54dde5f0-1c6e-41f6-956b-82979d15ffb9 admin admin] The token cache is being invalidate because project 0256f193432141a582df6c7960b3f1ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:18:58.500588 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-54dde5f0-1c6e-41f6-956b-82979d15ffb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:58.501213 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-54dde5f0-1c6e-41f6-956b-82979d15ffb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:18:58.502727 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1151/2311] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:18:58 2022] DELETE /identity/v3/projects/0256f193432141a582df6c7960b3f1ce => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:18:58.507724 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11b6c9-fe4d-4581-926d-2fcf29fa63f6 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:58.507998 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11b6c9-fe4d-4581-926d-2fcf29fa63f6 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:58.508272 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11b6c9-fe4d-4581-926d-2fcf29fa63f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:58.527161 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-5e11b6c9-fe4d-4581-926d-2fcf29fa63f6 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:18:58.528381 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-5e11b6c9-fe4d-4581-926d-2fcf29fa63f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:58.586569 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1161/2312] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:18:58.594319 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258043be-3a9c-4daa-85cc-697d381f2b4d None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:58.594611 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258043be-3a9c-4daa-85cc-697d381f2b4d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:58.594894 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258043be-3a9c-4daa-85cc-697d381f2b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:58.614496 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-258043be-3a9c-4daa-85cc-697d381f2b4d None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:18:58.615706 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-258043be-3a9c-4daa-85cc-697d381f2b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:58.625752 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1152/2313] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:18:58.629992 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11b6c9-fe4d-4581-926d-2fcf29fa63f6 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:58.639657 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11b6c9-fe4d-4581-926d-2fcf29fa63f6 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:58.644274 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2d27a-992d-425a-b1b0-9b8e8f32a216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:58.644945 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2d27a-992d-425a-b1b0-9b8e8f32a216 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:58.645255 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2d27a-992d-425a-b1b0-9b8e8f32a216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:58.645528 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2d27a-992d-425a-b1b0-9b8e8f32a216 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:58.646290 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2d27a-992d-425a-b1b0-9b8e8f32a216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:18:58.646593 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2d27a-992d-425a-b1b0-9b8e8f32a216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:58.648208 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2d27a-992d-425a-b1b0-9b8e8f32a216 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:58.659480 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1162/2314] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:18:58.663794 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258043be-3a9c-4daa-85cc-697d381f2b4d None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:58.675596 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258043be-3a9c-4daa-85cc-697d381f2b4d None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:58.681172 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22075f62-65a3-462c-a437-473b970a3e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:58.681836 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22075f62-65a3-462c-a437-473b970a3e68 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:58.682117 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22075f62-65a3-462c-a437-473b970a3e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:58.682391 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22075f62-65a3-462c-a437-473b970a3e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:58.683098 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22075f62-65a3-462c-a437-473b970a3e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:58.686322 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22075f62-65a3-462c-a437-473b970a3e68 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:58.718959 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1153/2315] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:18:58 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:18:58.722960 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2d27a-992d-425a-b1b0-9b8e8f32a216 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:58.734399 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2d27a-992d-425a-b1b0-9b8e8f32a216 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:58.793916 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2f9e4-c04f-434b-8f8a-c04df5e0df57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:58.795108 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2f9e4-c04f-434b-8f8a-c04df5e0df57 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:58.795414 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2f9e4-c04f-434b-8f8a-c04df5e0df57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:58.796256 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2f9e4-c04f-434b-8f8a-c04df5e0df57 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:58.796648 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2f9e4-c04f-434b-8f8a-c04df5e0df57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:58.798919 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2f9e4-c04f-434b-8f8a-c04df5e0df57 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:58.820480 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1163/2316] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:18:58 2022] POST /identity/v3/users => generated 282 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:18:58.828754 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22075f62-65a3-462c-a437-473b970a3e68 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:58.840727 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22075f62-65a3-462c-a437-473b970a3e68 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:58.847483 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b76f1-8a08-4263-a961-7e91e0abe07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:58.848509 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b76f1-8a08-4263-a961-7e91e0abe07e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:58.848794 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b76f1-8a08-4263-a961-7e91e0abe07e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:58.849150 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b76f1-8a08-4263-a961-7e91e0abe07e admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:58.850024 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b76f1-8a08-4263-a961-7e91e0abe07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:58.852930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b76f1-8a08-4263-a961-7e91e0abe07e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:58.864827 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1154/2317] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:18:58.868991 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2f9e4-c04f-434b-8f8a-c04df5e0df57 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:58.880265 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2f9e4-c04f-434b-8f8a-c04df5e0df57 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:58.884966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe4b88-6bff-4051-b4e1-e79c86c958f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:58.885632 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe4b88-6bff-4051-b4e1-e79c86c958f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:58.885916 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe4b88-6bff-4051-b4e1-e79c86c958f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:58.886198 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe4b88-6bff-4051-b4e1-e79c86c958f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:58.886946 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe4b88-6bff-4051-b4e1-e79c86c958f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:58.888666 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe4b88-6bff-4051-b4e1-e79c86c958f3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:58.898680 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1164/2318] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:18:58.903220 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b76f1-8a08-4263-a961-7e91e0abe07e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:58.913911 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b76f1-8a08-4263-a961-7e91e0abe07e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:58.919580 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dee147-32dc-4a71-9d22-1eee0e29bd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:58.920483 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dee147-32dc-4a71-9d22-1eee0e29bd80 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:58.920764 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dee147-32dc-4a71-9d22-1eee0e29bd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:58.921037 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dee147-32dc-4a71-9d22-1eee0e29bd80 admin admin] PATH_INFO: `/v3/projects/3e60a7634de1477ba3cf20a285eb3efc/users/ca739165070b4b44a2d0cb5eca368082/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:58.935602 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dee147-32dc-4a71-9d22-1eee0e29bd80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e60a7634de1477ba3cf20a285eb3efc, user_id=ca739165070b4b44a2d0cb5eca368082, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:58.938251 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dee147-32dc-4a71-9d22-1eee0e29bd80 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:58.950812 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1155/2319] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:18:58 2022] PUT /identity/v3/projects/3e60a7634de1477ba3cf20a285eb3efc/users/ca739165070b4b44a2d0cb5eca368082/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:18:58.960987 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9c477-716a-4a6b-8d51-59fb864bab2c None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:58.961279 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9c477-716a-4a6b-8d51-59fb864bab2c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:58.961558 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9c477-716a-4a6b-8d51-59fb864bab2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:58.990862 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-14d9c477-716a-4a6b-8d51-59fb864bab2c None None] MFA Rules not processed for user `ca739165070b4b44a2d0cb5eca368082`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:18:58.992158 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-14d9c477-716a-4a6b-8d51-59fb864bab2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:59.060183 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1165/2320] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:18:58 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:18:59.069936 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dee147-32dc-4a71-9d22-1eee0e29bd80 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:18:59.071621 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-33dee147-32dc-4a71-9d22-1eee0e29bd80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:18:59.128813 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dee147-32dc-4a71-9d22-1eee0e29bd80 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:18:59.132537 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527321a3-1785-4e63-8267-864a6d101d87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:18:59.133176 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527321a3-1785-4e63-8267-864a6d101d87 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:18:59.133481 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527321a3-1785-4e63-8267-864a6d101d87 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:18:59.133803 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527321a3-1785-4e63-8267-864a6d101d87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:18:59.142501 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527321a3-1785-4e63-8267-864a6d101d87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:18:59.143972 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527321a3-1785-4e63-8267-864a6d101d87 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:18:59.154175 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1156/2321] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:18:59 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:19:10.092876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9c477-716a-4a6b-8d51-59fb864bab2c None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:10.094245 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-14d9c477-716a-4a6b-8d51-59fb864bab2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:10.157748 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9c477-716a-4a6b-8d51-59fb864bab2c None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:10.162132 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08325aa-e49d-47ec-a9cd-4ccb35e747e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:10.162974 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08325aa-e49d-47ec-a9cd-4ccb35e747e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:10.163252 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08325aa-e49d-47ec-a9cd-4ccb35e747e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:10.163517 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08325aa-e49d-47ec-a9cd-4ccb35e747e3 admin admin] PATH_INFO: `/v3/users/907f02f7d77b45d5a4a1d39ec475b802` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:10.164717 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08325aa-e49d-47ec-a9cd-4ccb35e747e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=907f02f7d77b45d5a4a1d39ec475b802)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:10.166612 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08325aa-e49d-47ec-a9cd-4ccb35e747e3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:10.210141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a08325aa-e49d-47ec-a9cd-4ccb35e747e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '907f02f7d77b45d5a4a1d39ec475b802'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:10.221315 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a08325aa-e49d-47ec-a9cd-4ccb35e747e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '907f02f7d77b45d5a4a1d39ec475b802'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:10.222585 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a08325aa-e49d-47ec-a9cd-4ccb35e747e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '907f02f7d77b45d5a4a1d39ec475b802'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:10.229188 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a08325aa-e49d-47ec-a9cd-4ccb35e747e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '907f02f7d77b45d5a4a1d39ec475b802'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:10.229796 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a08325aa-e49d-47ec-a9cd-4ccb35e747e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '907f02f7d77b45d5a4a1d39ec475b802'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:10.241794 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1166/2322] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:19:10 2022] DELETE /identity/v3/users/907f02f7d77b45d5a4a1d39ec475b802 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:10.247375 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8ae68-6dcd-4391-8336-e5b7ee3ccc9f None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:10.247777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8ae68-6dcd-4391-8336-e5b7ee3ccc9f None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:10.247957 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8ae68-6dcd-4391-8336-e5b7ee3ccc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:10.265600 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-0fb8ae68-6dcd-4391-8336-e5b7ee3ccc9f None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:10.266897 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-0fb8ae68-6dcd-4391-8336-e5b7ee3ccc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:10.322529 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1157/2323] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:10.332782 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08325aa-e49d-47ec-a9cd-4ccb35e747e3 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:10.334181 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a08325aa-e49d-47ec-a9cd-4ccb35e747e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:10.390335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08325aa-e49d-47ec-a9cd-4ccb35e747e3 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:10.393974 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045197b-67a6-415b-bb30-1201748e25b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:10.394614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045197b-67a6-415b-bb30-1201748e25b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:10.394896 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045197b-67a6-415b-bb30-1201748e25b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:10.395166 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045197b-67a6-415b-bb30-1201748e25b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:10.404605 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045197b-67a6-415b-bb30-1201748e25b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:10.406009 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045197b-67a6-415b-bb30-1201748e25b0 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:10.415388 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1167/2324] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:19:10.692298 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8ae68-6dcd-4391-8336-e5b7ee3ccc9f None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:10.693990 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-0fb8ae68-6dcd-4391-8336-e5b7ee3ccc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:10.705914 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8ae68-6dcd-4391-8336-e5b7ee3ccc9f None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:10.710705 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c6128-e840-49f7-99b1-1c681ae941ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:10.711585 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c6128-e840-49f7-99b1-1c681ae941ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:10.711888 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c6128-e840-49f7-99b1-1c681ae941ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:10.712161 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c6128-e840-49f7-99b1-1c681ae941ea admin admin] PATH_INFO: `/v3/projects/a380c6c81cee43c7a9e80a6750be0c57` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:10.713691 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c6128-e840-49f7-99b1-1c681ae941ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=a380c6c81cee43c7a9e80a6750be0c57)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:10.715743 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c6128-e840-49f7-99b1-1c681ae941ea admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:10.766760 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5d2c6128-e840-49f7-99b1-1c681ae941ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a380c6c81cee43c7a9e80a6750be0c57', 'request_id': 'req-5d2c6128-e840-49f7-99b1-1c681ae941ea'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:10.773495 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5d2c6128-e840-49f7-99b1-1c681ae941ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a380c6c81cee43c7a9e80a6750be0c57', 'request_id': 'req-5d2c6128-e840-49f7-99b1-1c681ae941ea'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:10.779026 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5d2c6128-e840-49f7-99b1-1c681ae941ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a380c6c81cee43c7a9e80a6750be0c57', 'request_id': 'req-5d2c6128-e840-49f7-99b1-1c681ae941ea'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:10.789948 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5d2c6128-e840-49f7-99b1-1c681ae941ea admin admin] The token cache is being invalidate because project a380c6c81cee43c7a9e80a6750be0c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:19:10.790221 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5d2c6128-e840-49f7-99b1-1c681ae941ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:10.790868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5d2c6128-e840-49f7-99b1-1c681ae941ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:10.793057 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1158/2325] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:19:10 2022] DELETE /identity/v3/projects/a380c6c81cee43c7a9e80a6750be0c57 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:19:10.796994 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045197b-67a6-415b-bb30-1201748e25b0 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:10.806285 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045197b-67a6-415b-bb30-1201748e25b0 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:10.860835 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb983400-1d33-409c-a7a5-d594cbac2ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:10.861697 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983400-1d33-409c-a7a5-d594cbac2ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:10.861981 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983400-1d33-409c-a7a5-d594cbac2ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:10.862259 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983400-1d33-409c-a7a5-d594cbac2ac9 admin admin] PATH_INFO: `/v3/users/6a29e81c3d494fcc8e447c8e7c20472f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:10.863451 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb983400-1d33-409c-a7a5-d594cbac2ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a29e81c3d494fcc8e447c8e7c20472f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:10.865369 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb983400-1d33-409c-a7a5-d594cbac2ac9 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:10.910378 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-eb983400-1d33-409c-a7a5-d594cbac2ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a29e81c3d494fcc8e447c8e7c20472f'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:10.922456 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-eb983400-1d33-409c-a7a5-d594cbac2ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a29e81c3d494fcc8e447c8e7c20472f'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:10.923125 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-eb983400-1d33-409c-a7a5-d594cbac2ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a29e81c3d494fcc8e447c8e7c20472f'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:10.936689 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-eb983400-1d33-409c-a7a5-d594cbac2ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a29e81c3d494fcc8e447c8e7c20472f'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:10.937295 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-eb983400-1d33-409c-a7a5-d594cbac2ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a29e81c3d494fcc8e447c8e7c20472f'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:10.949002 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1168/2326] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:19:10 2022] DELETE /identity/v3/users/6a29e81c3d494fcc8e447c8e7c20472f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:11.210297 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c6128-e840-49f7-99b1-1c681ae941ea admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:11.211731 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-5d2c6128-e840-49f7-99b1-1c681ae941ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:11.224669 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c6128-e840-49f7-99b1-1c681ae941ea admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:11.281994 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c1131-7010-469e-b5e9-8c408b4bc759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:11.282858 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c1131-7010-469e-b5e9-8c408b4bc759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:11.283143 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c1131-7010-469e-b5e9-8c408b4bc759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:11.283421 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c1131-7010-469e-b5e9-8c408b4bc759 admin admin] PATH_INFO: `/v3/projects/d128902ba3d24bd8b1ff7b82b16e2b55` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:11.284642 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c1131-7010-469e-b5e9-8c408b4bc759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d128902ba3d24bd8b1ff7b82b16e2b55)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:11.286543 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c1131-7010-469e-b5e9-8c408b4bc759 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:11.330912 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ab3c1131-7010-469e-b5e9-8c408b4bc759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd128902ba3d24bd8b1ff7b82b16e2b55', 'request_id': 'req-ab3c1131-7010-469e-b5e9-8c408b4bc759'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:11.337621 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ab3c1131-7010-469e-b5e9-8c408b4bc759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd128902ba3d24bd8b1ff7b82b16e2b55', 'request_id': 'req-ab3c1131-7010-469e-b5e9-8c408b4bc759'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:11.343034 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ab3c1131-7010-469e-b5e9-8c408b4bc759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd128902ba3d24bd8b1ff7b82b16e2b55', 'request_id': 'req-ab3c1131-7010-469e-b5e9-8c408b4bc759'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:11.353422 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ab3c1131-7010-469e-b5e9-8c408b4bc759 admin admin] The token cache is being invalidate because project d128902ba3d24bd8b1ff7b82b16e2b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:19:11.353706 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ab3c1131-7010-469e-b5e9-8c408b4bc759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:11.354326 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ab3c1131-7010-469e-b5e9-8c408b4bc759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:11.356390 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1159/2327] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:19:11 2022] DELETE /identity/v3/projects/d128902ba3d24bd8b1ff7b82b16e2b55 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:11.362998 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a940173-75ca-47d4-a23d-961cf56e66ce None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:11.363475 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a940173-75ca-47d4-a23d-961cf56e66ce None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:11.363567 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a940173-75ca-47d4-a23d-961cf56e66ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:11.382543 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-2a940173-75ca-47d4-a23d-961cf56e66ce None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:11.383729 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2a940173-75ca-47d4-a23d-961cf56e66ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:11.441070 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1169/2328] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:11.450228 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf2fe4-1a05-4e31-ab75-d6543c6bcbad None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:11.450538 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf2fe4-1a05-4e31-ab75-d6543c6bcbad None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:11.450827 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf2fe4-1a05-4e31-ab75-d6543c6bcbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:11.468550 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-fdcf2fe4-1a05-4e31-ab75-d6543c6bcbad None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:11.469687 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-fdcf2fe4-1a05-4e31-ab75-d6543c6bcbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:11.477475 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1160/2329] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:11.482221 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a940173-75ca-47d4-a23d-961cf56e66ce None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:11.491525 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a940173-75ca-47d4-a23d-961cf56e66ce None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:11.497084 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6359d79-e2be-49cc-9f35-f066672488fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:11.497722 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6359d79-e2be-49cc-9f35-f066672488fc admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:11.498003 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6359d79-e2be-49cc-9f35-f066672488fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:11.498272 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6359d79-e2be-49cc-9f35-f066672488fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:11.499002 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6359d79-e2be-49cc-9f35-f066672488fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:19:11.499306 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6359d79-e2be-49cc-9f35-f066672488fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:11.500917 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6359d79-e2be-49cc-9f35-f066672488fc admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:11.513129 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1170/2330] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:19:11.516683 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf2fe4-1a05-4e31-ab75-d6543c6bcbad None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:11.525642 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf2fe4-1a05-4e31-ab75-d6543c6bcbad None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:11.530707 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af9d06-af6a-4801-8c7a-c219fd449a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:11.531423 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af9d06-af6a-4801-8c7a-c219fd449a4f admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:11.531704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af9d06-af6a-4801-8c7a-c219fd449a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:11.532007 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af9d06-af6a-4801-8c7a-c219fd449a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:11.532710 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af9d06-af6a-4801-8c7a-c219fd449a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:11.534577 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af9d06-af6a-4801-8c7a-c219fd449a4f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:11.561972 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1161/2331] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:19:11 2022] POST /identity/v3/projects => generated 401 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:19:11.566073 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6359d79-e2be-49cc-9f35-f066672488fc admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:11.577593 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6359d79-e2be-49cc-9f35-f066672488fc admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:11.636468 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b27e39-6b89-4123-9476-2cbd48f0f4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:11.637128 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b27e39-6b89-4123-9476-2cbd48f0f4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:11.637408 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b27e39-6b89-4123-9476-2cbd48f0f4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:11.637681 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b27e39-6b89-4123-9476-2cbd48f0f4b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:11.638386 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b27e39-6b89-4123-9476-2cbd48f0f4b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:11.640323 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b27e39-6b89-4123-9476-2cbd48f0f4b1 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:11.659220 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1171/2332] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:19:11 2022] POST /identity/v3/users => generated 301 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:19:11.663461 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af9d06-af6a-4801-8c7a-c219fd449a4f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:11.674222 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af9d06-af6a-4801-8c7a-c219fd449a4f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:11.678750 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682681c-ec4e-430b-a96c-d5ca302cedc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:11.679403 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682681c-ec4e-430b-a96c-d5ca302cedc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:11.679682 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682681c-ec4e-430b-a96c-d5ca302cedc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:11.679995 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682681c-ec4e-430b-a96c-d5ca302cedc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:11.680759 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682681c-ec4e-430b-a96c-d5ca302cedc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:11.682320 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682681c-ec4e-430b-a96c-d5ca302cedc5 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:11.692959 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1162/2333] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:19:11.696813 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b27e39-6b89-4123-9476-2cbd48f0f4b1 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:11.706667 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b27e39-6b89-4123-9476-2cbd48f0f4b1 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:11.711235 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e6289-be1d-48c6-9a3a-2c852de2520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:11.711916 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e6289-be1d-48c6-9a3a-2c852de2520e admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:11.712212 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e6289-be1d-48c6-9a3a-2c852de2520e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:11.712488 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e6289-be1d-48c6-9a3a-2c852de2520e admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:11.713222 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e6289-be1d-48c6-9a3a-2c852de2520e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:11.715335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e6289-be1d-48c6-9a3a-2c852de2520e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:11.724942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1172/2334] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:19:11.728763 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682681c-ec4e-430b-a96c-d5ca302cedc5 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:11.739009 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682681c-ec4e-430b-a96c-d5ca302cedc5 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:11.743478 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed57c3d-5519-4266-809b-3cec9719318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:11.744630 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed57c3d-5519-4266-809b-3cec9719318f admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:11.744910 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed57c3d-5519-4266-809b-3cec9719318f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:11.745182 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed57c3d-5519-4266-809b-3cec9719318f admin admin] PATH_INFO: `/v3/projects/b4d1f27d3c6a48b69190643a86f672e4/users/1112991287a64214923c680697952b46/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:11.759480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed57c3d-5519-4266-809b-3cec9719318f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4d1f27d3c6a48b69190643a86f672e4, user_id=1112991287a64214923c680697952b46, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:11.762237 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed57c3d-5519-4266-809b-3cec9719318f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:11.774593 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1163/2335] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:19:11 2022] PUT /identity/v3/projects/b4d1f27d3c6a48b69190643a86f672e4/users/1112991287a64214923c680697952b46/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:19:11.785554 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fced53-0bd4-4718-9d49-8590b3a0cbdc None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:11.785894 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fced53-0bd4-4718-9d49-8590b3a0cbdc None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:11.786197 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fced53-0bd4-4718-9d49-8590b3a0cbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:11.812105 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-66fced53-0bd4-4718-9d49-8590b3a0cbdc None None] MFA Rules not processed for user `1112991287a64214923c680697952b46`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:11.813298 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-66fced53-0bd4-4718-9d49-8590b3a0cbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:11.875556 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1173/2336] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:11.880304 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed57c3d-5519-4266-809b-3cec9719318f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:11.943066 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed57c3d-5519-4266-809b-3cec9719318f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:11.948045 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9716ad8-58d6-4d3a-b557-9a7489ecc4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:11.948750 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9716ad8-58d6-4d3a-b557-9a7489ecc4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:11.949062 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9716ad8-58d6-4d3a-b557-9a7489ecc4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:11.949388 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9716ad8-58d6-4d3a-b557-9a7489ecc4a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:11.950200 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9716ad8-58d6-4d3a-b557-9a7489ecc4a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:11.952123 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9716ad8-58d6-4d3a-b557-9a7489ecc4a8 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:11.990142 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1164/2337] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:19:11 2022] POST /identity/v3/projects => generated 401 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:19:11.990258 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fced53-0bd4-4718-9d49-8590b3a0cbdc None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:11.999968 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fced53-0bd4-4718-9d49-8590b3a0cbdc None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:12.058398 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6dab5-7dcc-4813-a349-517cc32acfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:12.059068 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6dab5-7dcc-4813-a349-517cc32acfb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:12.059350 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6dab5-7dcc-4813-a349-517cc32acfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:12.059626 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6dab5-7dcc-4813-a349-517cc32acfb7 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:12.060372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6dab5-7dcc-4813-a349-517cc32acfb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:12.062247 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6dab5-7dcc-4813-a349-517cc32acfb7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:12.083660 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1174/2338] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:19:11 2022] POST /identity/v3/users => generated 307 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:19:12.087324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9716ad8-58d6-4d3a-b557-9a7489ecc4a8 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:12.098477 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9716ad8-58d6-4d3a-b557-9a7489ecc4a8 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:12.103085 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb892737-8591-4c07-8cc3-aa56958c4861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:12.103737 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb892737-8591-4c07-8cc3-aa56958c4861 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:12.104059 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb892737-8591-4c07-8cc3-aa56958c4861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:12.104320 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb892737-8591-4c07-8cc3-aa56958c4861 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:12.105326 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb892737-8591-4c07-8cc3-aa56958c4861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:12.106981 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb892737-8591-4c07-8cc3-aa56958c4861 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:12.117170 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1165/2339] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:19:12.121674 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6dab5-7dcc-4813-a349-517cc32acfb7 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:12.131308 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6dab5-7dcc-4813-a349-517cc32acfb7 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:12.135811 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad2f71-a819-4eef-9fb5-8e641abcabf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:12.137372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad2f71-a819-4eef-9fb5-8e641abcabf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:12.137675 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad2f71-a819-4eef-9fb5-8e641abcabf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:12.137928 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad2f71-a819-4eef-9fb5-8e641abcabf5 admin admin] PATH_INFO: `/v3/projects/c5ce72f5d03246ec93cbc1a811aa5e25/users/b1b697956a1d4bf194066de89952ea53/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:12.152849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad2f71-a819-4eef-9fb5-8e641abcabf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ce72f5d03246ec93cbc1a811aa5e25, user_id=b1b697956a1d4bf194066de89952ea53, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:12.155486 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad2f71-a819-4eef-9fb5-8e641abcabf5 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:12.168485 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1175/2340] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:19:12 2022] PUT /identity/v3/projects/c5ce72f5d03246ec93cbc1a811aa5e25/users/b1b697956a1d4bf194066de89952ea53/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:19:12.172317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb892737-8591-4c07-8cc3-aa56958c4861 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:12.182167 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb892737-8591-4c07-8cc3-aa56958c4861 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:12.237846 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e43e7b-0892-46c7-8116-b07463050991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:12.238418 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e43e7b-0892-46c7-8116-b07463050991 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:12.238697 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e43e7b-0892-46c7-8116-b07463050991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:12.238967 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e43e7b-0892-46c7-8116-b07463050991 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:12.239690 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e43e7b-0892-46c7-8116-b07463050991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:12.241306 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e43e7b-0892-46c7-8116-b07463050991 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:12.251076 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1166/2341] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:19:12.255169 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad2f71-a819-4eef-9fb5-8e641abcabf5 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:12.265816 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad2f71-a819-4eef-9fb5-8e641abcabf5 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:12.270378 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e2d00-7ec6-4bb6-a4da-9109d72113cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:12.271238 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e2d00-7ec6-4bb6-a4da-9109d72113cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:12.271524 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e2d00-7ec6-4bb6-a4da-9109d72113cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:12.271803 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e2d00-7ec6-4bb6-a4da-9109d72113cd admin admin] PATH_INFO: `/v3/projects/c5ce72f5d03246ec93cbc1a811aa5e25/users/b1b697956a1d4bf194066de89952ea53/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:12.274069 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e2d00-7ec6-4bb6-a4da-9109d72113cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ce72f5d03246ec93cbc1a811aa5e25, user_id=b1b697956a1d4bf194066de89952ea53, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:12.277340 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e2d00-7ec6-4bb6-a4da-9109d72113cd admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:12.287317 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1176/2342] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:19:12 2022] PUT /identity/v3/projects/c5ce72f5d03246ec93cbc1a811aa5e25/users/b1b697956a1d4bf194066de89952ea53/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:12.297423 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612822ed-ae89-4c18-80f6-8c574173f729 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:12.297901 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612822ed-ae89-4c18-80f6-8c574173f729 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:12.297999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612822ed-ae89-4c18-80f6-8c574173f729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:12.323282 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-612822ed-ae89-4c18-80f6-8c574173f729 None None] MFA Rules not processed for user `b1b697956a1d4bf194066de89952ea53`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:12.324999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-612822ed-ae89-4c18-80f6-8c574173f729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:12.394803 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1167/2343] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:12.405355 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e2d00-7ec6-4bb6-a4da-9109d72113cd admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:12.407065 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-756e2d00-7ec6-4bb6-a4da-9109d72113cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:12.464957 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e2d00-7ec6-4bb6-a4da-9109d72113cd admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:12.468967 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee4ac3-683d-4adb-9a77-0d42bc50b769 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:12.469637 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee4ac3-683d-4adb-9a77-0d42bc50b769 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:12.469917 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee4ac3-683d-4adb-9a77-0d42bc50b769 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:12.470208 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee4ac3-683d-4adb-9a77-0d42bc50b769 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:12.479520 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee4ac3-683d-4adb-9a77-0d42bc50b769 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:12.481180 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee4ac3-683d-4adb-9a77-0d42bc50b769 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:12.490526 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1177/2344] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:19:12 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:19:12.562650 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612822ed-ae89-4c18-80f6-8c574173f729 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:12.572157 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612822ed-ae89-4c18-80f6-8c574173f729 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:12.576429 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1d92a-c876-4ee3-b942-e778e6e75ad8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:12.577063 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1d92a-c876-4ee3-b942-e778e6e75ad8 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:12.577349 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1d92a-c876-4ee3-b942-e778e6e75ad8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:12.577626 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1d92a-c876-4ee3-b942-e778e6e75ad8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:12.634360 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1d92a-c876-4ee3-b942-e778e6e75ad8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:12.635809 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1d92a-c876-4ee3-b942-e778e6e75ad8 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:12.651038 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1168/2345] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:19:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:19:12.653179 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee4ac3-683d-4adb-9a77-0d42bc50b769 service cinder] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:12.654591 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-66ee4ac3-683d-4adb-9a77-0d42bc50b769 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:12.726162 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee4ac3-683d-4adb-9a77-0d42bc50b769 service cinder] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:12.732322 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495133c-de8b-4fb5-853c-86ea01ac16b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:12.733266 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495133c-de8b-4fb5-853c-86ea01ac16b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:12.733615 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495133c-de8b-4fb5-853c-86ea01ac16b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:12.733977 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495133c-de8b-4fb5-853c-86ea01ac16b2 admin admin] PATH_INFO: `/v3/users/ca739165070b4b44a2d0cb5eca368082` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:12.735259 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495133c-de8b-4fb5-853c-86ea01ac16b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca739165070b4b44a2d0cb5eca368082)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:12.737212 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495133c-de8b-4fb5-853c-86ea01ac16b2 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:12.786256 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-d495133c-de8b-4fb5-853c-86ea01ac16b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca739165070b4b44a2d0cb5eca368082'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:12.799777 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-d495133c-de8b-4fb5-853c-86ea01ac16b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca739165070b4b44a2d0cb5eca368082'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:12.800497 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-d495133c-de8b-4fb5-853c-86ea01ac16b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca739165070b4b44a2d0cb5eca368082'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:12.807717 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-d495133c-de8b-4fb5-853c-86ea01ac16b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca739165070b4b44a2d0cb5eca368082'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:12.808492 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-d495133c-de8b-4fb5-853c-86ea01ac16b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca739165070b4b44a2d0cb5eca368082'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:12.820922 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1178/2346] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:19:12 2022] DELETE /identity/v3/users/ca739165070b4b44a2d0cb5eca368082 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:12.826075 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb425f8-cff5-480e-b8a6-fcd15c9d2cf8 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:12.826361 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb425f8-cff5-480e-b8a6-fcd15c9d2cf8 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:12.826637 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb425f8-cff5-480e-b8a6-fcd15c9d2cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:12.843858 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-bdb425f8-cff5-480e-b8a6-fcd15c9d2cf8 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:12.845076 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-bdb425f8-cff5-480e-b8a6-fcd15c9d2cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:12.911039 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1169/2347] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:12.920577 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495133c-de8b-4fb5-853c-86ea01ac16b2 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:12.922153 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d495133c-de8b-4fb5-853c-86ea01ac16b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:12.985357 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495133c-de8b-4fb5-853c-86ea01ac16b2 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:12.989530 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22136bae-483e-4458-ba20-131465cf5724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:12.990296 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22136bae-483e-4458-ba20-131465cf5724 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:12.990575 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22136bae-483e-4458-ba20-131465cf5724 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:12.990880 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22136bae-483e-4458-ba20-131465cf5724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:13.000442 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22136bae-483e-4458-ba20-131465cf5724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:13.002009 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22136bae-483e-4458-ba20-131465cf5724 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:13.012310 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1179/2348] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:19:13.286723 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb425f8-cff5-480e-b8a6-fcd15c9d2cf8 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:13.288186 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-bdb425f8-cff5-480e-b8a6-fcd15c9d2cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:13.300417 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb425f8-cff5-480e-b8a6-fcd15c9d2cf8 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:13.305119 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05b57f-47fe-4868-80ba-e3d3b8b52b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:13.305975 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05b57f-47fe-4868-80ba-e3d3b8b52b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:13.306263 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05b57f-47fe-4868-80ba-e3d3b8b52b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:13.306541 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05b57f-47fe-4868-80ba-e3d3b8b52b5c admin admin] PATH_INFO: `/v3/projects/3e60a7634de1477ba3cf20a285eb3efc` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:13.308338 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05b57f-47fe-4868-80ba-e3d3b8b52b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e60a7634de1477ba3cf20a285eb3efc)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:13.310618 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05b57f-47fe-4868-80ba-e3d3b8b52b5c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:13.373233 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0e05b57f-47fe-4868-80ba-e3d3b8b52b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e60a7634de1477ba3cf20a285eb3efc', 'request_id': 'req-0e05b57f-47fe-4868-80ba-e3d3b8b52b5c'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:13.382447 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0e05b57f-47fe-4868-80ba-e3d3b8b52b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e60a7634de1477ba3cf20a285eb3efc', 'request_id': 'req-0e05b57f-47fe-4868-80ba-e3d3b8b52b5c'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:13.388699 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0e05b57f-47fe-4868-80ba-e3d3b8b52b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e60a7634de1477ba3cf20a285eb3efc', 'request_id': 'req-0e05b57f-47fe-4868-80ba-e3d3b8b52b5c'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:13.399464 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0e05b57f-47fe-4868-80ba-e3d3b8b52b5c admin admin] The token cache is being invalidate because project 3e60a7634de1477ba3cf20a285eb3efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:19:13.399754 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0e05b57f-47fe-4868-80ba-e3d3b8b52b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:13.400444 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0e05b57f-47fe-4868-80ba-e3d3b8b52b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:13.402050 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1170/2349] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:19:13 2022] DELETE /identity/v3/projects/3e60a7634de1477ba3cf20a285eb3efc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:13.406979 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d264b-8a42-4c52-8058-59def8ab768d None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:13.407504 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d264b-8a42-4c52-8058-59def8ab768d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:13.407504 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d264b-8a42-4c52-8058-59def8ab768d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:13.425327 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-8f1d264b-8a42-4c52-8058-59def8ab768d None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:13.426488 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-8f1d264b-8a42-4c52-8058-59def8ab768d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:13.481709 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1180/2350] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:13.490518 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2d8b3-7fa7-4fe3-a1a7-63d3e9f6d555 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:13.490812 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2d8b3-7fa7-4fe3-a1a7-63d3e9f6d555 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:13.491113 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2d8b3-7fa7-4fe3-a1a7-63d3e9f6d555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:13.510067 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-bae2d8b3-7fa7-4fe3-a1a7-63d3e9f6d555 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:13.512111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-bae2d8b3-7fa7-4fe3-a1a7-63d3e9f6d555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:13.519864 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1171/2351] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:19:13.523945 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d264b-8a42-4c52-8058-59def8ab768d None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:13.533301 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d264b-8a42-4c52-8058-59def8ab768d None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:13.537676 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657529f-f896-48a8-9781-74d71b514b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:13.538311 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657529f-f896-48a8-9781-74d71b514b50 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:13.538591 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657529f-f896-48a8-9781-74d71b514b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:13.538864 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657529f-f896-48a8-9781-74d71b514b50 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:13.539589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657529f-f896-48a8-9781-74d71b514b50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:19:13.539933 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657529f-f896-48a8-9781-74d71b514b50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:13.541484 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657529f-f896-48a8-9781-74d71b514b50 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:13.553116 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1181/2352] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:19:13.557369 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2d8b3-7fa7-4fe3-a1a7-63d3e9f6d555 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:13.567059 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2d8b3-7fa7-4fe3-a1a7-63d3e9f6d555 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:13.571880 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e776b-2ac5-410a-859f-1258d570fd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:13.572579 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e776b-2ac5-410a-859f-1258d570fd29 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:13.572868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e776b-2ac5-410a-859f-1258d570fd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:13.573143 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e776b-2ac5-410a-859f-1258d570fd29 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:13.574165 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e776b-2ac5-410a-859f-1258d570fd29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:13.576090 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e776b-2ac5-410a-859f-1258d570fd29 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:13.599745 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1172/2353] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:19:13 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:19:13.603869 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657529f-f896-48a8-9781-74d71b514b50 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:13.614061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657529f-f896-48a8-9781-74d71b514b50 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:13.668731 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f8844-5f9a-487f-8c49-2f78e863135d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:13.669396 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f8844-5f9a-487f-8c49-2f78e863135d admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:13.669689 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f8844-5f9a-487f-8c49-2f78e863135d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:13.669997 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f8844-5f9a-487f-8c49-2f78e863135d admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:13.670802 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f8844-5f9a-487f-8c49-2f78e863135d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:13.672910 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f8844-5f9a-487f-8c49-2f78e863135d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:13.692585 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1182/2354] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:19:13 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:19:13.696675 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e776b-2ac5-410a-859f-1258d570fd29 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:13.706787 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e776b-2ac5-410a-859f-1258d570fd29 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:13.712108 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db2044-a198-4209-addc-98cde4c2aeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:13.712859 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db2044-a198-4209-addc-98cde4c2aeaf admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:13.713215 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db2044-a198-4209-addc-98cde4c2aeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:13.713522 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db2044-a198-4209-addc-98cde4c2aeaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:13.714514 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db2044-a198-4209-addc-98cde4c2aeaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:13.716200 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db2044-a198-4209-addc-98cde4c2aeaf admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:13.726452 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1173/2355] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:19:13.731065 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f8844-5f9a-487f-8c49-2f78e863135d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:13.740879 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f8844-5f9a-487f-8c49-2f78e863135d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:13.746644 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f18b6-89c7-469c-946a-a2854cd293f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:13.747322 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f18b6-89c7-469c-946a-a2854cd293f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:13.747609 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f18b6-89c7-469c-946a-a2854cd293f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:13.747931 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f18b6-89c7-469c-946a-a2854cd293f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:13.748726 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f18b6-89c7-469c-946a-a2854cd293f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:13.750443 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f18b6-89c7-469c-946a-a2854cd293f0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:13.760635 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1183/2356] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:19:13.765070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db2044-a198-4209-addc-98cde4c2aeaf admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:13.775369 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db2044-a198-4209-addc-98cde4c2aeaf admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:13.780653 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09734a64-1336-4166-9377-78d5552b1b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:13.781531 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09734a64-1336-4166-9377-78d5552b1b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:13.781810 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09734a64-1336-4166-9377-78d5552b1b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:13.782083 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09734a64-1336-4166-9377-78d5552b1b4a admin admin] PATH_INFO: `/v3/projects/9b3aa84df3554cfc86888a3c37460687/users/ab7e0c67b9c641bb94748b139548d8e2/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:13.796821 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09734a64-1336-4166-9377-78d5552b1b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3aa84df3554cfc86888a3c37460687, user_id=ab7e0c67b9c641bb94748b139548d8e2, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:13.799355 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09734a64-1336-4166-9377-78d5552b1b4a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:13.812400 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1174/2357] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:19:13 2022] PUT /identity/v3/projects/9b3aa84df3554cfc86888a3c37460687/users/ab7e0c67b9c641bb94748b139548d8e2/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:13.822452 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66029657-2907-4fd8-96be-f5b03d5f2033 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:13.822742 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66029657-2907-4fd8-96be-f5b03d5f2033 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:13.823017 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66029657-2907-4fd8-96be-f5b03d5f2033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:13.850034 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-66029657-2907-4fd8-96be-f5b03d5f2033 None None] MFA Rules not processed for user `ab7e0c67b9c641bb94748b139548d8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:13.851235 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-66029657-2907-4fd8-96be-f5b03d5f2033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:13.913322 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1184/2358] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:13.918259 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09734a64-1336-4166-9377-78d5552b1b4a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:13.978187 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09734a64-1336-4166-9377-78d5552b1b4a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:13.983522 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8eeea-5abf-4fb1-90e6-f14a75c7973a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:13.984219 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8eeea-5abf-4fb1-90e6-f14a75c7973a admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:13.984502 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8eeea-5abf-4fb1-90e6-f14a75c7973a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:13.984775 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8eeea-5abf-4fb1-90e6-f14a75c7973a admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:13.985463 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8eeea-5abf-4fb1-90e6-f14a75c7973a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:13.987337 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8eeea-5abf-4fb1-90e6-f14a75c7973a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:14.014068 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1175/2359] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:19:13 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:19:14.018214 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66029657-2907-4fd8-96be-f5b03d5f2033 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:14.029217 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66029657-2907-4fd8-96be-f5b03d5f2033 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:14.089975 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05cb25-b6f4-4595-9475-d584fe5af858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:14.090666 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05cb25-b6f4-4595-9475-d584fe5af858 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:14.090981 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05cb25-b6f4-4595-9475-d584fe5af858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:14.091283 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05cb25-b6f4-4595-9475-d584fe5af858 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:14.092038 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05cb25-b6f4-4595-9475-d584fe5af858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:14.094121 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05cb25-b6f4-4595-9475-d584fe5af858 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:14.114424 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1185/2360] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:19:14 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:19:14.118633 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8eeea-5abf-4fb1-90e6-f14a75c7973a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:14.131023 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8eeea-5abf-4fb1-90e6-f14a75c7973a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:14.135538 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697ce51-3618-4458-8ed7-d86ddf8db5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:14.136891 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697ce51-3618-4458-8ed7-d86ddf8db5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:14.137171 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697ce51-3618-4458-8ed7-d86ddf8db5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:14.137441 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697ce51-3618-4458-8ed7-d86ddf8db5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:14.138166 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697ce51-3618-4458-8ed7-d86ddf8db5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:14.139784 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697ce51-3618-4458-8ed7-d86ddf8db5d9 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:14.150562 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1176/2361] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:19:14.155410 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05cb25-b6f4-4595-9475-d584fe5af858 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:14.165081 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05cb25-b6f4-4595-9475-d584fe5af858 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:14.171319 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b462a2-2041-4934-94bc-d0c3ed2c8980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:14.172226 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b462a2-2041-4934-94bc-d0c3ed2c8980 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:14.172630 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b462a2-2041-4934-94bc-d0c3ed2c8980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:14.172914 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b462a2-2041-4934-94bc-d0c3ed2c8980 admin admin] PATH_INFO: `/v3/projects/1f9f9c24f4ec44af8da5b1861758c6b8/users/eee1dd9fa6f548ce8f917ee9cb393f3e/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:14.197657 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b462a2-2041-4934-94bc-d0c3ed2c8980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9f9c24f4ec44af8da5b1861758c6b8, user_id=eee1dd9fa6f548ce8f917ee9cb393f3e, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:14.200778 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b462a2-2041-4934-94bc-d0c3ed2c8980 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:14.217129 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1186/2362] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:19:14 2022] PUT /identity/v3/projects/1f9f9c24f4ec44af8da5b1861758c6b8/users/eee1dd9fa6f548ce8f917ee9cb393f3e/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:14.220869 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697ce51-3618-4458-8ed7-d86ddf8db5d9 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:14.233798 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697ce51-3618-4458-8ed7-d86ddf8db5d9 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:14.290919 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a268d-b1ed-44e4-a4e2-2577f454928b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:14.291787 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a268d-b1ed-44e4-a4e2-2577f454928b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:14.292237 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a268d-b1ed-44e4-a4e2-2577f454928b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:14.293242 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a268d-b1ed-44e4-a4e2-2577f454928b admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:14.294005 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a268d-b1ed-44e4-a4e2-2577f454928b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:14.295696 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a268d-b1ed-44e4-a4e2-2577f454928b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:14.305746 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1177/2363] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:19:14.310287 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b462a2-2041-4934-94bc-d0c3ed2c8980 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:14.320365 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b462a2-2041-4934-94bc-d0c3ed2c8980 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:14.325704 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8754a13-e9df-438a-9879-c562ea3e0a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:14.326566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8754a13-e9df-438a-9879-c562ea3e0a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:14.326849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8754a13-e9df-438a-9879-c562ea3e0a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:14.327123 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8754a13-e9df-438a-9879-c562ea3e0a5d admin admin] PATH_INFO: `/v3/projects/1f9f9c24f4ec44af8da5b1861758c6b8/users/eee1dd9fa6f548ce8f917ee9cb393f3e/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:14.329052 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8754a13-e9df-438a-9879-c562ea3e0a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9f9c24f4ec44af8da5b1861758c6b8, user_id=eee1dd9fa6f548ce8f917ee9cb393f3e, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:14.331653 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8754a13-e9df-438a-9879-c562ea3e0a5d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:14.342970 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1187/2364] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:19:14 2022] PUT /identity/v3/projects/1f9f9c24f4ec44af8da5b1861758c6b8/users/eee1dd9fa6f548ce8f917ee9cb393f3e/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:19:14.352863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e130491-f915-4aa4-8766-4598884cba3a None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:14.353150 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e130491-f915-4aa4-8766-4598884cba3a None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:14.353447 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e130491-f915-4aa4-8766-4598884cba3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:14.381351 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-1e130491-f915-4aa4-8766-4598884cba3a None None] MFA Rules not processed for user `eee1dd9fa6f548ce8f917ee9cb393f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:14.382580 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-1e130491-f915-4aa4-8766-4598884cba3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:14.449800 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1178/2365] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:14.460229 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8754a13-e9df-438a-9879-c562ea3e0a5d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:14.462007 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-f8754a13-e9df-438a-9879-c562ea3e0a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:14.520459 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8754a13-e9df-438a-9879-c562ea3e0a5d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:14.524064 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da418d4-4f11-4969-b79c-101ac69e43e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:14.524705 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da418d4-4f11-4969-b79c-101ac69e43e7 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:14.524993 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da418d4-4f11-4969-b79c-101ac69e43e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:14.525268 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da418d4-4f11-4969-b79c-101ac69e43e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:14.535071 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da418d4-4f11-4969-b79c-101ac69e43e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:14.536603 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da418d4-4f11-4969-b79c-101ac69e43e7 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:14.547937 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1188/2366] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:19:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:19:14.899006 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e130491-f915-4aa4-8766-4598884cba3a None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:14.959218 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e130491-f915-4aa4-8766-4598884cba3a None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:14.963718 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f677d-23a4-490e-b615-65dbbcac7596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:14.964725 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f677d-23a4-490e-b615-65dbbcac7596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:14.965009 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f677d-23a4-490e-b615-65dbbcac7596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:14.965293 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f677d-23a4-490e-b615-65dbbcac7596 admin admin] PATH_INFO: `/v3/users/ab7e0c67b9c641bb94748b139548d8e2` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:14.966482 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f677d-23a4-490e-b615-65dbbcac7596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7e0c67b9c641bb94748b139548d8e2)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:14.968438 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f677d-23a4-490e-b615-65dbbcac7596 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:15.013543 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-b26f677d-23a4-490e-b615-65dbbcac7596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7e0c67b9c641bb94748b139548d8e2'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:15.024931 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-b26f677d-23a4-490e-b615-65dbbcac7596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7e0c67b9c641bb94748b139548d8e2'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:15.025578 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-b26f677d-23a4-490e-b615-65dbbcac7596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7e0c67b9c641bb94748b139548d8e2'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:15.026172 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-b26f677d-23a4-490e-b615-65dbbcac7596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7e0c67b9c641bb94748b139548d8e2'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:15.032861 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-b26f677d-23a4-490e-b615-65dbbcac7596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7e0c67b9c641bb94748b139548d8e2'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:15.045034 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1179/2367] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:19:14 2022] DELETE /identity/v3/users/ab7e0c67b9c641bb94748b139548d8e2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:19:15.049497 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba900593-21e7-4ae6-9b13-6a30e88c902d None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:15.049789 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba900593-21e7-4ae6-9b13-6a30e88c902d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:15.050066 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba900593-21e7-4ae6-9b13-6a30e88c902d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:15.067725 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-ba900593-21e7-4ae6-9b13-6a30e88c902d None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:15.068964 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-ba900593-21e7-4ae6-9b13-6a30e88c902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:15.126240 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1189/2368] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:15.136136 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f677d-23a4-490e-b615-65dbbcac7596 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:15.137655 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-b26f677d-23a4-490e-b615-65dbbcac7596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:15.192878 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f677d-23a4-490e-b615-65dbbcac7596 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:15.196491 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2eff75-1c37-431f-a211-a824ab9d4724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:15.197133 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2eff75-1c37-431f-a211-a824ab9d4724 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:15.197420 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2eff75-1c37-431f-a211-a824ab9d4724 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:15.197701 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2eff75-1c37-431f-a211-a824ab9d4724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:15.206890 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2eff75-1c37-431f-a211-a824ab9d4724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:15.208608 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2eff75-1c37-431f-a211-a824ab9d4724 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:15.218898 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1180/2369] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:19:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:19:15.498220 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba900593-21e7-4ae6-9b13-6a30e88c902d None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:15.499748 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-ba900593-21e7-4ae6-9b13-6a30e88c902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:15.517805 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba900593-21e7-4ae6-9b13-6a30e88c902d None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:15.522805 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29ce5e-8288-4a09-95c6-c3965c565587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:15.523666 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29ce5e-8288-4a09-95c6-c3965c565587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:15.524065 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29ce5e-8288-4a09-95c6-c3965c565587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:15.524314 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29ce5e-8288-4a09-95c6-c3965c565587 admin admin] PATH_INFO: `/v3/projects/9b3aa84df3554cfc86888a3c37460687` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:15.525427 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29ce5e-8288-4a09-95c6-c3965c565587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b3aa84df3554cfc86888a3c37460687)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:15.527733 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29ce5e-8288-4a09-95c6-c3965c565587 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:15.576083 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-3b29ce5e-8288-4a09-95c6-c3965c565587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b3aa84df3554cfc86888a3c37460687', 'request_id': 'req-3b29ce5e-8288-4a09-95c6-c3965c565587'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:15.581364 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-3b29ce5e-8288-4a09-95c6-c3965c565587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b3aa84df3554cfc86888a3c37460687', 'request_id': 'req-3b29ce5e-8288-4a09-95c6-c3965c565587'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:15.587205 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-3b29ce5e-8288-4a09-95c6-c3965c565587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b3aa84df3554cfc86888a3c37460687', 'request_id': 'req-3b29ce5e-8288-4a09-95c6-c3965c565587'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:15.599188 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-3b29ce5e-8288-4a09-95c6-c3965c565587 admin admin] The token cache is being invalidate because project 9b3aa84df3554cfc86888a3c37460687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:19:15.599473 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-3b29ce5e-8288-4a09-95c6-c3965c565587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:15.600111 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-3b29ce5e-8288-4a09-95c6-c3965c565587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:15.601854 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1190/2370] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:19:15 2022] DELETE /identity/v3/projects/9b3aa84df3554cfc86888a3c37460687 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:15.605571 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2eff75-1c37-431f-a211-a824ab9d4724 service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:15.614854 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2eff75-1c37-431f-a211-a824ab9d4724 service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:15.672921 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccea3fa-383b-4c73-a6fc-c7aed4265be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:15.673920 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccea3fa-383b-4c73-a6fc-c7aed4265be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:15.674195 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccea3fa-383b-4c73-a6fc-c7aed4265be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:15.674661 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccea3fa-383b-4c73-a6fc-c7aed4265be1 admin admin] PATH_INFO: `/v3/users/eee1dd9fa6f548ce8f917ee9cb393f3e` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:15.676057 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccea3fa-383b-4c73-a6fc-c7aed4265be1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eee1dd9fa6f548ce8f917ee9cb393f3e)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:15.678337 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccea3fa-383b-4c73-a6fc-c7aed4265be1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:15.729472 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cccea3fa-383b-4c73-a6fc-c7aed4265be1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eee1dd9fa6f548ce8f917ee9cb393f3e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:15.742678 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cccea3fa-383b-4c73-a6fc-c7aed4265be1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eee1dd9fa6f548ce8f917ee9cb393f3e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:15.743476 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cccea3fa-383b-4c73-a6fc-c7aed4265be1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eee1dd9fa6f548ce8f917ee9cb393f3e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:15.744112 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cccea3fa-383b-4c73-a6fc-c7aed4265be1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eee1dd9fa6f548ce8f917ee9cb393f3e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:15.751670 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cccea3fa-383b-4c73-a6fc-c7aed4265be1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eee1dd9fa6f548ce8f917ee9cb393f3e'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:15.765924 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1181/2371] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:19:15 2022] DELETE /identity/v3/users/eee1dd9fa6f548ce8f917ee9cb393f3e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:16.037625 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29ce5e-8288-4a09-95c6-c3965c565587 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:16.039102 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-3b29ce5e-8288-4a09-95c6-c3965c565587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:16.052036 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29ce5e-8288-4a09-95c6-c3965c565587 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:16.108293 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce41413-69f5-4d65-b20f-44589d514928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:16.109259 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce41413-69f5-4d65-b20f-44589d514928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:16.109534 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce41413-69f5-4d65-b20f-44589d514928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:16.109799 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce41413-69f5-4d65-b20f-44589d514928 admin admin] PATH_INFO: `/v3/projects/1f9f9c24f4ec44af8da5b1861758c6b8` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:16.110997 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce41413-69f5-4d65-b20f-44589d514928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f9f9c24f4ec44af8da5b1861758c6b8)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:16.112977 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce41413-69f5-4d65-b20f-44589d514928 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:16.156703 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5ce41413-69f5-4d65-b20f-44589d514928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f9f9c24f4ec44af8da5b1861758c6b8', 'request_id': 'req-5ce41413-69f5-4d65-b20f-44589d514928'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:16.161817 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5ce41413-69f5-4d65-b20f-44589d514928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f9f9c24f4ec44af8da5b1861758c6b8', 'request_id': 'req-5ce41413-69f5-4d65-b20f-44589d514928'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:16.167567 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5ce41413-69f5-4d65-b20f-44589d514928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f9f9c24f4ec44af8da5b1861758c6b8', 'request_id': 'req-5ce41413-69f5-4d65-b20f-44589d514928'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:16.179406 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5ce41413-69f5-4d65-b20f-44589d514928 admin admin] The token cache is being invalidate because project 1f9f9c24f4ec44af8da5b1861758c6b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:19:16.179695 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5ce41413-69f5-4d65-b20f-44589d514928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:16.180350 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5ce41413-69f5-4d65-b20f-44589d514928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:16.181897 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1191/2372] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:19:16 2022] DELETE /identity/v3/projects/1f9f9c24f4ec44af8da5b1861758c6b8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:16.187443 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b37d2-4093-4112-8c67-e5eb7127ec22 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:16.187737 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b37d2-4093-4112-8c67-e5eb7127ec22 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:16.188050 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b37d2-4093-4112-8c67-e5eb7127ec22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:16.208285 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-ed4b37d2-4093-4112-8c67-e5eb7127ec22 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:16.209536 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-ed4b37d2-4093-4112-8c67-e5eb7127ec22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:16.266968 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1182/2373] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:16.275977 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45726b7-77a2-428d-9bb3-77d8a0d4fbdb None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:16.276268 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45726b7-77a2-428d-9bb3-77d8a0d4fbdb None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:16.276545 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45726b7-77a2-428d-9bb3-77d8a0d4fbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:16.294707 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-d45726b7-77a2-428d-9bb3-77d8a0d4fbdb None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:16.295900 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d45726b7-77a2-428d-9bb3-77d8a0d4fbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:16.303437 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1192/2374] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:16.307416 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b37d2-4093-4112-8c67-e5eb7127ec22 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:16.317620 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b37d2-4093-4112-8c67-e5eb7127ec22 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:16.322178 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225dc71-00aa-4727-9c58-28c14e61d1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:16.322816 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225dc71-00aa-4727-9c58-28c14e61d1de admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:16.323101 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225dc71-00aa-4727-9c58-28c14e61d1de admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:16.324005 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225dc71-00aa-4727-9c58-28c14e61d1de admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:16.324932 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225dc71-00aa-4727-9c58-28c14e61d1de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:19:16.325238 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225dc71-00aa-4727-9c58-28c14e61d1de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:16.326805 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225dc71-00aa-4727-9c58-28c14e61d1de admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:16.338115 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1183/2375] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:19:16.342316 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45726b7-77a2-428d-9bb3-77d8a0d4fbdb None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:16.351207 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45726b7-77a2-428d-9bb3-77d8a0d4fbdb None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:16.355757 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a01e9-9f21-4eaf-ac54-ee4f6b5dea05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:16.356422 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a01e9-9f21-4eaf-ac54-ee4f6b5dea05 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:16.356702 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a01e9-9f21-4eaf-ac54-ee4f6b5dea05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:16.356973 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a01e9-9f21-4eaf-ac54-ee4f6b5dea05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:16.357672 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a01e9-9f21-4eaf-ac54-ee4f6b5dea05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:16.359525 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a01e9-9f21-4eaf-ac54-ee4f6b5dea05 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:16.387099 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1193/2376] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:19:16 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:19:16.391061 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225dc71-00aa-4727-9c58-28c14e61d1de admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:16.400768 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225dc71-00aa-4727-9c58-28c14e61d1de admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:16.455177 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d09ba-719e-4849-af11-dfd55697582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:16.455855 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d09ba-719e-4849-af11-dfd55697582e admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:16.456141 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d09ba-719e-4849-af11-dfd55697582e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:16.456418 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d09ba-719e-4849-af11-dfd55697582e admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:16.457169 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d09ba-719e-4849-af11-dfd55697582e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:16.459088 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d09ba-719e-4849-af11-dfd55697582e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:16.478392 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1184/2377] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:19:16 2022] POST /identity/v3/users => generated 284 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:19:16.482579 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a01e9-9f21-4eaf-ac54-ee4f6b5dea05 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:16.492600 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a01e9-9f21-4eaf-ac54-ee4f6b5dea05 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:16.498178 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791a26a-01a3-4ed4-bfba-98f18f238d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:16.498827 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791a26a-01a3-4ed4-bfba-98f18f238d90 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:16.499383 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791a26a-01a3-4ed4-bfba-98f18f238d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:16.499383 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791a26a-01a3-4ed4-bfba-98f18f238d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:16.500133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791a26a-01a3-4ed4-bfba-98f18f238d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:16.501707 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791a26a-01a3-4ed4-bfba-98f18f238d90 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:16.512619 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1194/2378] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:19:16.516340 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d09ba-719e-4849-af11-dfd55697582e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:16.526112 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d09ba-719e-4849-af11-dfd55697582e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:16.533307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae2697-ff1b-482d-9c45-d395509fc211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:16.533970 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae2697-ff1b-482d-9c45-d395509fc211 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:16.534254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae2697-ff1b-482d-9c45-d395509fc211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:16.534639 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae2697-ff1b-482d-9c45-d395509fc211 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:16.535377 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae2697-ff1b-482d-9c45-d395509fc211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:16.537448 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae2697-ff1b-482d-9c45-d395509fc211 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:16.548165 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1185/2379] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:19:16.552384 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791a26a-01a3-4ed4-bfba-98f18f238d90 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:16.562876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791a26a-01a3-4ed4-bfba-98f18f238d90 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:16.568096 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741340e-c710-43d0-a877-d978b68ebe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:16.568967 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741340e-c710-43d0-a877-d978b68ebe14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:16.569249 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741340e-c710-43d0-a877-d978b68ebe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:16.569527 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741340e-c710-43d0-a877-d978b68ebe14 admin admin] PATH_INFO: `/v3/projects/7ca4b0cdcc4446dd8a60e086caaf3ed6/users/74b1854298bf490c9e1fd170a809c8ef/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:16.587777 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741340e-c710-43d0-a877-d978b68ebe14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca4b0cdcc4446dd8a60e086caaf3ed6, user_id=74b1854298bf490c9e1fd170a809c8ef, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:16.590800 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741340e-c710-43d0-a877-d978b68ebe14 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:16.604203 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1195/2380] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:19:16 2022] PUT /identity/v3/projects/7ca4b0cdcc4446dd8a60e086caaf3ed6/users/74b1854298bf490c9e1fd170a809c8ef/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:19:16.614904 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec1c89-9a78-4727-9c17-a7fd99819605 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:16.615438 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec1c89-9a78-4727-9c17-a7fd99819605 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:16.615438 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec1c89-9a78-4727-9c17-a7fd99819605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:16.644133 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-a0ec1c89-9a78-4727-9c17-a7fd99819605 None None] MFA Rules not processed for user `74b1854298bf490c9e1fd170a809c8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:16.645368 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a0ec1c89-9a78-4727-9c17-a7fd99819605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:16.664661 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741340e-c710-43d0-a877-d978b68ebe14 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:16.666369 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a741340e-c710-43d0-a877-d978b68ebe14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:16.710202 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1186/2381] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:16.715465 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec1c89-9a78-4727-9c17-a7fd99819605 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:16.729319 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741340e-c710-43d0-a877-d978b68ebe14 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:16.734814 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4715fdd-bfcb-4daa-88de-a00fdba230ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:16.735673 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4715fdd-bfcb-4daa-88de-a00fdba230ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:16.735992 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4715fdd-bfcb-4daa-88de-a00fdba230ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:16.736273 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4715fdd-bfcb-4daa-88de-a00fdba230ac admin admin] PATH_INFO: `/v3/users/1112991287a64214923c680697952b46` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:16.737482 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4715fdd-bfcb-4daa-88de-a00fdba230ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1112991287a64214923c680697952b46)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:16.739383 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4715fdd-bfcb-4daa-88de-a00fdba230ac admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:16.777385 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec1c89-9a78-4727-9c17-a7fd99819605 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:16.782145 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f1290-2e04-4e6d-9f1f-90c4bdc7422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:16.782992 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f1290-2e04-4e6d-9f1f-90c4bdc7422b admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:16.783142 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f1290-2e04-4e6d-9f1f-90c4bdc7422b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:16.783418 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f1290-2e04-4e6d-9f1f-90c4bdc7422b admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:16.784176 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f1290-2e04-4e6d-9f1f-90c4bdc7422b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:16.786063 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f1290-2e04-4e6d-9f1f-90c4bdc7422b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:16.789149 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f4715fdd-bfcb-4daa-88de-a00fdba230ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1112991287a64214923c680697952b46'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:16.801609 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f4715fdd-bfcb-4daa-88de-a00fdba230ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1112991287a64214923c680697952b46'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:16.802330 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f4715fdd-bfcb-4daa-88de-a00fdba230ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1112991287a64214923c680697952b46'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:16.810632 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f4715fdd-bfcb-4daa-88de-a00fdba230ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1112991287a64214923c680697952b46'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:16.811360 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f4715fdd-bfcb-4daa-88de-a00fdba230ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1112991287a64214923c680697952b46'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:16.816886 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1187/2382] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:19:16 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:19:16.820732 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f1290-2e04-4e6d-9f1f-90c4bdc7422b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:16.822468 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-366f1290-2e04-4e6d-9f1f-90c4bdc7422b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:16.827742 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1196/2383] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:19:16 2022] DELETE /identity/v3/users/1112991287a64214923c680697952b46 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:19:16.829824 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06710126-196d-4b0d-bcb1-f481068afd49 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:16.830117 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06710126-196d-4b0d-bcb1-f481068afd49 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:16.830473 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06710126-196d-4b0d-bcb1-f481068afd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:16.849712 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-06710126-196d-4b0d-bcb1-f481068afd49 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:16.850996 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-06710126-196d-4b0d-bcb1-f481068afd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:16.891063 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f1290-2e04-4e6d-9f1f-90c4bdc7422b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:16.915561 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1197/2384] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:19:16.929109 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06710126-196d-4b0d-bcb1-f481068afd49 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:16.930449 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-06710126-196d-4b0d-bcb1-f481068afd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:16.952965 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df840e9-e967-4916-b036-1145f35cf836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:16.953641 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df840e9-e967-4916-b036-1145f35cf836 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:16.953923 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df840e9-e967-4916-b036-1145f35cf836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:16.954198 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df840e9-e967-4916-b036-1145f35cf836 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:16.954893 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df840e9-e967-4916-b036-1145f35cf836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:16.956877 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df840e9-e967-4916-b036-1145f35cf836 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:16.977155 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1188/2385] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:19:16 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:19:16.981770 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df840e9-e967-4916-b036-1145f35cf836 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:16.988485 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06710126-196d-4b0d-bcb1-f481068afd49 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:16.991297 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df840e9-e967-4916-b036-1145f35cf836 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:16.992050 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae5300-95ca-4836-8768-1d18b196efeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:16.992684 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae5300-95ca-4836-8768-1d18b196efeb service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:16.992963 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae5300-95ca-4836-8768-1d18b196efeb service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:16.993233 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae5300-95ca-4836-8768-1d18b196efeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:16.997205 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42298987-6306-49ff-9a07-a70c20516386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:16.997844 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42298987-6306-49ff-9a07-a70c20516386 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:16.998125 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42298987-6306-49ff-9a07-a70c20516386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:16.998399 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42298987-6306-49ff-9a07-a70c20516386 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:16.999130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42298987-6306-49ff-9a07-a70c20516386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:17.000818 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42298987-6306-49ff-9a07-a70c20516386 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:17.003640 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae5300-95ca-4836-8768-1d18b196efeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:17.005250 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae5300-95ca-4836-8768-1d18b196efeb service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:17.015632 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1189/2386] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:19:17.015795 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1198/2387] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:19:17.016983 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42298987-6306-49ff-9a07-a70c20516386 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:17.026862 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42298987-6306-49ff-9a07-a70c20516386 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:17.031731 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3393b-bdeb-4a1a-8727-07a6031c44d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:17.032651 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3393b-bdeb-4a1a-8727-07a6031c44d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:17.032938 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3393b-bdeb-4a1a-8727-07a6031c44d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:17.033242 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3393b-bdeb-4a1a-8727-07a6031c44d7 admin admin] PATH_INFO: `/v3/projects/a7e756cc7451440792b86cab0b940f13/users/5822058dbac34d6cbb42d9f0cafd0e7f/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:17.047659 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3393b-bdeb-4a1a-8727-07a6031c44d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e756cc7451440792b86cab0b940f13, user_id=5822058dbac34d6cbb42d9f0cafd0e7f, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:17.050346 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3393b-bdeb-4a1a-8727-07a6031c44d7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:17.064366 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1190/2388] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:19:17 2022] PUT /identity/v3/projects/a7e756cc7451440792b86cab0b940f13/users/5822058dbac34d6cbb42d9f0cafd0e7f/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:19:17.068448 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae5300-95ca-4836-8768-1d18b196efeb service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:17.086074 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae5300-95ca-4836-8768-1d18b196efeb service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:17.143094 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425f355-c61a-4b8a-b425-7ebf83569565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:17.143785 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425f355-c61a-4b8a-b425-7ebf83569565 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:17.144144 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425f355-c61a-4b8a-b425-7ebf83569565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:17.144419 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425f355-c61a-4b8a-b425-7ebf83569565 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:17.145150 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425f355-c61a-4b8a-b425-7ebf83569565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:17.146719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425f355-c61a-4b8a-b425-7ebf83569565 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:17.157175 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1199/2389] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:19:17.161224 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3393b-bdeb-4a1a-8727-07a6031c44d7 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:17.172760 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3393b-bdeb-4a1a-8727-07a6031c44d7 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:17.177597 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ef5c7-f1b0-47f8-ac20-efa5077cc8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:17.178550 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ef5c7-f1b0-47f8-ac20-efa5077cc8c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:17.178905 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ef5c7-f1b0-47f8-ac20-efa5077cc8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:17.179250 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ef5c7-f1b0-47f8-ac20-efa5077cc8c7 admin admin] PATH_INFO: `/v3/projects/a7e756cc7451440792b86cab0b940f13/users/5822058dbac34d6cbb42d9f0cafd0e7f/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:17.181368 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ef5c7-f1b0-47f8-ac20-efa5077cc8c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e756cc7451440792b86cab0b940f13, user_id=5822058dbac34d6cbb42d9f0cafd0e7f, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:17.184246 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ef5c7-f1b0-47f8-ac20-efa5077cc8c7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:17.194940 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1191/2390] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:19:17 2022] PUT /identity/v3/projects/a7e756cc7451440792b86cab0b940f13/users/5822058dbac34d6cbb42d9f0cafd0e7f/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:17.204947 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaa9bd-7ce6-41aa-b0ec-444d85535409 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:17.205237 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaa9bd-7ce6-41aa-b0ec-444d85535409 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:17.205511 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaa9bd-7ce6-41aa-b0ec-444d85535409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:17.236814 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-ebdaa9bd-7ce6-41aa-b0ec-444d85535409 None None] MFA Rules not processed for user `5822058dbac34d6cbb42d9f0cafd0e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:17.238079 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-ebdaa9bd-7ce6-41aa-b0ec-444d85535409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:17.296289 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ef5c7-f1b0-47f8-ac20-efa5077cc8c7 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:17.298871 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-ac5ef5c7-f1b0-47f8-ac20-efa5077cc8c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:17.310089 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1200/2391] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:17 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:17.320455 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaa9bd-7ce6-41aa-b0ec-444d85535409 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:17.322051 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-ebdaa9bd-7ce6-41aa-b0ec-444d85535409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:17.372165 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ef5c7-f1b0-47f8-ac20-efa5077cc8c7 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:17.377782 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c289e8-f852-4d52-bcd9-025b5002760a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:17.378772 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c289e8-f852-4d52-bcd9-025b5002760a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:17.379057 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c289e8-f852-4d52-bcd9-025b5002760a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:17.379329 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c289e8-f852-4d52-bcd9-025b5002760a admin admin] PATH_INFO: `/v3/projects/b4d1f27d3c6a48b69190643a86f672e4` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:17.379453 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaa9bd-7ce6-41aa-b0ec-444d85535409 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:17.380586 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c289e8-f852-4d52-bcd9-025b5002760a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4d1f27d3c6a48b69190643a86f672e4)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:17.382601 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c289e8-f852-4d52-bcd9-025b5002760a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:17.383465 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cef6f-9d48-4984-9f22-8b64d1beab7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:17.384121 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cef6f-9d48-4984-9f22-8b64d1beab7e service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:17.384407 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cef6f-9d48-4984-9f22-8b64d1beab7e service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:17.384686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cef6f-9d48-4984-9f22-8b64d1beab7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:17.394884 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cef6f-9d48-4984-9f22-8b64d1beab7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:17.396366 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cef6f-9d48-4984-9f22-8b64d1beab7e service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:17.406625 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1201/2392] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:19:17 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:19:17.430463 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-34c289e8-f852-4d52-bcd9-025b5002760a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4d1f27d3c6a48b69190643a86f672e4', 'request_id': 'req-34c289e8-f852-4d52-bcd9-025b5002760a'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:17.437950 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-34c289e8-f852-4d52-bcd9-025b5002760a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4d1f27d3c6a48b69190643a86f672e4', 'request_id': 'req-34c289e8-f852-4d52-bcd9-025b5002760a'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:17.443511 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-34c289e8-f852-4d52-bcd9-025b5002760a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4d1f27d3c6a48b69190643a86f672e4', 'request_id': 'req-34c289e8-f852-4d52-bcd9-025b5002760a'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:17.455251 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-34c289e8-f852-4d52-bcd9-025b5002760a admin admin] The token cache is being invalidate because project b4d1f27d3c6a48b69190643a86f672e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:19:17.455538 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-34c289e8-f852-4d52-bcd9-025b5002760a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:17.456226 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-34c289e8-f852-4d52-bcd9-025b5002760a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:17.457759 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1192/2393] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:19:17 2022] DELETE /identity/v3/projects/b4d1f27d3c6a48b69190643a86f672e4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:19:17.461973 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cef6f-9d48-4984-9f22-8b64d1beab7e service cinder] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:17.473567 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cef6f-9d48-4984-9f22-8b64d1beab7e service cinder] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:17.534232 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422c5fa-8f93-4e51-b4ba-8d3a21fb10cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:17.535095 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422c5fa-8f93-4e51-b4ba-8d3a21fb10cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:17.535388 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422c5fa-8f93-4e51-b4ba-8d3a21fb10cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:17.535662 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422c5fa-8f93-4e51-b4ba-8d3a21fb10cc admin admin] PATH_INFO: `/v3/users/b1b697956a1d4bf194066de89952ea53` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:17.536908 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422c5fa-8f93-4e51-b4ba-8d3a21fb10cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1b697956a1d4bf194066de89952ea53)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:17.538818 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422c5fa-8f93-4e51-b4ba-8d3a21fb10cc admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:17.587834 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c422c5fa-8f93-4e51-b4ba-8d3a21fb10cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1b697956a1d4bf194066de89952ea53'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:17.603252 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c422c5fa-8f93-4e51-b4ba-8d3a21fb10cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1b697956a1d4bf194066de89952ea53'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:17.604313 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c422c5fa-8f93-4e51-b4ba-8d3a21fb10cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1b697956a1d4bf194066de89952ea53'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:17.612720 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c422c5fa-8f93-4e51-b4ba-8d3a21fb10cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1b697956a1d4bf194066de89952ea53'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:17.613466 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c422c5fa-8f93-4e51-b4ba-8d3a21fb10cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1b697956a1d4bf194066de89952ea53'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:17.626410 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1202/2394] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:19:17 2022] DELETE /identity/v3/users/b1b697956a1d4bf194066de89952ea53 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:17.911412 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c289e8-f852-4d52-bcd9-025b5002760a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:17.912962 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-34c289e8-f852-4d52-bcd9-025b5002760a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:17.935480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c289e8-f852-4d52-bcd9-025b5002760a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:18.004626 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb753fa-c9db-4036-8bb3-0e07d7de1e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:18.005533 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb753fa-c9db-4036-8bb3-0e07d7de1e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:18.005848 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb753fa-c9db-4036-8bb3-0e07d7de1e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:18.006118 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb753fa-c9db-4036-8bb3-0e07d7de1e51 admin admin] PATH_INFO: `/v3/projects/c5ce72f5d03246ec93cbc1a811aa5e25` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:18.007331 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb753fa-c9db-4036-8bb3-0e07d7de1e51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ce72f5d03246ec93cbc1a811aa5e25)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:18.009302 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb753fa-c9db-4036-8bb3-0e07d7de1e51 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:18.065309 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ecb753fa-c9db-4036-8bb3-0e07d7de1e51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ce72f5d03246ec93cbc1a811aa5e25', 'request_id': 'req-ecb753fa-c9db-4036-8bb3-0e07d7de1e51'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:18.074983 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ecb753fa-c9db-4036-8bb3-0e07d7de1e51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ce72f5d03246ec93cbc1a811aa5e25', 'request_id': 'req-ecb753fa-c9db-4036-8bb3-0e07d7de1e51'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:18.082053 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ecb753fa-c9db-4036-8bb3-0e07d7de1e51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ce72f5d03246ec93cbc1a811aa5e25', 'request_id': 'req-ecb753fa-c9db-4036-8bb3-0e07d7de1e51'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:18.095853 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ecb753fa-c9db-4036-8bb3-0e07d7de1e51 admin admin] The token cache is being invalidate because project c5ce72f5d03246ec93cbc1a811aa5e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:19:18.096157 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ecb753fa-c9db-4036-8bb3-0e07d7de1e51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:18.097268 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ecb753fa-c9db-4036-8bb3-0e07d7de1e51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:18.098632 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1193/2395] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:19:17 2022] DELETE /identity/v3/projects/c5ce72f5d03246ec93cbc1a811aa5e25 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:19:18.103296 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7a858-0d3e-4f61-9fa3-f372608536aa None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:18.103592 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7a858-0d3e-4f61-9fa3-f372608536aa None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:18.103916 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7a858-0d3e-4f61-9fa3-f372608536aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:18.125190 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-d6f7a858-0d3e-4f61-9fa3-f372608536aa None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:18.126906 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d6f7a858-0d3e-4f61-9fa3-f372608536aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:18.191970 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1203/2396] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:18.195642 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69e6da-d18a-4d6f-ad6d-38fd07e34e16 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:18.195983 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69e6da-d18a-4d6f-ad6d-38fd07e34e16 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:18.196263 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69e6da-d18a-4d6f-ad6d-38fd07e34e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:18.215377 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-8f69e6da-d18a-4d6f-ad6d-38fd07e34e16 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:18.216616 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-8f69e6da-d18a-4d6f-ad6d-38fd07e34e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:18.224745 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1194/2397] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:18.228950 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7a858-0d3e-4f61-9fa3-f372608536aa None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:18.239038 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7a858-0d3e-4f61-9fa3-f372608536aa None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:18.243677 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0340d17-9be2-41f7-b2f0-c22a5b62dd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:18.244640 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0340d17-9be2-41f7-b2f0-c22a5b62dd18 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:18.244922 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0340d17-9be2-41f7-b2f0-c22a5b62dd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:18.245803 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0340d17-9be2-41f7-b2f0-c22a5b62dd18 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:18.246524 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0340d17-9be2-41f7-b2f0-c22a5b62dd18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:19:18.246880 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0340d17-9be2-41f7-b2f0-c22a5b62dd18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:18.248501 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0340d17-9be2-41f7-b2f0-c22a5b62dd18 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:18.263862 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1204/2398] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:19:18.268040 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69e6da-d18a-4d6f-ad6d-38fd07e34e16 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:18.277977 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69e6da-d18a-4d6f-ad6d-38fd07e34e16 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:18.282647 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bc334-83b9-432b-b32e-b483934f16b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:18.283302 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bc334-83b9-432b-b32e-b483934f16b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:18.283601 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bc334-83b9-432b-b32e-b483934f16b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:18.283916 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bc334-83b9-432b-b32e-b483934f16b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:18.284618 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579bc334-83b9-432b-b32e-b483934f16b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:18.286479 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579bc334-83b9-432b-b32e-b483934f16b1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:18.313548 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1195/2399] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:19:18 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:19:18.317584 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0340d17-9be2-41f7-b2f0-c22a5b62dd18 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:18.327670 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0340d17-9be2-41f7-b2f0-c22a5b62dd18 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:18.386527 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef52369-bc52-44e2-81ca-60a199aaf64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:18.387214 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef52369-bc52-44e2-81ca-60a199aaf64e admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:18.387658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef52369-bc52-44e2-81ca-60a199aaf64e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:18.388095 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef52369-bc52-44e2-81ca-60a199aaf64e admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:18.388885 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef52369-bc52-44e2-81ca-60a199aaf64e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:18.390907 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef52369-bc52-44e2-81ca-60a199aaf64e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:18.412002 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1205/2400] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:19:18 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:19:18.416306 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bc334-83b9-432b-b32e-b483934f16b1 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:18.427206 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bc334-83b9-432b-b32e-b483934f16b1 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:18.432015 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29747d-8321-460b-a065-cc321f01e76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:18.433253 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29747d-8321-460b-a065-cc321f01e76c admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:18.433727 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29747d-8321-460b-a065-cc321f01e76c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:18.433999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29747d-8321-460b-a065-cc321f01e76c admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:18.434728 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29747d-8321-460b-a065-cc321f01e76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:18.436392 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29747d-8321-460b-a065-cc321f01e76c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:18.450083 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1196/2401] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:19:18.451768 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef52369-bc52-44e2-81ca-60a199aaf64e admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:18.461676 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef52369-bc52-44e2-81ca-60a199aaf64e admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:18.466855 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950bce4-87ee-49ed-842d-a18dc52338f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:18.467517 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950bce4-87ee-49ed-842d-a18dc52338f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:18.467798 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950bce4-87ee-49ed-842d-a18dc52338f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:18.468106 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950bce4-87ee-49ed-842d-a18dc52338f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:18.468843 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950bce4-87ee-49ed-842d-a18dc52338f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:18.470425 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950bce4-87ee-49ed-842d-a18dc52338f6 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:18.480989 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1206/2402] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:19:18.485249 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29747d-8321-460b-a065-cc321f01e76c admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:18.496023 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29747d-8321-460b-a065-cc321f01e76c admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:18.503484 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3e94c-c308-47ee-98fa-98ebd3f75222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:18.503484 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3e94c-c308-47ee-98fa-98ebd3f75222 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:18.503484 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3e94c-c308-47ee-98fa-98ebd3f75222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:18.503484 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3e94c-c308-47ee-98fa-98ebd3f75222 admin admin] PATH_INFO: `/v3/projects/8112af212c7944688c5d2b566cd01406/users/8493ae655d1a4859b8fdae636db2dde4/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:18.518948 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3e94c-c308-47ee-98fa-98ebd3f75222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8112af212c7944688c5d2b566cd01406, user_id=8493ae655d1a4859b8fdae636db2dde4, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:18.521634 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3e94c-c308-47ee-98fa-98ebd3f75222 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:18.535531 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1197/2403] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:19:18 2022] PUT /identity/v3/projects/8112af212c7944688c5d2b566cd01406/users/8493ae655d1a4859b8fdae636db2dde4/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:19:18.540699 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000ddd1-8515-4c40-82b7-87541e8ec2da None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:18.541183 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000ddd1-8515-4c40-82b7-87541e8ec2da None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:18.541288 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000ddd1-8515-4c40-82b7-87541e8ec2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:18.560942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-1000ddd1-8515-4c40-82b7-87541e8ec2da None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:18.562134 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-1000ddd1-8515-4c40-82b7-87541e8ec2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:18.624221 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1207/2404] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:18.637657 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3e94c-c308-47ee-98fa-98ebd3f75222 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:18.639696 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-b1f3e94c-c308-47ee-98fa-98ebd3f75222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:18.697772 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3e94c-c308-47ee-98fa-98ebd3f75222 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:18.704119 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3236e5-ff3a-47ed-b25e-f48a31965ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:18.704119 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3236e5-ff3a-47ed-b25e-f48a31965ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:18.704119 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3236e5-ff3a-47ed-b25e-f48a31965ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:18.704119 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3236e5-ff3a-47ed-b25e-f48a31965ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:18.705196 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000ddd1-8515-4c40-82b7-87541e8ec2da None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:18.706597 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-1000ddd1-8515-4c40-82b7-87541e8ec2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:18.712499 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3236e5-ff3a-47ed-b25e-f48a31965ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:18.714489 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3236e5-ff3a-47ed-b25e-f48a31965ab1 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:18.718976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000ddd1-8515-4c40-82b7-87541e8ec2da None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:18.723780 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1198/2405] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:19:18.723934 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b3059-d7bc-450c-a002-148643042342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:18.724858 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b3059-d7bc-450c-a002-148643042342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:18.725207 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b3059-d7bc-450c-a002-148643042342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:18.725566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b3059-d7bc-450c-a002-148643042342 admin admin] PATH_INFO: `/v3/users/74b1854298bf490c9e1fd170a809c8ef` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:18.726882 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b3059-d7bc-450c-a002-148643042342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b1854298bf490c9e1fd170a809c8ef)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:18.728816 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b3059-d7bc-450c-a002-148643042342 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:18.774872 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-d46b3059-d7bc-450c-a002-148643042342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b1854298bf490c9e1fd170a809c8ef'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:18.787259 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-d46b3059-d7bc-450c-a002-148643042342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b1854298bf490c9e1fd170a809c8ef'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:18.788072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-d46b3059-d7bc-450c-a002-148643042342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b1854298bf490c9e1fd170a809c8ef'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:18.796144 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-d46b3059-d7bc-450c-a002-148643042342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b1854298bf490c9e1fd170a809c8ef'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:18.797019 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-d46b3059-d7bc-450c-a002-148643042342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b1854298bf490c9e1fd170a809c8ef'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:18.810393 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1208/2406] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:19:18 2022] DELETE /identity/v3/users/74b1854298bf490c9e1fd170a809c8ef => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:18.814973 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71859a-b6af-4743-a89b-225eb088826d None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:18.815260 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71859a-b6af-4743-a89b-225eb088826d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:18.815549 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71859a-b6af-4743-a89b-225eb088826d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:18.833496 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-cc71859a-b6af-4743-a89b-225eb088826d None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:18.834687 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-cc71859a-b6af-4743-a89b-225eb088826d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:18.897280 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1199/2407] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:18.907414 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b3059-d7bc-450c-a002-148643042342 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:18.908981 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d46b3059-d7bc-450c-a002-148643042342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:18.965555 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b3059-d7bc-450c-a002-148643042342 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:18.970500 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a25a93-967d-4957-a6cc-3ac3764e5a08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:18.971226 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a25a93-967d-4957-a6cc-3ac3764e5a08 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:18.971513 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a25a93-967d-4957-a6cc-3ac3764e5a08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:18.971789 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a25a93-967d-4957-a6cc-3ac3764e5a08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:18.983542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a25a93-967d-4957-a6cc-3ac3764e5a08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:18.983850 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a25a93-967d-4957-a6cc-3ac3764e5a08 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:18.995298 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1209/2408] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:19:19.434279 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71859a-b6af-4743-a89b-225eb088826d None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:19.435831 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-cc71859a-b6af-4743-a89b-225eb088826d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:19.450186 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71859a-b6af-4743-a89b-225eb088826d None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:19.464409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20789eea-871b-4292-86b6-dbd9a45de788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:19.464409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20789eea-871b-4292-86b6-dbd9a45de788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:19.464409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20789eea-871b-4292-86b6-dbd9a45de788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:19.464409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20789eea-871b-4292-86b6-dbd9a45de788 admin admin] PATH_INFO: `/v3/projects/7ca4b0cdcc4446dd8a60e086caaf3ed6` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:19.464769 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20789eea-871b-4292-86b6-dbd9a45de788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ca4b0cdcc4446dd8a60e086caaf3ed6)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:19.464769 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20789eea-871b-4292-86b6-dbd9a45de788 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:19.521801 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-20789eea-871b-4292-86b6-dbd9a45de788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ca4b0cdcc4446dd8a60e086caaf3ed6', 'request_id': 'req-20789eea-871b-4292-86b6-dbd9a45de788'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:19.529741 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-20789eea-871b-4292-86b6-dbd9a45de788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ca4b0cdcc4446dd8a60e086caaf3ed6', 'request_id': 'req-20789eea-871b-4292-86b6-dbd9a45de788'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:19.537097 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-20789eea-871b-4292-86b6-dbd9a45de788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ca4b0cdcc4446dd8a60e086caaf3ed6', 'request_id': 'req-20789eea-871b-4292-86b6-dbd9a45de788'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:19.554812 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-20789eea-871b-4292-86b6-dbd9a45de788 admin admin] The token cache is being invalidate because project 7ca4b0cdcc4446dd8a60e086caaf3ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:19:19.555937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-20789eea-871b-4292-86b6-dbd9a45de788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:19.556479 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-20789eea-871b-4292-86b6-dbd9a45de788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:19.559073 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1200/2409] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:19:19 2022] DELETE /identity/v3/projects/7ca4b0cdcc4446dd8a60e086caaf3ed6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:19.563034 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a25a93-967d-4957-a6cc-3ac3764e5a08 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:19.575231 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a25a93-967d-4957-a6cc-3ac3764e5a08 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:19.640706 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c4d48-7984-4372-b10f-c80ad710b114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:19.641618 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c4d48-7984-4372-b10f-c80ad710b114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:19.642086 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c4d48-7984-4372-b10f-c80ad710b114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:19.642361 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c4d48-7984-4372-b10f-c80ad710b114 admin admin] PATH_INFO: `/v3/users/5822058dbac34d6cbb42d9f0cafd0e7f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:19.643635 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c4d48-7984-4372-b10f-c80ad710b114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5822058dbac34d6cbb42d9f0cafd0e7f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:19.645723 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c4d48-7984-4372-b10f-c80ad710b114 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:19.702620 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7b5c4d48-7984-4372-b10f-c80ad710b114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5822058dbac34d6cbb42d9f0cafd0e7f'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:19.717521 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7b5c4d48-7984-4372-b10f-c80ad710b114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5822058dbac34d6cbb42d9f0cafd0e7f'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:19.718510 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7b5c4d48-7984-4372-b10f-c80ad710b114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5822058dbac34d6cbb42d9f0cafd0e7f'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:19.726340 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7b5c4d48-7984-4372-b10f-c80ad710b114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5822058dbac34d6cbb42d9f0cafd0e7f'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:19.726952 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7b5c4d48-7984-4372-b10f-c80ad710b114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5822058dbac34d6cbb42d9f0cafd0e7f'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:19.744177 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1210/2410] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:19:19 2022] DELETE /identity/v3/users/5822058dbac34d6cbb42d9f0cafd0e7f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:20.134217 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20789eea-871b-4292-86b6-dbd9a45de788 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:20.136555 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-20789eea-871b-4292-86b6-dbd9a45de788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:20.165760 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20789eea-871b-4292-86b6-dbd9a45de788 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:20.232564 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb62f0-cbd8-4ae0-b210-15c5cce8c013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:20.233616 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb62f0-cbd8-4ae0-b210-15c5cce8c013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:20.234104 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb62f0-cbd8-4ae0-b210-15c5cce8c013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:20.234417 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb62f0-cbd8-4ae0-b210-15c5cce8c013 admin admin] PATH_INFO: `/v3/projects/a7e756cc7451440792b86cab0b940f13` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:20.235779 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb62f0-cbd8-4ae0-b210-15c5cce8c013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7e756cc7451440792b86cab0b940f13)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:20.237877 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb62f0-cbd8-4ae0-b210-15c5cce8c013 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:20.295540 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f1eb62f0-cbd8-4ae0-b210-15c5cce8c013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7e756cc7451440792b86cab0b940f13', 'request_id': 'req-f1eb62f0-cbd8-4ae0-b210-15c5cce8c013'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:20.304171 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f1eb62f0-cbd8-4ae0-b210-15c5cce8c013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7e756cc7451440792b86cab0b940f13', 'request_id': 'req-f1eb62f0-cbd8-4ae0-b210-15c5cce8c013'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:20.310461 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f1eb62f0-cbd8-4ae0-b210-15c5cce8c013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7e756cc7451440792b86cab0b940f13', 'request_id': 'req-f1eb62f0-cbd8-4ae0-b210-15c5cce8c013'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:20.325661 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f1eb62f0-cbd8-4ae0-b210-15c5cce8c013 admin admin] The token cache is being invalidate because project a7e756cc7451440792b86cab0b940f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:19:20.326539 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f1eb62f0-cbd8-4ae0-b210-15c5cce8c013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:20.327509 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f1eb62f0-cbd8-4ae0-b210-15c5cce8c013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:20.329550 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1201/2411] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:19:20 2022] DELETE /identity/v3/projects/a7e756cc7451440792b86cab0b940f13 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:20.334534 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269aadc-3a0b-4e22-a0d4-781a17b93629 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:20.334959 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269aadc-3a0b-4e22-a0d4-781a17b93629 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:20.335344 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269aadc-3a0b-4e22-a0d4-781a17b93629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:20.363971 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-b269aadc-3a0b-4e22-a0d4-781a17b93629 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:20.366030 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-b269aadc-3a0b-4e22-a0d4-781a17b93629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:20.431735 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1211/2412] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:20.439957 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efb0df-f15f-47f3-a63e-bcdca0e844b4 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:20.440566 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efb0df-f15f-47f3-a63e-bcdca0e844b4 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:20.441053 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efb0df-f15f-47f3-a63e-bcdca0e844b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:20.466962 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-66efb0df-f15f-47f3-a63e-bcdca0e844b4 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:20.468205 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-66efb0df-f15f-47f3-a63e-bcdca0e844b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:20.476955 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1202/2413] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:20.481740 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269aadc-3a0b-4e22-a0d4-781a17b93629 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:20.492414 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269aadc-3a0b-4e22-a0d4-781a17b93629 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:20.500029 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f3e97-e988-4b70-a0c6-220bd8420546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:20.500951 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f3e97-e988-4b70-a0c6-220bd8420546 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:20.502198 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f3e97-e988-4b70-a0c6-220bd8420546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:20.502644 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f3e97-e988-4b70-a0c6-220bd8420546 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:20.503544 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f3e97-e988-4b70-a0c6-220bd8420546 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:19:20.504173 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f3e97-e988-4b70-a0c6-220bd8420546 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:20.506439 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f3e97-e988-4b70-a0c6-220bd8420546 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:20.524752 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efb0df-f15f-47f3-a63e-bcdca0e844b4 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:20.527973 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1212/2414] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:19:20.535412 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efb0df-f15f-47f3-a63e-bcdca0e844b4 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:20.540858 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4b7cb-13b5-42ac-8742-11e47588c4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:20.541931 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4b7cb-13b5-42ac-8742-11e47588c4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:20.542330 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4b7cb-13b5-42ac-8742-11e47588c4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:20.542702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4b7cb-13b5-42ac-8742-11e47588c4e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:20.543738 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4b7cb-13b5-42ac-8742-11e47588c4e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:20.545525 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4b7cb-13b5-42ac-8742-11e47588c4e8 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:20.604659 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1203/2415] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:19:20 2022] POST /identity/v3/projects => generated 367 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:19:20.607860 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f3e97-e988-4b70-a0c6-220bd8420546 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:20.620523 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f3e97-e988-4b70-a0c6-220bd8420546 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:20.690367 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd928d-2a7a-4d77-816e-37070cfdf7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:20.691072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd928d-2a7a-4d77-816e-37070cfdf7bc admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:20.691643 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd928d-2a7a-4d77-816e-37070cfdf7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:20.691954 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd928d-2a7a-4d77-816e-37070cfdf7bc admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:20.692836 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd928d-2a7a-4d77-816e-37070cfdf7bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:20.694934 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd928d-2a7a-4d77-816e-37070cfdf7bc admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:20.735104 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1213/2416] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:19:20 2022] POST /identity/v3/users => generated 284 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:19:20.739260 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4b7cb-13b5-42ac-8742-11e47588c4e8 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:20.753273 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4b7cb-13b5-42ac-8742-11e47588c4e8 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:20.759924 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd524cd2-5b38-418d-a5a3-a7d736cab775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:20.760600 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd524cd2-5b38-418d-a5a3-a7d736cab775 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:20.760910 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd524cd2-5b38-418d-a5a3-a7d736cab775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:20.761868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd524cd2-5b38-418d-a5a3-a7d736cab775 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:20.762654 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd524cd2-5b38-418d-a5a3-a7d736cab775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:20.764300 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd524cd2-5b38-418d-a5a3-a7d736cab775 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:20.775083 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1204/2417] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:19:20.779912 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd928d-2a7a-4d77-816e-37070cfdf7bc admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:20.790190 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd928d-2a7a-4d77-816e-37070cfdf7bc admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:20.795566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de7230-f5eb-44a2-8a49-a17f310fdfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:20.796247 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de7230-f5eb-44a2-8a49-a17f310fdfbf admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:20.796526 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de7230-f5eb-44a2-8a49-a17f310fdfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:20.796798 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de7230-f5eb-44a2-8a49-a17f310fdfbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:20.797527 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de7230-f5eb-44a2-8a49-a17f310fdfbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:20.799118 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de7230-f5eb-44a2-8a49-a17f310fdfbf admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:20.811178 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1214/2418] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:19:20.815295 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd524cd2-5b38-418d-a5a3-a7d736cab775 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:20.825500 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd524cd2-5b38-418d-a5a3-a7d736cab775 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:20.830253 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd818971-5508-48e2-a084-a2ce475c3d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:20.831200 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd818971-5508-48e2-a084-a2ce475c3d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:20.831595 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd818971-5508-48e2-a084-a2ce475c3d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:20.831973 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd818971-5508-48e2-a084-a2ce475c3d31 admin admin] PATH_INFO: `/v3/projects/ff19766782b14a3280316c94e92b4121/users/bd03c47a4a484492acfad75d946d932f/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:20.848691 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd818971-5508-48e2-a084-a2ce475c3d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff19766782b14a3280316c94e92b4121, user_id=bd03c47a4a484492acfad75d946d932f, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:20.851390 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd818971-5508-48e2-a084-a2ce475c3d31 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:20.865135 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1205/2419] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:19:20 2022] PUT /identity/v3/projects/ff19766782b14a3280316c94e92b4121/users/bd03c47a4a484492acfad75d946d932f/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:19:20.875812 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c062e-7f6b-4c97-a1d7-ea27ff68bb4e None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:20.876141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c062e-7f6b-4c97-a1d7-ea27ff68bb4e None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:20.876421 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c062e-7f6b-4c97-a1d7-ea27ff68bb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:20.906889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-e24c062e-7f6b-4c97-a1d7-ea27ff68bb4e None None] MFA Rules not processed for user `bd03c47a4a484492acfad75d946d932f`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:20.908151 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e24c062e-7f6b-4c97-a1d7-ea27ff68bb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:20.971675 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1215/2420] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:20.976337 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd818971-5508-48e2-a084-a2ce475c3d31 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:21.049286 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd818971-5508-48e2-a084-a2ce475c3d31 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:21.056896 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a56b2-ac57-4811-9d06-91cbe0aa7fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:21.057996 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a56b2-ac57-4811-9d06-91cbe0aa7fdc admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:21.058434 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a56b2-ac57-4811-9d06-91cbe0aa7fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:21.058784 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a56b2-ac57-4811-9d06-91cbe0aa7fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:21.059580 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a56b2-ac57-4811-9d06-91cbe0aa7fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:21.061606 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a56b2-ac57-4811-9d06-91cbe0aa7fdc admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:21.100282 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1206/2421] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:19:20 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:19:21.104140 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c062e-7f6b-4c97-a1d7-ea27ff68bb4e None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:21.115922 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c062e-7f6b-4c97-a1d7-ea27ff68bb4e None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:21.193107 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8e871-affe-4b48-9414-62f3ab9577c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:21.193798 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8e871-affe-4b48-9414-62f3ab9577c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:21.194080 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8e871-affe-4b48-9414-62f3ab9577c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:21.194345 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8e871-affe-4b48-9414-62f3ab9577c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:21.195066 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8e871-affe-4b48-9414-62f3ab9577c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:21.197208 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8e871-affe-4b48-9414-62f3ab9577c4 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:21.223589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1216/2422] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:19:21 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:19:21.227273 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a56b2-ac57-4811-9d06-91cbe0aa7fdc admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:21.240726 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a56b2-ac57-4811-9d06-91cbe0aa7fdc admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:21.251102 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8df40b-1edf-477a-8183-8797e3908db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:21.252174 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8df40b-1edf-477a-8183-8797e3908db4 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:21.252394 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8df40b-1edf-477a-8183-8797e3908db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:21.252764 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8df40b-1edf-477a-8183-8797e3908db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:21.253805 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8df40b-1edf-477a-8183-8797e3908db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:21.255445 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8df40b-1edf-477a-8183-8797e3908db4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:21.272265 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1207/2423] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:19:21.272898 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8e871-affe-4b48-9414-62f3ab9577c4 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:21.286390 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8e871-affe-4b48-9414-62f3ab9577c4 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:21.292974 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad729b5-f92a-4b7d-9c30-aab0327c1213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:21.294306 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad729b5-f92a-4b7d-9c30-aab0327c1213 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:21.294784 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad729b5-f92a-4b7d-9c30-aab0327c1213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:21.295217 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad729b5-f92a-4b7d-9c30-aab0327c1213 admin admin] PATH_INFO: `/v3/projects/b2b0b1788b0c46f882a3b40697d02ebb/users/4156a104d50943ceb64a42118607c250/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:21.324924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad729b5-f92a-4b7d-9c30-aab0327c1213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b0b1788b0c46f882a3b40697d02ebb, user_id=4156a104d50943ceb64a42118607c250, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:21.328343 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad729b5-f92a-4b7d-9c30-aab0327c1213 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:21.346400 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1217/2424] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:19:21 2022] PUT /identity/v3/projects/b2b0b1788b0c46f882a3b40697d02ebb/users/4156a104d50943ceb64a42118607c250/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:19:21.350453 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8df40b-1edf-477a-8183-8797e3908db4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:21.365735 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8df40b-1edf-477a-8183-8797e3908db4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:21.443401 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4cd6b-693f-40ff-8173-da5e09c88a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:21.443950 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4cd6b-693f-40ff-8173-da5e09c88a10 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:21.444233 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4cd6b-693f-40ff-8173-da5e09c88a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:21.444694 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4cd6b-693f-40ff-8173-da5e09c88a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:21.446423 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4cd6b-693f-40ff-8173-da5e09c88a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:21.448844 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4cd6b-693f-40ff-8173-da5e09c88a10 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:21.459854 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1208/2425] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:19:21.464637 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad729b5-f92a-4b7d-9c30-aab0327c1213 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:21.475888 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad729b5-f92a-4b7d-9c30-aab0327c1213 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:21.481434 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6720b-ed93-432b-a38c-cb55ea0203f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:21.482315 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6720b-ed93-432b-a38c-cb55ea0203f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:21.482610 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6720b-ed93-432b-a38c-cb55ea0203f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:21.482872 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6720b-ed93-432b-a38c-cb55ea0203f3 admin admin] PATH_INFO: `/v3/projects/b2b0b1788b0c46f882a3b40697d02ebb/users/4156a104d50943ceb64a42118607c250/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:21.484908 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6720b-ed93-432b-a38c-cb55ea0203f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b0b1788b0c46f882a3b40697d02ebb, user_id=4156a104d50943ceb64a42118607c250, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:21.487862 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6720b-ed93-432b-a38c-cb55ea0203f3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:21.499673 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1218/2426] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:19:21 2022] PUT /identity/v3/projects/b2b0b1788b0c46f882a3b40697d02ebb/users/4156a104d50943ceb64a42118607c250/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:19:21.511040 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bc0f6-123e-43d0-933c-093a7c6441f4 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:21.511541 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bc0f6-123e-43d0-933c-093a7c6441f4 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:21.512064 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bc0f6-123e-43d0-933c-093a7c6441f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:21.545471 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-b55bc0f6-123e-43d0-933c-093a7c6441f4 None None] MFA Rules not processed for user `4156a104d50943ceb64a42118607c250`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:21.546748 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-b55bc0f6-123e-43d0-933c-093a7c6441f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:21.630775 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1209/2427] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:21.640981 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6720b-ed93-432b-a38c-cb55ea0203f3 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:21.642707 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-82f6720b-ed93-432b-a38c-cb55ea0203f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:21.707688 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6720b-ed93-432b-a38c-cb55ea0203f3 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:21.712507 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda09b7-159c-4f6d-a423-db50e6847c1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:21.713580 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda09b7-159c-4f6d-a423-db50e6847c1e service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:21.714695 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda09b7-159c-4f6d-a423-db50e6847c1e service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:21.715222 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda09b7-159c-4f6d-a423-db50e6847c1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:21.726461 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda09b7-159c-4f6d-a423-db50e6847c1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:21.728849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda09b7-159c-4f6d-a423-db50e6847c1e service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:21.742104 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1219/2428] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:19:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:19:21.862913 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bc0f6-123e-43d0-933c-093a7c6441f4 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:21.875648 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bc0f6-123e-43d0-933c-093a7c6441f4 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:21.880572 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c79be7-8dd8-4d5f-abd4-d3288fdc1151 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:21.881700 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c79be7-8dd8-4d5f-abd4-d3288fdc1151 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:21.882173 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c79be7-8dd8-4d5f-abd4-d3288fdc1151 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:21.882604 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c79be7-8dd8-4d5f-abd4-d3288fdc1151 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:21.977083 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c79be7-8dd8-4d5f-abd4-d3288fdc1151 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:21.978639 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c79be7-8dd8-4d5f-abd4-d3288fdc1151 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:21.991791 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1210/2429] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:19:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:19:23.277769 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0f245-9ad0-4516-a9fb-2964119942f4 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:23.278233 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0f245-9ad0-4516-a9fb-2964119942f4 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:23.278516 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0f245-9ad0-4516-a9fb-2964119942f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:23.324802 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-91f0f245-9ad0-4516-a9fb-2964119942f4 None None] MFA Rules not processed for user `8493ae655d1a4859b8fdae636db2dde4`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:23.326046 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-91f0f245-9ad0-4516-a9fb-2964119942f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:23.411332 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1220/2430] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:23.415880 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c79be7-8dd8-4d5f-abd4-d3288fdc1151 service cinder] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:23.418874 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-12c79be7-8dd8-4d5f-abd4-d3288fdc1151 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:23.492574 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c79be7-8dd8-4d5f-abd4-d3288fdc1151 service cinder] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:23.520301 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91c4f9-8d89-4685-b5a7-47c5cf30a8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:23.520998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91c4f9-8d89-4685-b5a7-47c5cf30a8aa admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:23.521283 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91c4f9-8d89-4685-b5a7-47c5cf30a8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:23.521888 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91c4f9-8d89-4685-b5a7-47c5cf30a8aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:23.522612 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91c4f9-8d89-4685-b5a7-47c5cf30a8aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:23.525140 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91c4f9-8d89-4685-b5a7-47c5cf30a8aa admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:23.563457 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1211/2431] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:19:23 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:19:23.567158 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0f245-9ad0-4516-a9fb-2964119942f4 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:23.579542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0f245-9ad0-4516-a9fb-2964119942f4 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:23.659475 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb34b9d-9ab3-4a89-97d8-386282292302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:23.660209 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb34b9d-9ab3-4a89-97d8-386282292302 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:23.660497 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb34b9d-9ab3-4a89-97d8-386282292302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:23.660772 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb34b9d-9ab3-4a89-97d8-386282292302 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:23.661477 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb34b9d-9ab3-4a89-97d8-386282292302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:23.663678 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb34b9d-9ab3-4a89-97d8-386282292302 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:23.685034 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1221/2432] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:19:23 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:19:23.689222 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91c4f9-8d89-4685-b5a7-47c5cf30a8aa admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:23.701525 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91c4f9-8d89-4685-b5a7-47c5cf30a8aa admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:23.706613 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53483b11-3ba8-4c3d-ab56-6e64628adda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:23.707447 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53483b11-3ba8-4c3d-ab56-6e64628adda4 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:23.707733 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53483b11-3ba8-4c3d-ab56-6e64628adda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:23.708094 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53483b11-3ba8-4c3d-ab56-6e64628adda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:23.708840 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53483b11-3ba8-4c3d-ab56-6e64628adda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:23.710744 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53483b11-3ba8-4c3d-ab56-6e64628adda4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:23.722974 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1212/2433] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:19:23.727317 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb34b9d-9ab3-4a89-97d8-386282292302 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:23.737988 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb34b9d-9ab3-4a89-97d8-386282292302 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:23.747982 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a3818-1cb4-4a4e-88ef-646fa43d7065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:23.749002 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a3818-1cb4-4a4e-88ef-646fa43d7065 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:23.749404 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a3818-1cb4-4a4e-88ef-646fa43d7065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:23.749860 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a3818-1cb4-4a4e-88ef-646fa43d7065 admin admin] PATH_INFO: `/v3/projects/9deb71cc68ef4e24bc7d1dd36ed76d8b/users/fcbfa7c4a45c40bdbb53011e31f694a9/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:23.766245 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a3818-1cb4-4a4e-88ef-646fa43d7065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9deb71cc68ef4e24bc7d1dd36ed76d8b, user_id=fcbfa7c4a45c40bdbb53011e31f694a9, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:23.768963 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a3818-1cb4-4a4e-88ef-646fa43d7065 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:23.783406 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1222/2434] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:19:23 2022] PUT /identity/v3/projects/9deb71cc68ef4e24bc7d1dd36ed76d8b/users/fcbfa7c4a45c40bdbb53011e31f694a9/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:23.787601 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53483b11-3ba8-4c3d-ab56-6e64628adda4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:23.799086 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53483b11-3ba8-4c3d-ab56-6e64628adda4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:23.860061 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf82418-f80e-4b5a-a3c4-a5ef75d42b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:23.860779 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf82418-f80e-4b5a-a3c4-a5ef75d42b0d admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:23.861066 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf82418-f80e-4b5a-a3c4-a5ef75d42b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:23.861347 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf82418-f80e-4b5a-a3c4-a5ef75d42b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:23.862087 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf82418-f80e-4b5a-a3c4-a5ef75d42b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:23.863689 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf82418-f80e-4b5a-a3c4-a5ef75d42b0d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:23.874375 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1213/2435] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:19:23.878710 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a3818-1cb4-4a4e-88ef-646fa43d7065 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:23.893138 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a3818-1cb4-4a4e-88ef-646fa43d7065 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:23.897959 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0a434-ce42-4398-a280-4f62fc0917a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:23.898893 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0a434-ce42-4398-a280-4f62fc0917a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:23.899180 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0a434-ce42-4398-a280-4f62fc0917a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:23.899455 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0a434-ce42-4398-a280-4f62fc0917a5 admin admin] PATH_INFO: `/v3/projects/9deb71cc68ef4e24bc7d1dd36ed76d8b/users/fcbfa7c4a45c40bdbb53011e31f694a9/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:23.902395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0a434-ce42-4398-a280-4f62fc0917a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9deb71cc68ef4e24bc7d1dd36ed76d8b, user_id=fcbfa7c4a45c40bdbb53011e31f694a9, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:23.905314 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0a434-ce42-4398-a280-4f62fc0917a5 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:23.916375 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1223/2436] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:19:23 2022] PUT /identity/v3/projects/9deb71cc68ef4e24bc7d1dd36ed76d8b/users/fcbfa7c4a45c40bdbb53011e31f694a9/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:27.103556 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf82418-f80e-4b5a-a3c4-a5ef75d42b0d admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:27.120594 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf82418-f80e-4b5a-a3c4-a5ef75d42b0d admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:27.249845 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc766ed-f722-4f24-8401-0d2e22dab9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:27.250940 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc766ed-f722-4f24-8401-0d2e22dab9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:27.251332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc766ed-f722-4f24-8401-0d2e22dab9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:27.252984 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc766ed-f722-4f24-8401-0d2e22dab9c5 admin admin] PATH_INFO: `/v3/users/bd03c47a4a484492acfad75d946d932f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:27.256395 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc766ed-f722-4f24-8401-0d2e22dab9c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd03c47a4a484492acfad75d946d932f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:27.260262 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc766ed-f722-4f24-8401-0d2e22dab9c5 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:27.366952 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0bc766ed-f722-4f24-8401-0d2e22dab9c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd03c47a4a484492acfad75d946d932f'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:27.384938 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0bc766ed-f722-4f24-8401-0d2e22dab9c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd03c47a4a484492acfad75d946d932f'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:27.385922 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0bc766ed-f722-4f24-8401-0d2e22dab9c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd03c47a4a484492acfad75d946d932f'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:27.387409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0bc766ed-f722-4f24-8401-0d2e22dab9c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd03c47a4a484492acfad75d946d932f'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:27.398218 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0bc766ed-f722-4f24-8401-0d2e22dab9c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd03c47a4a484492acfad75d946d932f'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:27.418297 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1214/2437] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:19:27 2022] DELETE /identity/v3/users/bd03c47a4a484492acfad75d946d932f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:27.420235 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ad3e3-76dd-431e-9a31-8de542ce34ba None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:27.421163 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ad3e3-76dd-431e-9a31-8de542ce34ba None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:27.421607 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ad3e3-76dd-431e-9a31-8de542ce34ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:27.456639 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-c97ad3e3-76dd-431e-9a31-8de542ce34ba None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:27.458109 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-c97ad3e3-76dd-431e-9a31-8de542ce34ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:27.586276 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1224/2438] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:27.593514 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc766ed-f722-4f24-8401-0d2e22dab9c5 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:27.595274 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-0bc766ed-f722-4f24-8401-0d2e22dab9c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:27.691566 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc766ed-f722-4f24-8401-0d2e22dab9c5 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:27.697091 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efc3d7-b147-48bf-a966-c865c509ece4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:27.697777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efc3d7-b147-48bf-a966-c865c509ece4 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:27.698075 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efc3d7-b147-48bf-a966-c865c509ece4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:27.698375 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efc3d7-b147-48bf-a966-c865c509ece4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:27.713371 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efc3d7-b147-48bf-a966-c865c509ece4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:27.715849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efc3d7-b147-48bf-a966-c865c509ece4 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:27.733878 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1215/2439] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:19:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:19:28.143733 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ad3e3-76dd-431e-9a31-8de542ce34ba None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:28.145323 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-c97ad3e3-76dd-431e-9a31-8de542ce34ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:28.169861 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ad3e3-76dd-431e-9a31-8de542ce34ba None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:28.184674 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139eb07-3ab2-4c6b-b81d-14c792a3e36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:28.186397 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139eb07-3ab2-4c6b-b81d-14c792a3e36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:28.186688 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139eb07-3ab2-4c6b-b81d-14c792a3e36f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:28.186963 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139eb07-3ab2-4c6b-b81d-14c792a3e36f admin admin] PATH_INFO: `/v3/projects/ff19766782b14a3280316c94e92b4121` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:28.188344 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139eb07-3ab2-4c6b-b81d-14c792a3e36f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff19766782b14a3280316c94e92b4121)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:28.190269 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139eb07-3ab2-4c6b-b81d-14c792a3e36f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:28.254287 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-0139eb07-3ab2-4c6b-b81d-14c792a3e36f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff19766782b14a3280316c94e92b4121', 'request_id': 'req-0139eb07-3ab2-4c6b-b81d-14c792a3e36f'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:28.265058 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-0139eb07-3ab2-4c6b-b81d-14c792a3e36f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff19766782b14a3280316c94e92b4121', 'request_id': 'req-0139eb07-3ab2-4c6b-b81d-14c792a3e36f'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:28.275465 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-0139eb07-3ab2-4c6b-b81d-14c792a3e36f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff19766782b14a3280316c94e92b4121', 'request_id': 'req-0139eb07-3ab2-4c6b-b81d-14c792a3e36f'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:28.296157 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-0139eb07-3ab2-4c6b-b81d-14c792a3e36f admin admin] The token cache is being invalidate because project ff19766782b14a3280316c94e92b4121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:19:28.296676 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-0139eb07-3ab2-4c6b-b81d-14c792a3e36f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:28.297517 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-0139eb07-3ab2-4c6b-b81d-14c792a3e36f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:28.302314 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1225/2440] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:19:28 2022] DELETE /identity/v3/projects/ff19766782b14a3280316c94e92b4121 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:28.303483 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efc3d7-b147-48bf-a966-c865c509ece4 service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:28.329120 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efc3d7-b147-48bf-a966-c865c509ece4 service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:28.412025 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a533c6-5a0b-47d5-ac19-06d65f8af962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:28.413419 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a533c6-5a0b-47d5-ac19-06d65f8af962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:28.414881 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a533c6-5a0b-47d5-ac19-06d65f8af962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:28.415346 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a533c6-5a0b-47d5-ac19-06d65f8af962 admin admin] PATH_INFO: `/v3/users/4156a104d50943ceb64a42118607c250` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:28.417506 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a533c6-5a0b-47d5-ac19-06d65f8af962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4156a104d50943ceb64a42118607c250)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:28.419335 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a533c6-5a0b-47d5-ac19-06d65f8af962 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:28.499412 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-90a533c6-5a0b-47d5-ac19-06d65f8af962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4156a104d50943ceb64a42118607c250'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:28.513632 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-90a533c6-5a0b-47d5-ac19-06d65f8af962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4156a104d50943ceb64a42118607c250'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:28.514446 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-90a533c6-5a0b-47d5-ac19-06d65f8af962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4156a104d50943ceb64a42118607c250'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:28.519084 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-90a533c6-5a0b-47d5-ac19-06d65f8af962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4156a104d50943ceb64a42118607c250'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:28.531773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-90a533c6-5a0b-47d5-ac19-06d65f8af962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4156a104d50943ceb64a42118607c250'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:28.555143 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1216/2441] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:19:28 2022] DELETE /identity/v3/users/4156a104d50943ceb64a42118607c250 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:29.055145 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139eb07-3ab2-4c6b-b81d-14c792a3e36f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:29.056675 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-0139eb07-3ab2-4c6b-b81d-14c792a3e36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:29.076799 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139eb07-3ab2-4c6b-b81d-14c792a3e36f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:29.148756 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586295ab-161a-4180-b5b8-b9fe4cba51a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:29.149623 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586295ab-161a-4180-b5b8-b9fe4cba51a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:29.150757 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586295ab-161a-4180-b5b8-b9fe4cba51a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:29.152561 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586295ab-161a-4180-b5b8-b9fe4cba51a4 admin admin] PATH_INFO: `/v3/projects/b2b0b1788b0c46f882a3b40697d02ebb` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:29.155155 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586295ab-161a-4180-b5b8-b9fe4cba51a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b0b1788b0c46f882a3b40697d02ebb)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:29.158818 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586295ab-161a-4180-b5b8-b9fe4cba51a4 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:29.240039 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-586295ab-161a-4180-b5b8-b9fe4cba51a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b0b1788b0c46f882a3b40697d02ebb', 'request_id': 'req-586295ab-161a-4180-b5b8-b9fe4cba51a4'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:29.251246 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-586295ab-161a-4180-b5b8-b9fe4cba51a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b0b1788b0c46f882a3b40697d02ebb', 'request_id': 'req-586295ab-161a-4180-b5b8-b9fe4cba51a4'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:29.258995 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-586295ab-161a-4180-b5b8-b9fe4cba51a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b0b1788b0c46f882a3b40697d02ebb', 'request_id': 'req-586295ab-161a-4180-b5b8-b9fe4cba51a4'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:29.281314 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-586295ab-161a-4180-b5b8-b9fe4cba51a4 admin admin] The token cache is being invalidate because project b2b0b1788b0c46f882a3b40697d02ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:19:29.281632 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-586295ab-161a-4180-b5b8-b9fe4cba51a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:29.282341 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-586295ab-161a-4180-b5b8-b9fe4cba51a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:19:29.284460 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1226/2442] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:19:29 2022] DELETE /identity/v3/projects/b2b0b1788b0c46f882a3b40697d02ebb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:19:29.289287 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77312cf8-fb2f-44fd-a1d3-a4686d2d7ea5 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:29.289643 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77312cf8-fb2f-44fd-a1d3-a4686d2d7ea5 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:29.289986 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77312cf8-fb2f-44fd-a1d3-a4686d2d7ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:29.316383 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-77312cf8-fb2f-44fd-a1d3-a4686d2d7ea5 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:29.318647 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-77312cf8-fb2f-44fd-a1d3-a4686d2d7ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:29.408237 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1217/2443] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:29.420569 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9780070-dd4f-45bf-beab-40a444ad2363 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:29.423090 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9780070-dd4f-45bf-beab-40a444ad2363 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:29.423475 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9780070-dd4f-45bf-beab-40a444ad2363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:29.449375 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-e9780070-dd4f-45bf-beab-40a444ad2363 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:29.451259 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e9780070-dd4f-45bf-beab-40a444ad2363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:29.461992 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1227/2444] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:29.466830 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77312cf8-fb2f-44fd-a1d3-a4686d2d7ea5 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:29.476443 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77312cf8-fb2f-44fd-a1d3-a4686d2d7ea5 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:29.481279 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1266b9-0973-4834-8e5d-969bd3cc9e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:29.481943 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1266b9-0973-4834-8e5d-969bd3cc9e54 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:29.482226 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1266b9-0973-4834-8e5d-969bd3cc9e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:29.482498 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1266b9-0973-4834-8e5d-969bd3cc9e54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:29.483398 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1266b9-0973-4834-8e5d-969bd3cc9e54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:19:29.483937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1266b9-0973-4834-8e5d-969bd3cc9e54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:29.485562 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1266b9-0973-4834-8e5d-969bd3cc9e54 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:29.498916 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1218/2445] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:19:29.503254 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9780070-dd4f-45bf-beab-40a444ad2363 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:29.514865 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9780070-dd4f-45bf-beab-40a444ad2363 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:29.523606 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4aa6a-4d89-41df-8aec-df6d26ba6b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:29.524419 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4aa6a-4d89-41df-8aec-df6d26ba6b58 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:29.524715 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4aa6a-4d89-41df-8aec-df6d26ba6b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:29.524994 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4aa6a-4d89-41df-8aec-df6d26ba6b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:29.525801 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4aa6a-4d89-41df-8aec-df6d26ba6b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:29.530137 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4aa6a-4d89-41df-8aec-df6d26ba6b58 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:29.534174 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35405cd0-20cc-4bc6-8cd4-bbd1a254479c None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:29.534675 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35405cd0-20cc-4bc6-8cd4-bbd1a254479c None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:29.535245 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35405cd0-20cc-4bc6-8cd4-bbd1a254479c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:29.573881 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-35405cd0-20cc-4bc6-8cd4-bbd1a254479c None None] MFA Rules not processed for user `fcbfa7c4a45c40bdbb53011e31f694a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:29.575758 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-35405cd0-20cc-4bc6-8cd4-bbd1a254479c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:29.587783 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1228/2446] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:19:29 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:19:29.590062 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4aa6a-4d89-41df-8aec-df6d26ba6b58 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:29.662251 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4aa6a-4d89-41df-8aec-df6d26ba6b58 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:29.663375 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1219/2447] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:29.671696 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291a039-5e68-4812-a786-84f7317a7480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:29.672417 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291a039-5e68-4812-a786-84f7317a7480 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:29.672694 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291a039-5e68-4812-a786-84f7317a7480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:29.672970 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291a039-5e68-4812-a786-84f7317a7480 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:29.673772 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291a039-5e68-4812-a786-84f7317a7480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:29.675488 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35405cd0-20cc-4bc6-8cd4-bbd1a254479c None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:29.675755 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291a039-5e68-4812-a786-84f7317a7480 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:29.677122 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-35405cd0-20cc-4bc6-8cd4-bbd1a254479c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:29.700996 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1229/2448] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:19:29 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:19:29.704716 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291a039-5e68-4812-a786-84f7317a7480 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:29.714778 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291a039-5e68-4812-a786-84f7317a7480 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:29.720241 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2c8bb-64a1-403c-a734-a9716af69364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:29.720912 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2c8bb-64a1-403c-a734-a9716af69364 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:29.721191 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2c8bb-64a1-403c-a734-a9716af69364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:29.721462 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2c8bb-64a1-403c-a734-a9716af69364 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:29.722212 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2c8bb-64a1-403c-a734-a9716af69364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:29.723848 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2c8bb-64a1-403c-a734-a9716af69364 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:29.734575 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1230/2449] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:19:29.738360 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2c8bb-64a1-403c-a734-a9716af69364 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:29.748864 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2c8bb-64a1-403c-a734-a9716af69364 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:29.753986 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95187921-b4d9-4cd6-a1f7-83efb135277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:29.754649 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95187921-b4d9-4cd6-a1f7-83efb135277b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:29.754931 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95187921-b4d9-4cd6-a1f7-83efb135277b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:29.755205 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95187921-b4d9-4cd6-a1f7-83efb135277b admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:29.756122 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95187921-b4d9-4cd6-a1f7-83efb135277b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:29.757703 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95187921-b4d9-4cd6-a1f7-83efb135277b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:29.772834 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1231/2450] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:19:29.773865 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95187921-b4d9-4cd6-a1f7-83efb135277b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:29.786353 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95187921-b4d9-4cd6-a1f7-83efb135277b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:29.792184 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97029db5-a374-4ce7-bad1-5b1c49d66390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:29.793485 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97029db5-a374-4ce7-bad1-5b1c49d66390 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:29.793973 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97029db5-a374-4ce7-bad1-5b1c49d66390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:29.794432 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97029db5-a374-4ce7-bad1-5b1c49d66390 admin admin] PATH_INFO: `/v3/projects/79413c98c25b465996f814247a834813/users/d20142f4344341fcabd8fe3b388aa3aa/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:29.810107 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35405cd0-20cc-4bc6-8cd4-bbd1a254479c None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:29.817719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97029db5-a374-4ce7-bad1-5b1c49d66390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79413c98c25b465996f814247a834813, user_id=d20142f4344341fcabd8fe3b388aa3aa, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:29.821905 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97029db5-a374-4ce7-bad1-5b1c49d66390 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:29.863429 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1232/2451] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:19:29 2022] PUT /identity/v3/projects/79413c98c25b465996f814247a834813/users/d20142f4344341fcabd8fe3b388aa3aa/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:19:29.864966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138eace0-3abd-45e5-96ba-5412863e0693 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:29.865535 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138eace0-3abd-45e5-96ba-5412863e0693 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:29.866166 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138eace0-3abd-45e5-96ba-5412863e0693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:29.916482 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-138eace0-3abd-45e5-96ba-5412863e0693 None None] MFA Rules not processed for user `d20142f4344341fcabd8fe3b388aa3aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:29.918236 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-138eace0-3abd-45e5-96ba-5412863e0693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:29.923010 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43998326-0aab-4fa8-ad6a-f2408561f0a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:29.923775 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43998326-0aab-4fa8-ad6a-f2408561f0a9 service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:29.924162 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43998326-0aab-4fa8-ad6a-f2408561f0a9 service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:29.924500 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43998326-0aab-4fa8-ad6a-f2408561f0a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:29.926401 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-43998326-0aab-4fa8-ad6a-f2408561f0a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:30.023039 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43998326-0aab-4fa8-ad6a-f2408561f0a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:30.025263 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43998326-0aab-4fa8-ad6a-f2408561f0a9 service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:30.026758 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1233/2452] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:30.038210 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138eace0-3abd-45e5-96ba-5412863e0693 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:30.040158 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-138eace0-3abd-45e5-96ba-5412863e0693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:30.047471 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1220/2453] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:19:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:19:30.162194 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138eace0-3abd-45e5-96ba-5412863e0693 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:30.167374 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bf585-150f-469f-a4c9-644be95a484c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd367d4b48c634351a427f2f1b468d4ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:30.168142 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bf585-150f-469f-a4c9-644be95a484c service glance] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:30.168454 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bf585-150f-469f-a4c9-644be95a484c service glance] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:30.168730 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bf585-150f-469f-a4c9-644be95a484c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:30.184156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09bf585-150f-469f-a4c9-644be95a484c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:30.185740 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09bf585-150f-469f-a4c9-644be95a484c service glance] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:30.197340 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1234/2454] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:19:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:19:31.713287 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368649d1-5312-4dae-88d0-e2a4ed89e60d None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:31.714801 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368649d1-5312-4dae-88d0-e2a4ed89e60d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:31.715086 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368649d1-5312-4dae-88d0-e2a4ed89e60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:31.735171 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-368649d1-5312-4dae-88d0-e2a4ed89e60d None None] MFA Rules not processed for user `8493ae655d1a4859b8fdae636db2dde4`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:31.736454 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-368649d1-5312-4dae-88d0-e2a4ed89e60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:31.806222 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1221/2455] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:19:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:19:45.160138 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a4163-5f79-4954-a933-fdcf57cc0a0b None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:45.160635 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a4163-5f79-4954-a933-fdcf57cc0a0b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:45.160727 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a4163-5f79-4954-a933-fdcf57cc0a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:45.210924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-382a4163-5f79-4954-a933-fdcf57cc0a0b None None] MFA Rules not processed for user `9dca4ea4f2c8490e823a73dca6c303ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:19:45.212769 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-382a4163-5f79-4954-a933-fdcf57cc0a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:45.282136 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1235/2456] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Feb 10 23:19:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:19:45.336465 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368649d1-5312-4dae-88d0-e2a4ed89e60d None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:19:45.337979 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-368649d1-5312-4dae-88d0-e2a4ed89e60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:19:45.439207 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368649d1-5312-4dae-88d0-e2a4ed89e60d None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:19:45.445216 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb8616-2ac6-493a-a843-9280db4c0153 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce55b64dc528447993e32b00ae4d3a2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:19:45.445862 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb8616-2ac6-493a-a843-9280db4c0153 service swift] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:19:45.446151 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb8616-2ac6-493a-a843-9280db4c0153 service swift] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:19:45.446431 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb8616-2ac6-493a-a843-9280db4c0153 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:19:45.455551 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb8616-2ac6-493a-a843-9280db4c0153 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:19:45.457216 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb8616-2ac6-493a-a843-9280db4c0153 service swift] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:19:45.466037 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1222/2457] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Feb 10 23:19:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:20:03.077114 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e6ee0-370f-40c3-9ec3-e0c04a7ab2ab None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:03.077715 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e6ee0-370f-40c3-9ec3-e0c04a7ab2ab None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:03.078202 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e6ee0-370f-40c3-9ec3-e0c04a7ab2ab None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:03.080586 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1236/2458] 10.222.0.77 () {54 vars in 921 bytes} [Thu Feb 10 23:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:20:03.088467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6febe-cd39-4766-827d-ecb4add48ed9 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:03.088992 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6febe-cd39-4766-827d-ecb4add48ed9 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:03.089091 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6febe-cd39-4766-827d-ecb4add48ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:03.125798 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-42d6febe-cd39-4766-827d-ecb4add48ed9 None None] MFA Rules not processed for user `551da2c9fab74cb8b14287a5634adb25`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:03.127030 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-42d6febe-cd39-4766-827d-ecb4add48ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:03.200355 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1223/2459] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Feb 10 23:20:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:03.215226 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e6ee0-370f-40c3-9ec3-e0c04a7ab2ab None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:03.226978 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e6ee0-370f-40c3-9ec3-e0c04a7ab2ab None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:03.230462 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdc659-e8db-4018-b565-807b859c4e2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd367d4b48c634351a427f2f1b468d4ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:03.231083 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdc659-e8db-4018-b565-807b859c4e2a service glance] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:03.231364 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdc659-e8db-4018-b565-807b859c4e2a service glance] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:03.231636 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdc659-e8db-4018-b565-807b859c4e2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:03.241423 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdc659-e8db-4018-b565-807b859c4e2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:03.242817 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdc659-e8db-4018-b565-807b859c4e2a service glance] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:03.253124 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1237/2460] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:20:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:20:03.319271 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5471e-6a96-434a-9080-60def941f577 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:03.319606 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5471e-6a96-434a-9080-60def941f577 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:03.320062 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5471e-6a96-434a-9080-60def941f577 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:03.321964 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1224/2461] 10.222.0.77 () {54 vars in 921 bytes} [Thu Feb 10 23:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:20:03.327804 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193aeab-64af-4047-9fc3-1d916a71b1ee None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:03.328122 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193aeab-64af-4047-9fc3-1d916a71b1ee None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:03.328429 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193aeab-64af-4047-9fc3-1d916a71b1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:03.366101 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-d193aeab-64af-4047-9fc3-1d916a71b1ee None None] MFA Rules not processed for user `0d2af52f48dc435ca9a48cc0a32c31e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:03.367377 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d193aeab-64af-4047-9fc3-1d916a71b1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:03.418589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1238/2462] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Feb 10 23:20:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:03.430504 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5471e-6a96-434a-9080-60def941f577 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:03.432417 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-4ab5471e-6a96-434a-9080-60def941f577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:03.445714 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5471e-6a96-434a-9080-60def941f577 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:03.449069 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104b14e-4174-480b-8ced-29a2fea27abf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:03.449688 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104b14e-4174-480b-8ced-29a2fea27abf service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:03.449996 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104b14e-4174-480b-8ced-29a2fea27abf service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:03.450268 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104b14e-4174-480b-8ced-29a2fea27abf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:03.456999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104b14e-4174-480b-8ced-29a2fea27abf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:03.458416 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104b14e-4174-480b-8ced-29a2fea27abf service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:03.466498 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1225/2463] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:20:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:20:03.582214 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a741689-1db0-4c16-bc29-56d2a27ddecd None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:03.582497 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a741689-1db0-4c16-bc29-56d2a27ddecd None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:03.582768 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a741689-1db0-4c16-bc29-56d2a27ddecd None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:03.584606 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1239/2464] 10.222.0.77 () {54 vars in 921 bytes} [Thu Feb 10 23:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:20:03.590604 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dcad0-a016-4faa-a0bc-94f95b7f03f1 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:03.590906 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dcad0-a016-4faa-a0bc-94f95b7f03f1 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:03.591182 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dcad0-a016-4faa-a0bc-94f95b7f03f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:03.609740 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-df4dcad0-a016-4faa-a0bc-94f95b7f03f1 None None] MFA Rules not processed for user `551da2c9fab74cb8b14287a5634adb25`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:03.610930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-df4dcad0-a016-4faa-a0bc-94f95b7f03f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:03.620292 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1226/2465] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Feb 10 23:20:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:03.630716 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a741689-1db0-4c16-bc29-56d2a27ddecd None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:03.642373 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a741689-1db0-4c16-bc29-56d2a27ddecd None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:03.645890 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654716c5-c632-4438-85ac-89facefceb5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:03.646527 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654716c5-c632-4438-85ac-89facefceb5f service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:03.646825 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654716c5-c632-4438-85ac-89facefceb5f service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:03.647103 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654716c5-c632-4438-85ac-89facefceb5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:03.657547 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654716c5-c632-4438-85ac-89facefceb5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:03.658959 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654716c5-c632-4438-85ac-89facefceb5f service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:03.669641 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1240/2466] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:20:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:20:06.397030 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dbb88-a74e-4444-a607-2fbcfdfdfd79 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:06.397558 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dbb88-a74e-4444-a607-2fbcfdfdfd79 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:06.397558 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dbb88-a74e-4444-a607-2fbcfdfdfd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:06.415544 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-735dbb88-a74e-4444-a607-2fbcfdfdfd79 None None] MFA Rules not processed for user `9dca4ea4f2c8490e823a73dca6c303ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:06.416758 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-735dbb88-a74e-4444-a607-2fbcfdfdfd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:06.424157 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1227/2467] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Feb 10 23:20:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:06.438647 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654716c5-c632-4438-85ac-89facefceb5f service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:06.450277 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654716c5-c632-4438-85ac-89facefceb5f service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:06.455783 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1ba12-3cc2-4a80-96cb-fefa65eeb938 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce55b64dc528447993e32b00ae4d3a2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:06.456228 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1ba12-3cc2-4a80-96cb-fefa65eeb938 service swift] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:06.456508 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1ba12-3cc2-4a80-96cb-fefa65eeb938 service swift] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:06.456782 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1ba12-3cc2-4a80-96cb-fefa65eeb938 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:06.465769 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1ba12-3cc2-4a80-96cb-fefa65eeb938 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:06.467348 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1ba12-3cc2-4a80-96cb-fefa65eeb938 service swift] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:06.476013 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1241/2468] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Feb 10 23:20:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 23:20:07.954168 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dbb88-a74e-4444-a607-2fbcfdfdfd79 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:08.065623 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dbb88-a74e-4444-a607-2fbcfdfdfd79 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:08.071184 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd40df5-83f3-4a41-861c-324427c7a7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:08.072337 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd40df5-83f3-4a41-861c-324427c7a7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:08.072794 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd40df5-83f3-4a41-861c-324427c7a7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:08.073234 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd40df5-83f3-4a41-861c-324427c7a7d0 admin admin] PATH_INFO: `/v3/users/d20142f4344341fcabd8fe3b388aa3aa` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:08.075607 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd40df5-83f3-4a41-861c-324427c7a7d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d20142f4344341fcabd8fe3b388aa3aa)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:08.082471 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd40df5-83f3-4a41-861c-324427c7a7d0 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:08.176316 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-8bd40df5-83f3-4a41-861c-324427c7a7d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd20142f4344341fcabd8fe3b388aa3aa'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:08.203578 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-8bd40df5-83f3-4a41-861c-324427c7a7d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd20142f4344341fcabd8fe3b388aa3aa'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:08.204375 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-8bd40df5-83f3-4a41-861c-324427c7a7d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd20142f4344341fcabd8fe3b388aa3aa'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:08.205138 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-8bd40df5-83f3-4a41-861c-324427c7a7d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd20142f4344341fcabd8fe3b388aa3aa'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:08.214000 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-8bd40df5-83f3-4a41-861c-324427c7a7d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd20142f4344341fcabd8fe3b388aa3aa'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:08.232735 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1228/2469] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:20:07 2022] DELETE /identity/v3/users/d20142f4344341fcabd8fe3b388aa3aa => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:20:08.237588 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0b792-ec74-4d87-b376-c581e40beb00 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:08.237991 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0b792-ec74-4d87-b376-c581e40beb00 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:08.238154 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0b792-ec74-4d87-b376-c581e40beb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:08.257731 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-86b0b792-ec74-4d87-b376-c581e40beb00 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:08.259772 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-86b0b792-ec74-4d87-b376-c581e40beb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:08.342936 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd40df5-83f3-4a41-861c-324427c7a7d0 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:08.343996 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1242/2470] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:08.345106 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-8bd40df5-83f3-4a41-861c-324427c7a7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:08.439402 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd40df5-83f3-4a41-861c-324427c7a7d0 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:08.446971 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31781053-af5b-4a75-875a-c4df861e8152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:08.448347 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31781053-af5b-4a75-875a-c4df861e8152 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:08.449054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31781053-af5b-4a75-875a-c4df861e8152 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:08.449725 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31781053-af5b-4a75-875a-c4df861e8152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:08.465969 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31781053-af5b-4a75-875a-c4df861e8152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:08.467573 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31781053-af5b-4a75-875a-c4df861e8152 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:08.491919 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1229/2471] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:20:08.825616 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0b792-ec74-4d87-b376-c581e40beb00 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:08.827610 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-86b0b792-ec74-4d87-b376-c581e40beb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:08.849165 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0b792-ec74-4d87-b376-c581e40beb00 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:08.867025 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca4f95-cf2c-48fd-923b-37380aa7c479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:08.867796 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca4f95-cf2c-48fd-923b-37380aa7c479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:08.868123 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca4f95-cf2c-48fd-923b-37380aa7c479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:08.868367 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca4f95-cf2c-48fd-923b-37380aa7c479 admin admin] PATH_INFO: `/v3/projects/79413c98c25b465996f814247a834813` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:08.869897 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca4f95-cf2c-48fd-923b-37380aa7c479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79413c98c25b465996f814247a834813)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:08.871805 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca4f95-cf2c-48fd-923b-37380aa7c479 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:08.958842 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-73ca4f95-cf2c-48fd-923b-37380aa7c479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79413c98c25b465996f814247a834813', 'request_id': 'req-73ca4f95-cf2c-48fd-923b-37380aa7c479'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:08.964603 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-73ca4f95-cf2c-48fd-923b-37380aa7c479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79413c98c25b465996f814247a834813', 'request_id': 'req-73ca4f95-cf2c-48fd-923b-37380aa7c479'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:08.972063 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-73ca4f95-cf2c-48fd-923b-37380aa7c479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79413c98c25b465996f814247a834813', 'request_id': 'req-73ca4f95-cf2c-48fd-923b-37380aa7c479'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:08.988213 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-73ca4f95-cf2c-48fd-923b-37380aa7c479 admin admin] The token cache is being invalidate because project 79413c98c25b465996f814247a834813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:20:08.988541 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-73ca4f95-cf2c-48fd-923b-37380aa7c479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:08.989196 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-73ca4f95-cf2c-48fd-923b-37380aa7c479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:08.995924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1243/2472] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:20:08 2022] DELETE /identity/v3/projects/79413c98c25b465996f814247a834813 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:20:08.996183 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b1518-4e41-4eb9-9f72-4a10bc960cde None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:08.996777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b1518-4e41-4eb9-9f72-4a10bc960cde None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:08.996777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b1518-4e41-4eb9-9f72-4a10bc960cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:09.015866 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-2b2b1518-4e41-4eb9-9f72-4a10bc960cde None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:09.017105 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-2b2b1518-4e41-4eb9-9f72-4a10bc960cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:09.137450 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1230/2473] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:09.145561 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff234b2-029f-4339-9fa4-45ba78332ed7 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:09.146045 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff234b2-029f-4339-9fa4-45ba78332ed7 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:09.147855 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff234b2-029f-4339-9fa4-45ba78332ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:09.167425 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-2ff234b2-029f-4339-9fa4-45ba78332ed7 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:09.168931 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2ff234b2-029f-4339-9fa4-45ba78332ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:09.199994 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1244/2474] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:09.204964 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b1518-4e41-4eb9-9f72-4a10bc960cde None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:09.217912 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b1518-4e41-4eb9-9f72-4a10bc960cde None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:09.226327 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb59045-c923-4149-8aa8-347487d20539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:09.226327 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb59045-c923-4149-8aa8-347487d20539 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:09.226327 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb59045-c923-4149-8aa8-347487d20539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:09.226327 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb59045-c923-4149-8aa8-347487d20539 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:09.226838 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb59045-c923-4149-8aa8-347487d20539 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:20:09.226838 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb59045-c923-4149-8aa8-347487d20539 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:09.228689 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb59045-c923-4149-8aa8-347487d20539 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:09.253814 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1231/2475] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:20:09.258015 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff234b2-029f-4339-9fa4-45ba78332ed7 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:09.268336 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff234b2-029f-4339-9fa4-45ba78332ed7 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:09.274824 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ce8ac-9fc4-4cbc-9c5f-940f88cb64b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:09.275495 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ce8ac-9fc4-4cbc-9c5f-940f88cb64b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:09.276019 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ce8ac-9fc4-4cbc-9c5f-940f88cb64b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:09.276450 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ce8ac-9fc4-4cbc-9c5f-940f88cb64b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:09.277359 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ce8ac-9fc4-4cbc-9c5f-940f88cb64b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:09.279779 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ce8ac-9fc4-4cbc-9c5f-940f88cb64b3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:09.327629 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1245/2476] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:20:09 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:20:09.328555 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb59045-c923-4149-8aa8-347487d20539 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:09.341764 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb59045-c923-4149-8aa8-347487d20539 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:09.452949 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fb88e-1f47-4631-917f-1ee0e47a1fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:09.453849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fb88e-1f47-4631-917f-1ee0e47a1fba admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:09.454274 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fb88e-1f47-4631-917f-1ee0e47a1fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:09.454718 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fb88e-1f47-4631-917f-1ee0e47a1fba admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:09.455730 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474fb88e-1f47-4631-917f-1ee0e47a1fba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:09.458773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474fb88e-1f47-4631-917f-1ee0e47a1fba admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:09.496409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1232/2477] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:20:09 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:20:09.500878 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ce8ac-9fc4-4cbc-9c5f-940f88cb64b3 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:09.512040 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ce8ac-9fc4-4cbc-9c5f-940f88cb64b3 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:09.519202 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619781f-dd6b-4455-98fd-59b6d7fe60bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:09.520386 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619781f-dd6b-4455-98fd-59b6d7fe60bc admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:09.520986 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619781f-dd6b-4455-98fd-59b6d7fe60bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:09.521666 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619781f-dd6b-4455-98fd-59b6d7fe60bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:09.522779 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619781f-dd6b-4455-98fd-59b6d7fe60bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:09.525159 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619781f-dd6b-4455-98fd-59b6d7fe60bc admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:09.539557 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1246/2478] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:20:09.543173 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fb88e-1f47-4631-917f-1ee0e47a1fba admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:09.553989 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fb88e-1f47-4631-917f-1ee0e47a1fba admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:09.559200 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3224c36-55e7-4b34-b139-8aeef5397f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:09.560011 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3224c36-55e7-4b34-b139-8aeef5397f6a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:09.560324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3224c36-55e7-4b34-b139-8aeef5397f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:09.561266 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3224c36-55e7-4b34-b139-8aeef5397f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:09.562019 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3224c36-55e7-4b34-b139-8aeef5397f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:09.563635 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3224c36-55e7-4b34-b139-8aeef5397f6a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:09.574703 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1233/2479] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:20:09.579203 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619781f-dd6b-4455-98fd-59b6d7fe60bc admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:09.594456 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619781f-dd6b-4455-98fd-59b6d7fe60bc admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:09.605651 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793928b-754e-4068-aa8e-b1d677b825ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:09.607034 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793928b-754e-4068-aa8e-b1d677b825ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:09.607933 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793928b-754e-4068-aa8e-b1d677b825ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:09.608192 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793928b-754e-4068-aa8e-b1d677b825ca admin admin] PATH_INFO: `/v3/projects/6b4d5225e7bd4048a71f7fda1019e569/users/fb455c92d9764a94829dd6e9d9f57783/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:09.634040 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793928b-754e-4068-aa8e-b1d677b825ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b4d5225e7bd4048a71f7fda1019e569, user_id=fb455c92d9764a94829dd6e9d9f57783, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:09.637010 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793928b-754e-4068-aa8e-b1d677b825ca admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:09.652675 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1247/2480] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:20:09 2022] PUT /identity/v3/projects/6b4d5225e7bd4048a71f7fda1019e569/users/fb455c92d9764a94829dd6e9d9f57783/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:20:09.662884 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c23d2-5a6e-4fe9-ba10-45a62695beec None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:09.663185 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c23d2-5a6e-4fe9-ba10-45a62695beec None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:09.663457 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c23d2-5a6e-4fe9-ba10-45a62695beec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:09.700597 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-497c23d2-5a6e-4fe9-ba10-45a62695beec None None] MFA Rules not processed for user `fb455c92d9764a94829dd6e9d9f57783`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:09.701834 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-497c23d2-5a6e-4fe9-ba10-45a62695beec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:09.771350 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1234/2481] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:20:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:09.776548 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793928b-754e-4068-aa8e-b1d677b825ca admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:09.838888 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793928b-754e-4068-aa8e-b1d677b825ca admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:09.844954 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d477d30-d332-4c16-bc62-ccf71979ec4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:09.845609 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d477d30-d332-4c16-bc62-ccf71979ec4e admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:09.845894 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d477d30-d332-4c16-bc62-ccf71979ec4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:09.846168 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d477d30-d332-4c16-bc62-ccf71979ec4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:09.846882 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d477d30-d332-4c16-bc62-ccf71979ec4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:09.848810 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d477d30-d332-4c16-bc62-ccf71979ec4e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:09.876907 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1248/2482] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:20:09 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:20:09.881112 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c23d2-5a6e-4fe9-ba10-45a62695beec None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:09.892410 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c23d2-5a6e-4fe9-ba10-45a62695beec None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:09.959058 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83035c3f-e511-466c-9a2c-7463b1d2be58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:09.959739 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83035c3f-e511-466c-9a2c-7463b1d2be58 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:09.960047 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83035c3f-e511-466c-9a2c-7463b1d2be58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:09.960485 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83035c3f-e511-466c-9a2c-7463b1d2be58 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:09.961201 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83035c3f-e511-466c-9a2c-7463b1d2be58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:09.963095 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83035c3f-e511-466c-9a2c-7463b1d2be58 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:09.987140 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1235/2483] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:20:09 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:20:09.991210 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d477d30-d332-4c16-bc62-ccf71979ec4e admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:10.002918 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d477d30-d332-4c16-bc62-ccf71979ec4e admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:10.009038 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737501c-a817-4f1c-b54b-cfe8735f462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:10.009829 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737501c-a817-4f1c-b54b-cfe8735f462f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:10.010183 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737501c-a817-4f1c-b54b-cfe8735f462f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:10.010528 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737501c-a817-4f1c-b54b-cfe8735f462f admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:10.011345 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737501c-a817-4f1c-b54b-cfe8735f462f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:10.013059 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737501c-a817-4f1c-b54b-cfe8735f462f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:10.027971 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1249/2484] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:20:10.029054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83035c3f-e511-466c-9a2c-7463b1d2be58 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:10.039769 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83035c3f-e511-466c-9a2c-7463b1d2be58 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:10.046341 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acf341-7264-45bf-9e05-a29f689e0726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:10.047028 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acf341-7264-45bf-9e05-a29f689e0726 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:10.047314 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acf341-7264-45bf-9e05-a29f689e0726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:10.047594 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acf341-7264-45bf-9e05-a29f689e0726 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:10.048384 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acf341-7264-45bf-9e05-a29f689e0726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:10.049983 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acf341-7264-45bf-9e05-a29f689e0726 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:10.062797 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1236/2485] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:20:10.066779 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737501c-a817-4f1c-b54b-cfe8735f462f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:10.086115 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737501c-a817-4f1c-b54b-cfe8735f462f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:10.094696 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5123d8a-e0da-45a7-a9fb-be89f73d0f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:10.095598 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5123d8a-e0da-45a7-a9fb-be89f73d0f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:10.095914 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5123d8a-e0da-45a7-a9fb-be89f73d0f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:10.096200 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5123d8a-e0da-45a7-a9fb-be89f73d0f93 admin admin] PATH_INFO: `/v3/projects/1b678d23d0bb4519a125e51fdf8da1dc/users/661df642d6494849b4dc74b3ecc5a36a/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:10.115395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5123d8a-e0da-45a7-a9fb-be89f73d0f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b678d23d0bb4519a125e51fdf8da1dc, user_id=661df642d6494849b4dc74b3ecc5a36a, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:10.118257 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5123d8a-e0da-45a7-a9fb-be89f73d0f93 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:10.163228 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1250/2486] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:20:10 2022] PUT /identity/v3/projects/1b678d23d0bb4519a125e51fdf8da1dc/users/661df642d6494849b4dc74b3ecc5a36a/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:20:10.182560 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ef8d7-3daa-400e-8ba7-f3309b5b2999 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:10.182560 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ef8d7-3daa-400e-8ba7-f3309b5b2999 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:10.186141 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ef8d7-3daa-400e-8ba7-f3309b5b2999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:10.229248 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-495ef8d7-3daa-400e-8ba7-f3309b5b2999 None None] MFA Rules not processed for user `661df642d6494849b4dc74b3ecc5a36a`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:10.229248 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-495ef8d7-3daa-400e-8ba7-f3309b5b2999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:10.313850 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1237/2487] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:20:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:10.320521 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5123d8a-e0da-45a7-a9fb-be89f73d0f93 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:10.395455 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5123d8a-e0da-45a7-a9fb-be89f73d0f93 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:10.400181 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814ee3f-f87d-4635-b9fc-9d61d1eac85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:10.400837 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814ee3f-f87d-4635-b9fc-9d61d1eac85f admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:10.401117 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814ee3f-f87d-4635-b9fc-9d61d1eac85f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:10.401396 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814ee3f-f87d-4635-b9fc-9d61d1eac85f admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:10.402100 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814ee3f-f87d-4635-b9fc-9d61d1eac85f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:10.404005 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814ee3f-f87d-4635-b9fc-9d61d1eac85f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:10.442183 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1251/2488] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:20:10 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:20:10.446254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ef8d7-3daa-400e-8ba7-f3309b5b2999 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:10.462827 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ef8d7-3daa-400e-8ba7-f3309b5b2999 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:10.545827 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fe50a-4268-411d-8ad2-fc2d8eb97f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:10.547070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fe50a-4268-411d-8ad2-fc2d8eb97f79 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:10.547523 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fe50a-4268-411d-8ad2-fc2d8eb97f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:10.548050 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fe50a-4268-411d-8ad2-fc2d8eb97f79 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:10.549201 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fe50a-4268-411d-8ad2-fc2d8eb97f79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:10.551616 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fe50a-4268-411d-8ad2-fc2d8eb97f79 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:10.578798 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1238/2489] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:20:10 2022] POST /identity/v3/users => generated 295 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:20:10.582686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814ee3f-f87d-4635-b9fc-9d61d1eac85f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:10.595253 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814ee3f-f87d-4635-b9fc-9d61d1eac85f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:10.602252 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c50169-9b60-43bf-9865-f101167848c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:10.603201 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c50169-9b60-43bf-9865-f101167848c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:10.603668 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c50169-9b60-43bf-9865-f101167848c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:10.604143 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c50169-9b60-43bf-9865-f101167848c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:10.605059 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c50169-9b60-43bf-9865-f101167848c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:10.607006 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c50169-9b60-43bf-9865-f101167848c6 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:10.618603 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1252/2490] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:20:10.622469 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fe50a-4268-411d-8ad2-fc2d8eb97f79 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:10.638009 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fe50a-4268-411d-8ad2-fc2d8eb97f79 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:10.644374 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5e753-f626-48ef-9a3e-9b7991669de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:10.645254 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5e753-f626-48ef-9a3e-9b7991669de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:10.645536 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5e753-f626-48ef-9a3e-9b7991669de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:10.645809 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5e753-f626-48ef-9a3e-9b7991669de1 admin admin] PATH_INFO: `/v3/projects/becb14b683264d1da59efdaf5f511bb9/users/9d8eed641e90495b8a8135ffc58277d6/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:10.662320 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5e753-f626-48ef-9a3e-9b7991669de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=becb14b683264d1da59efdaf5f511bb9, user_id=9d8eed641e90495b8a8135ffc58277d6, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:10.665089 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5e753-f626-48ef-9a3e-9b7991669de1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:10.684026 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c50169-9b60-43bf-9865-f101167848c6 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:10.684480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1239/2491] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:20:10 2022] PUT /identity/v3/projects/becb14b683264d1da59efdaf5f511bb9/users/9d8eed641e90495b8a8135ffc58277d6/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:20:10.695762 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c50169-9b60-43bf-9865-f101167848c6 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:10.770101 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77770f-22d3-440e-bcd9-752b45223c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:10.771085 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77770f-22d3-440e-bcd9-752b45223c38 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:10.771538 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77770f-22d3-440e-bcd9-752b45223c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:10.771846 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77770f-22d3-440e-bcd9-752b45223c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:10.772635 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77770f-22d3-440e-bcd9-752b45223c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:10.774252 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77770f-22d3-440e-bcd9-752b45223c38 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:10.785246 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1253/2492] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:20:10.789298 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5e753-f626-48ef-9a3e-9b7991669de1 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:10.802434 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5e753-f626-48ef-9a3e-9b7991669de1 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:10.817379 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5eb14e-07b0-4b57-a1f6-ac9d2991d2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:10.818442 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5eb14e-07b0-4b57-a1f6-ac9d2991d2b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:10.818734 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5eb14e-07b0-4b57-a1f6-ac9d2991d2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:10.819010 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5eb14e-07b0-4b57-a1f6-ac9d2991d2b9 admin admin] PATH_INFO: `/v3/projects/becb14b683264d1da59efdaf5f511bb9/users/9d8eed641e90495b8a8135ffc58277d6/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:10.821199 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5eb14e-07b0-4b57-a1f6-ac9d2991d2b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=becb14b683264d1da59efdaf5f511bb9, user_id=9d8eed641e90495b8a8135ffc58277d6, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:10.823878 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5eb14e-07b0-4b57-a1f6-ac9d2991d2b9 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:10.836489 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1240/2493] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:20:10 2022] PUT /identity/v3/projects/becb14b683264d1da59efdaf5f511bb9/users/9d8eed641e90495b8a8135ffc58277d6/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:20:10.846691 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa263606-f2b6-46bf-b14d-d0430b267f4c None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:10.846976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa263606-f2b6-46bf-b14d-d0430b267f4c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:10.847251 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa263606-f2b6-46bf-b14d-d0430b267f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:11.019232 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-fa263606-f2b6-46bf-b14d-d0430b267f4c None None] MFA Rules not processed for user `9d8eed641e90495b8a8135ffc58277d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:11.020534 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-fa263606-f2b6-46bf-b14d-d0430b267f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:11.096302 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1254/2494] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:20:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:11.106946 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5eb14e-07b0-4b57-a1f6-ac9d2991d2b9 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:11.109903 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-2b5eb14e-07b0-4b57-a1f6-ac9d2991d2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:11.173004 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5eb14e-07b0-4b57-a1f6-ac9d2991d2b9 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:11.177043 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf02ce-d1d7-47fa-9646-c8e5ccfdec53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:11.177773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf02ce-d1d7-47fa-9646-c8e5ccfdec53 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:11.178133 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf02ce-d1d7-47fa-9646-c8e5ccfdec53 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:11.178484 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf02ce-d1d7-47fa-9646-c8e5ccfdec53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:11.239651 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf02ce-d1d7-47fa-9646-c8e5ccfdec53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:11.241139 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf02ce-d1d7-47fa-9646-c8e5ccfdec53 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:11.250014 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1241/2495] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:20:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:20:13.854594 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa263606-f2b6-46bf-b14d-d0430b267f4c None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:13.865618 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa263606-f2b6-46bf-b14d-d0430b267f4c None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:13.872788 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ebec9-832d-4297-a4cb-5693fc76ed7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:13.873519 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ebec9-832d-4297-a4cb-5693fc76ed7a service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:13.873872 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ebec9-832d-4297-a4cb-5693fc76ed7a service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:13.874217 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ebec9-832d-4297-a4cb-5693fc76ed7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:13.941314 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ebec9-832d-4297-a4cb-5693fc76ed7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:13.942879 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ebec9-832d-4297-a4cb-5693fc76ed7a service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:13.951897 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1255/2496] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:20:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:20:14.633154 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf02ce-d1d7-47fa-9646-c8e5ccfdec53 service cinder] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:14.645055 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf02ce-d1d7-47fa-9646-c8e5ccfdec53 service cinder] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:14.649330 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2727a-af59-43f4-8d5b-f60bad6cdc44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:14.649989 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2727a-af59-43f4-8d5b-f60bad6cdc44 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:14.650335 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2727a-af59-43f4-8d5b-f60bad6cdc44 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:14.650675 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2727a-af59-43f4-8d5b-f60bad6cdc44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:14.662843 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d2727a-af59-43f4-8d5b-f60bad6cdc44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:14.664312 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d2727a-af59-43f4-8d5b-f60bad6cdc44 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:14.674564 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1242/2497] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:20:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:20:19.510397 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ebec9-832d-4297-a4cb-5693fc76ed7a service cinder] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:19.571486 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ebec9-832d-4297-a4cb-5693fc76ed7a service cinder] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:19.576020 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ad7e7-1f91-4ca0-a5d3-6ce2e37058f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:19.576874 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ad7e7-1f91-4ca0-a5d3-6ce2e37058f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:19.577149 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ad7e7-1f91-4ca0-a5d3-6ce2e37058f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:19.577415 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ad7e7-1f91-4ca0-a5d3-6ce2e37058f7 admin admin] PATH_INFO: `/v3/users/fb455c92d9764a94829dd6e9d9f57783` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:19.578591 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ad7e7-1f91-4ca0-a5d3-6ce2e37058f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb455c92d9764a94829dd6e9d9f57783)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:19.580520 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ad7e7-1f91-4ca0-a5d3-6ce2e37058f7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:19.625058 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c78ad7e7-1f91-4ca0-a5d3-6ce2e37058f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb455c92d9764a94829dd6e9d9f57783'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:19.636423 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c78ad7e7-1f91-4ca0-a5d3-6ce2e37058f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb455c92d9764a94829dd6e9d9f57783'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:19.637074 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c78ad7e7-1f91-4ca0-a5d3-6ce2e37058f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb455c92d9764a94829dd6e9d9f57783'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:19.644021 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c78ad7e7-1f91-4ca0-a5d3-6ce2e37058f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb455c92d9764a94829dd6e9d9f57783'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:19.644624 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-c78ad7e7-1f91-4ca0-a5d3-6ce2e37058f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb455c92d9764a94829dd6e9d9f57783'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:19.656283 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1256/2498] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:20:19 2022] DELETE /identity/v3/users/fb455c92d9764a94829dd6e9d9f57783 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:20:19.661293 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdacb2-b5a4-4a8e-a308-a73b533740b0 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:19.661804 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdacb2-b5a4-4a8e-a308-a73b533740b0 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:19.661902 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdacb2-b5a4-4a8e-a308-a73b533740b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:19.679101 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-e9fdacb2-b5a4-4a8e-a308-a73b533740b0 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:19.680313 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e9fdacb2-b5a4-4a8e-a308-a73b533740b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:19.735488 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1243/2499] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:19.745912 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ad7e7-1f91-4ca0-a5d3-6ce2e37058f7 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:19.747348 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-c78ad7e7-1f91-4ca0-a5d3-6ce2e37058f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:19.802262 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ad7e7-1f91-4ca0-a5d3-6ce2e37058f7 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:19.805980 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afd760-9962-4a51-a862-60697b0d74fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:19.806602 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afd760-9962-4a51-a862-60697b0d74fc service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:19.806880 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afd760-9962-4a51-a862-60697b0d74fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:19.807153 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afd760-9962-4a51-a862-60697b0d74fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:19.816118 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afd760-9962-4a51-a862-60697b0d74fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:19.817837 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afd760-9962-4a51-a862-60697b0d74fc service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:19.826976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1257/2500] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:20:20.195864 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdacb2-b5a4-4a8e-a308-a73b533740b0 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:20.197120 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e9fdacb2-b5a4-4a8e-a308-a73b533740b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:20.211607 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdacb2-b5a4-4a8e-a308-a73b533740b0 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:20.220929 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e02891-5a89-4040-909d-94ac8360a089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:20.221728 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e02891-5a89-4040-909d-94ac8360a089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:20.222009 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e02891-5a89-4040-909d-94ac8360a089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:20.222274 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e02891-5a89-4040-909d-94ac8360a089 admin admin] PATH_INFO: `/v3/projects/6b4d5225e7bd4048a71f7fda1019e569` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:20.224113 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e02891-5a89-4040-909d-94ac8360a089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b4d5225e7bd4048a71f7fda1019e569)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:20.226139 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e02891-5a89-4040-909d-94ac8360a089 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:20.273055 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f1e02891-5a89-4040-909d-94ac8360a089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b4d5225e7bd4048a71f7fda1019e569', 'request_id': 'req-f1e02891-5a89-4040-909d-94ac8360a089'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:20.279958 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f1e02891-5a89-4040-909d-94ac8360a089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b4d5225e7bd4048a71f7fda1019e569', 'request_id': 'req-f1e02891-5a89-4040-909d-94ac8360a089'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:20.285221 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f1e02891-5a89-4040-909d-94ac8360a089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b4d5225e7bd4048a71f7fda1019e569', 'request_id': 'req-f1e02891-5a89-4040-909d-94ac8360a089'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:20.295936 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f1e02891-5a89-4040-909d-94ac8360a089 admin admin] The token cache is being invalidate because project 6b4d5225e7bd4048a71f7fda1019e569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:20:20.296225 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f1e02891-5a89-4040-909d-94ac8360a089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:20.296839 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-f1e02891-5a89-4040-909d-94ac8360a089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:20.298347 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1244/2501] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:20:20 2022] DELETE /identity/v3/projects/6b4d5225e7bd4048a71f7fda1019e569 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:20:20.302450 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afd760-9962-4a51-a862-60697b0d74fc service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:20.311522 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afd760-9962-4a51-a862-60697b0d74fc service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:20.364441 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3cbe7-33d3-43c7-b48f-4d03af2b2d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:20.365293 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3cbe7-33d3-43c7-b48f-4d03af2b2d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:20.365571 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3cbe7-33d3-43c7-b48f-4d03af2b2d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:20.365841 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3cbe7-33d3-43c7-b48f-4d03af2b2d75 admin admin] PATH_INFO: `/v3/users/661df642d6494849b4dc74b3ecc5a36a` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:20.367003 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3cbe7-33d3-43c7-b48f-4d03af2b2d75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=661df642d6494849b4dc74b3ecc5a36a)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:20.368913 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3cbe7-33d3-43c7-b48f-4d03af2b2d75 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:20.412391 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-61c3cbe7-33d3-43c7-b48f-4d03af2b2d75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '661df642d6494849b4dc74b3ecc5a36a'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:20.423241 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-61c3cbe7-33d3-43c7-b48f-4d03af2b2d75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '661df642d6494849b4dc74b3ecc5a36a'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:20.423905 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-61c3cbe7-33d3-43c7-b48f-4d03af2b2d75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '661df642d6494849b4dc74b3ecc5a36a'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:20.430876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-61c3cbe7-33d3-43c7-b48f-4d03af2b2d75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '661df642d6494849b4dc74b3ecc5a36a'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:20.431436 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-61c3cbe7-33d3-43c7-b48f-4d03af2b2d75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '661df642d6494849b4dc74b3ecc5a36a'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:20.444153 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1258/2502] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:20:20 2022] DELETE /identity/v3/users/661df642d6494849b4dc74b3ecc5a36a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:20:20.759317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e02891-5a89-4040-909d-94ac8360a089 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:20.760774 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-f1e02891-5a89-4040-909d-94ac8360a089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:20.776525 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e02891-5a89-4040-909d-94ac8360a089 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:20.840526 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266bffe-edaf-4448-88e5-519659ec1ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:20.841496 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266bffe-edaf-4448-88e5-519659ec1ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:20.841857 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266bffe-edaf-4448-88e5-519659ec1ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:20.842212 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266bffe-edaf-4448-88e5-519659ec1ad6 admin admin] PATH_INFO: `/v3/projects/1b678d23d0bb4519a125e51fdf8da1dc` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:20.843487 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266bffe-edaf-4448-88e5-519659ec1ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b678d23d0bb4519a125e51fdf8da1dc)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:20.845512 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266bffe-edaf-4448-88e5-519659ec1ad6 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:20.891870 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0266bffe-edaf-4448-88e5-519659ec1ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b678d23d0bb4519a125e51fdf8da1dc', 'request_id': 'req-0266bffe-edaf-4448-88e5-519659ec1ad6'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:20.900894 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0266bffe-edaf-4448-88e5-519659ec1ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b678d23d0bb4519a125e51fdf8da1dc', 'request_id': 'req-0266bffe-edaf-4448-88e5-519659ec1ad6'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:20.906795 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0266bffe-edaf-4448-88e5-519659ec1ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b678d23d0bb4519a125e51fdf8da1dc', 'request_id': 'req-0266bffe-edaf-4448-88e5-519659ec1ad6'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:20.918155 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0266bffe-edaf-4448-88e5-519659ec1ad6 admin admin] The token cache is being invalidate because project 1b678d23d0bb4519a125e51fdf8da1dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:20:20.918432 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0266bffe-edaf-4448-88e5-519659ec1ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:20.919270 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0266bffe-edaf-4448-88e5-519659ec1ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:20.920829 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1245/2503] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:20:20 2022] DELETE /identity/v3/projects/1b678d23d0bb4519a125e51fdf8da1dc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:20:20.924705 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3cbe7-33d3-43c7-b48f-4d03af2b2d75 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:20.926166 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-61c3cbe7-33d3-43c7-b48f-4d03af2b2d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:20.940409 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3cbe7-33d3-43c7-b48f-4d03af2b2d75 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:21.000138 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e8e6d-d35c-4107-9e5c-f32aa8b6c783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:21.001016 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e8e6d-d35c-4107-9e5c-f32aa8b6c783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:21.001369 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e8e6d-d35c-4107-9e5c-f32aa8b6c783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:21.001639 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e8e6d-d35c-4107-9e5c-f32aa8b6c783 admin admin] PATH_INFO: `/v3/users/9d8eed641e90495b8a8135ffc58277d6` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:21.002945 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e8e6d-d35c-4107-9e5c-f32aa8b6c783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d8eed641e90495b8a8135ffc58277d6)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:21.005006 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e8e6d-d35c-4107-9e5c-f32aa8b6c783 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:21.057635 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-9d6e8e6d-d35c-4107-9e5c-f32aa8b6c783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d8eed641e90495b8a8135ffc58277d6'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:21.074234 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-9d6e8e6d-d35c-4107-9e5c-f32aa8b6c783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d8eed641e90495b8a8135ffc58277d6'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:21.075013 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-9d6e8e6d-d35c-4107-9e5c-f32aa8b6c783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d8eed641e90495b8a8135ffc58277d6'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:21.085634 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-9d6e8e6d-d35c-4107-9e5c-f32aa8b6c783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d8eed641e90495b8a8135ffc58277d6'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:21.086703 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-9d6e8e6d-d35c-4107-9e5c-f32aa8b6c783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d8eed641e90495b8a8135ffc58277d6'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:21.101227 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1259/2504] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:20:20 2022] DELETE /identity/v3/users/9d8eed641e90495b8a8135ffc58277d6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:20:21.617939 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266bffe-edaf-4448-88e5-519659ec1ad6 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:21.619540 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-0266bffe-edaf-4448-88e5-519659ec1ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:21.633324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266bffe-edaf-4448-88e5-519659ec1ad6 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:21.694215 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bc4c4-9b93-4d93-af8f-3e4ae5a1147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:21.695198 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bc4c4-9b93-4d93-af8f-3e4ae5a1147a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:21.696322 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bc4c4-9b93-4d93-af8f-3e4ae5a1147a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:21.696747 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bc4c4-9b93-4d93-af8f-3e4ae5a1147a admin admin] PATH_INFO: `/v3/projects/becb14b683264d1da59efdaf5f511bb9` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:21.698189 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bc4c4-9b93-4d93-af8f-3e4ae5a1147a admin admin] RBAC: Authorizing `identity:delete_project(project_id=becb14b683264d1da59efdaf5f511bb9)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:21.700142 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bc4c4-9b93-4d93-af8f-3e4ae5a1147a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:21.750162 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ec5bc4c4-9b93-4d93-af8f-3e4ae5a1147a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'becb14b683264d1da59efdaf5f511bb9', 'request_id': 'req-ec5bc4c4-9b93-4d93-af8f-3e4ae5a1147a'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:21.757779 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ec5bc4c4-9b93-4d93-af8f-3e4ae5a1147a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'becb14b683264d1da59efdaf5f511bb9', 'request_id': 'req-ec5bc4c4-9b93-4d93-af8f-3e4ae5a1147a'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:21.763324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ec5bc4c4-9b93-4d93-af8f-3e4ae5a1147a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'becb14b683264d1da59efdaf5f511bb9', 'request_id': 'req-ec5bc4c4-9b93-4d93-af8f-3e4ae5a1147a'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:21.775302 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ec5bc4c4-9b93-4d93-af8f-3e4ae5a1147a admin admin] The token cache is being invalidate because project becb14b683264d1da59efdaf5f511bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:20:21.775523 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ec5bc4c4-9b93-4d93-af8f-3e4ae5a1147a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:21.776253 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ec5bc4c4-9b93-4d93-af8f-3e4ae5a1147a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:21.777798 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1246/2505] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:20:21 2022] DELETE /identity/v3/projects/becb14b683264d1da59efdaf5f511bb9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:20:21.782670 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4845a95-ff38-45ff-8f9e-c86b1eafe69e None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:21.782964 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4845a95-ff38-45ff-8f9e-c86b1eafe69e None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:21.783267 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4845a95-ff38-45ff-8f9e-c86b1eafe69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:21.801016 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-f4845a95-ff38-45ff-8f9e-c86b1eafe69e None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:21.802209 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-f4845a95-ff38-45ff-8f9e-c86b1eafe69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:21.861492 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1260/2506] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:20:21.869558 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d1f39-8190-4d02-b991-b9fc85014f91 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:21.869856 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d1f39-8190-4d02-b991-b9fc85014f91 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:21.870137 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d1f39-8190-4d02-b991-b9fc85014f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:21.888679 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-634d1f39-8190-4d02-b991-b9fc85014f91 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:21.890114 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-634d1f39-8190-4d02-b991-b9fc85014f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:21.898564 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1247/2507] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:21.902839 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4845a95-ff38-45ff-8f9e-c86b1eafe69e None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:21.912513 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4845a95-ff38-45ff-8f9e-c86b1eafe69e None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:21.917169 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631830b-8872-4503-b9ef-789e0aced46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:21.917815 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631830b-8872-4503-b9ef-789e0aced46c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:21.918124 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631830b-8872-4503-b9ef-789e0aced46c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:21.918393 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631830b-8872-4503-b9ef-789e0aced46c admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:21.919123 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631830b-8872-4503-b9ef-789e0aced46c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:20:21.919420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631830b-8872-4503-b9ef-789e0aced46c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:21.921060 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631830b-8872-4503-b9ef-789e0aced46c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:21.932370 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1261/2508] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:20:21.936608 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d1f39-8190-4d02-b991-b9fc85014f91 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:21.946304 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d1f39-8190-4d02-b991-b9fc85014f91 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:21.951301 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea864ca3-a816-4b05-ae7c-91299d74ed13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:21.952004 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864ca3-a816-4b05-ae7c-91299d74ed13 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:21.952289 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864ca3-a816-4b05-ae7c-91299d74ed13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:21.952569 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864ca3-a816-4b05-ae7c-91299d74ed13 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:21.953276 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea864ca3-a816-4b05-ae7c-91299d74ed13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:21.955185 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea864ca3-a816-4b05-ae7c-91299d74ed13 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:21.985140 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1248/2509] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:20:21 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:20:21.986348 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631830b-8872-4503-b9ef-789e0aced46c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:21.996130 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631830b-8872-4503-b9ef-789e0aced46c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:22.060482 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885381bd-8865-4367-b0cd-3997d1fda910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:22.061160 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885381bd-8865-4367-b0cd-3997d1fda910 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:22.061444 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885381bd-8865-4367-b0cd-3997d1fda910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:22.061720 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885381bd-8865-4367-b0cd-3997d1fda910 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:22.062430 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885381bd-8865-4367-b0cd-3997d1fda910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:22.064364 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885381bd-8865-4367-b0cd-3997d1fda910 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:22.093230 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1262/2510] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:20:21 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:20:22.097403 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea864ca3-a816-4b05-ae7c-91299d74ed13 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:22.113388 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea864ca3-a816-4b05-ae7c-91299d74ed13 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:22.121585 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d8b6f-cf1d-4eae-a3fb-2db81fc0d232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:22.122364 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d8b6f-cf1d-4eae-a3fb-2db81fc0d232 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:22.122716 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d8b6f-cf1d-4eae-a3fb-2db81fc0d232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:22.123048 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d8b6f-cf1d-4eae-a3fb-2db81fc0d232 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:22.123791 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d8b6f-cf1d-4eae-a3fb-2db81fc0d232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:22.125453 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d8b6f-cf1d-4eae-a3fb-2db81fc0d232 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:22.139799 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1249/2511] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:20:22.143876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885381bd-8865-4367-b0cd-3997d1fda910 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:22.154570 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885381bd-8865-4367-b0cd-3997d1fda910 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:22.159383 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bcbdc-e9c6-4905-91c5-3e23066f8b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:22.160131 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bcbdc-e9c6-4905-91c5-3e23066f8b95 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:22.160416 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bcbdc-e9c6-4905-91c5-3e23066f8b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:22.160687 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bcbdc-e9c6-4905-91c5-3e23066f8b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:22.161426 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bcbdc-e9c6-4905-91c5-3e23066f8b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:22.163257 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bcbdc-e9c6-4905-91c5-3e23066f8b95 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:22.174033 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1263/2512] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:20:22.178969 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d8b6f-cf1d-4eae-a3fb-2db81fc0d232 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:22.190597 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d8b6f-cf1d-4eae-a3fb-2db81fc0d232 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:22.195510 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e5f59-c897-49fa-a5ef-d5838edeea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:22.196451 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e5f59-c897-49fa-a5ef-d5838edeea4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:22.196739 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e5f59-c897-49fa-a5ef-d5838edeea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:22.197018 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e5f59-c897-49fa-a5ef-d5838edeea4b admin admin] PATH_INFO: `/v3/projects/717d8951fb974c6ba0da577b1f6b8717/users/e85dc41d66fc4b98997962935c06ceeb/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:22.213569 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e5f59-c897-49fa-a5ef-d5838edeea4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=717d8951fb974c6ba0da577b1f6b8717, user_id=e85dc41d66fc4b98997962935c06ceeb, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:22.216269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e5f59-c897-49fa-a5ef-d5838edeea4b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:22.229346 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1250/2513] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:20:22 2022] PUT /identity/v3/projects/717d8951fb974c6ba0da577b1f6b8717/users/e85dc41d66fc4b98997962935c06ceeb/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:20:22.241255 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061af05-0d8d-47d7-a8b0-1a6e7a5479a2 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:22.241553 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061af05-0d8d-47d7-a8b0-1a6e7a5479a2 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:22.241836 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061af05-0d8d-47d7-a8b0-1a6e7a5479a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:22.275767 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-4061af05-0d8d-47d7-a8b0-1a6e7a5479a2 None None] MFA Rules not processed for user `e85dc41d66fc4b98997962935c06ceeb`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:22.277227 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-4061af05-0d8d-47d7-a8b0-1a6e7a5479a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:22.383345 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1264/2514] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:20:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:22.393799 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e5f59-c897-49fa-a5ef-d5838edeea4b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:22.395781 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-313e5f59-c897-49fa-a5ef-d5838edeea4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:22.463527 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e5f59-c897-49fa-a5ef-d5838edeea4b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:22.467279 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6e9b3-c0eb-4931-995e-cb650de7ff0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:22.467953 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6e9b3-c0eb-4931-995e-cb650de7ff0e service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:22.468234 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6e9b3-c0eb-4931-995e-cb650de7ff0e service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:22.468508 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6e9b3-c0eb-4931-995e-cb650de7ff0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:22.477603 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6e9b3-c0eb-4931-995e-cb650de7ff0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:22.479061 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6e9b3-c0eb-4931-995e-cb650de7ff0e service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:22.488127 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1251/2515] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:20:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:20:27.400589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061af05-0d8d-47d7-a8b0-1a6e7a5479a2 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:27.402396 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-4061af05-0d8d-47d7-a8b0-1a6e7a5479a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:27.461266 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061af05-0d8d-47d7-a8b0-1a6e7a5479a2 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:27.465108 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cb332-b1d3-4700-b1f0-1c067b7a463c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:27.465761 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cb332-b1d3-4700-b1f0-1c067b7a463c service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:27.466039 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cb332-b1d3-4700-b1f0-1c067b7a463c service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:27.466309 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cb332-b1d3-4700-b1f0-1c067b7a463c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:27.468163 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-aa4cb332-b1d3-4700-b1f0-1c067b7a463c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:27.539914 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4cb332-b1d3-4700-b1f0-1c067b7a463c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:27.541503 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4cb332-b1d3-4700-b1f0-1c067b7a463c service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:27.552595 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1265/2516] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:20:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:20:28.346900 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6e9b3-c0eb-4931-995e-cb650de7ff0e service cinder] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:28.348320 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-b8c6e9b3-c0eb-4931-995e-cb650de7ff0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:28.360306 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6e9b3-c0eb-4931-995e-cb650de7ff0e service cinder] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:28.364096 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e2b92-c66e-4ed8-af26-bdada94c10b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:28.364730 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e2b92-c66e-4ed8-af26-bdada94c10b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:28.365009 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e2b92-c66e-4ed8-af26-bdada94c10b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:28.365284 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e2b92-c66e-4ed8-af26-bdada94c10b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:28.367017 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-234e2b92-c66e-4ed8-af26-bdada94c10b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:28.386604 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e2b92-c66e-4ed8-af26-bdada94c10b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:28.386604 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e2b92-c66e-4ed8-af26-bdada94c10b3 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:28.395320 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1252/2517] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:20:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:20:32.347959 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cb332-b1d3-4700-b1f0-1c067b7a463c service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:32.411875 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cb332-b1d3-4700-b1f0-1c067b7a463c service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:32.416395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28006fc-0a61-41cb-b1aa-55b6d0e47cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:32.417247 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28006fc-0a61-41cb-b1aa-55b6d0e47cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:32.418089 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28006fc-0a61-41cb-b1aa-55b6d0e47cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:32.418362 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28006fc-0a61-41cb-b1aa-55b6d0e47cbf admin admin] PATH_INFO: `/v3/users/e85dc41d66fc4b98997962935c06ceeb` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:32.419555 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28006fc-0a61-41cb-b1aa-55b6d0e47cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e85dc41d66fc4b98997962935c06ceeb)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:32.421483 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28006fc-0a61-41cb-b1aa-55b6d0e47cbf admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:32.464678 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e28006fc-0a61-41cb-b1aa-55b6d0e47cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e85dc41d66fc4b98997962935c06ceeb'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:32.475849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e28006fc-0a61-41cb-b1aa-55b6d0e47cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e85dc41d66fc4b98997962935c06ceeb'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:32.476510 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e28006fc-0a61-41cb-b1aa-55b6d0e47cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e85dc41d66fc4b98997962935c06ceeb'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:32.484629 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e28006fc-0a61-41cb-b1aa-55b6d0e47cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e85dc41d66fc4b98997962935c06ceeb'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:32.485278 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-e28006fc-0a61-41cb-b1aa-55b6d0e47cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e85dc41d66fc4b98997962935c06ceeb'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:32.497762 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1266/2518] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:20:32 2022] DELETE /identity/v3/users/e85dc41d66fc4b98997962935c06ceeb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:20:32.502244 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44461e9f-8f27-4180-975f-72f699ca05ec None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:32.502727 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44461e9f-8f27-4180-975f-72f699ca05ec None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:32.502825 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44461e9f-8f27-4180-975f-72f699ca05ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:32.519269 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-44461e9f-8f27-4180-975f-72f699ca05ec None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:32.520557 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-44461e9f-8f27-4180-975f-72f699ca05ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:32.576999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1253/2519] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:32.586483 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28006fc-0a61-41cb-b1aa-55b6d0e47cbf admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:32.587867 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e28006fc-0a61-41cb-b1aa-55b6d0e47cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:32.647621 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28006fc-0a61-41cb-b1aa-55b6d0e47cbf admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:32.653230 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef804867-90d0-4cd4-9f90-ad820fd77db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:32.653817 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804867-90d0-4cd4-9f90-ad820fd77db5 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:32.654217 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804867-90d0-4cd4-9f90-ad820fd77db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:32.654589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804867-90d0-4cd4-9f90-ad820fd77db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:32.666074 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef804867-90d0-4cd4-9f90-ad820fd77db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:32.668544 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef804867-90d0-4cd4-9f90-ad820fd77db5 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:32.679504 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1267/2520] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:20:32.956126 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44461e9f-8f27-4180-975f-72f699ca05ec None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:32.957682 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-44461e9f-8f27-4180-975f-72f699ca05ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:32.970104 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44461e9f-8f27-4180-975f-72f699ca05ec None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:32.975043 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcc095-04f3-4564-bced-138e1f437db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:32.976051 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcc095-04f3-4564-bced-138e1f437db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:32.976400 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcc095-04f3-4564-bced-138e1f437db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:32.976749 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcc095-04f3-4564-bced-138e1f437db1 admin admin] PATH_INFO: `/v3/projects/717d8951fb974c6ba0da577b1f6b8717` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:32.978008 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcc095-04f3-4564-bced-138e1f437db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=717d8951fb974c6ba0da577b1f6b8717)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:32.981196 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcc095-04f3-4564-bced-138e1f437db1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:33.030044 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-64dcc095-04f3-4564-bced-138e1f437db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '717d8951fb974c6ba0da577b1f6b8717', 'request_id': 'req-64dcc095-04f3-4564-bced-138e1f437db1'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:33.037631 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-64dcc095-04f3-4564-bced-138e1f437db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '717d8951fb974c6ba0da577b1f6b8717', 'request_id': 'req-64dcc095-04f3-4564-bced-138e1f437db1'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:33.044033 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-64dcc095-04f3-4564-bced-138e1f437db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '717d8951fb974c6ba0da577b1f6b8717', 'request_id': 'req-64dcc095-04f3-4564-bced-138e1f437db1'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:33.055110 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-64dcc095-04f3-4564-bced-138e1f437db1 admin admin] The token cache is being invalidate because project 717d8951fb974c6ba0da577b1f6b8717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:20:33.055397 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-64dcc095-04f3-4564-bced-138e1f437db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:33.056102 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-64dcc095-04f3-4564-bced-138e1f437db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:33.057612 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1254/2521] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:20:32 2022] DELETE /identity/v3/projects/717d8951fb974c6ba0da577b1f6b8717 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:20:33.063456 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6b369-583d-404e-ab50-f2aa0ade021b None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:33.063881 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6b369-583d-404e-ab50-f2aa0ade021b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:33.064221 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6b369-583d-404e-ab50-f2aa0ade021b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:33.086558 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-2ce6b369-583d-404e-ab50-f2aa0ade021b None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:33.088003 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2ce6b369-583d-404e-ab50-f2aa0ade021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:33.158878 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1268/2522] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:20:33.166750 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b593d1-2461-40fc-a4cf-54dbc11c954b None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:33.167037 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b593d1-2461-40fc-a4cf-54dbc11c954b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:33.167313 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b593d1-2461-40fc-a4cf-54dbc11c954b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:33.187435 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-e6b593d1-2461-40fc-a4cf-54dbc11c954b None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:33.188672 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e6b593d1-2461-40fc-a4cf-54dbc11c954b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:33.196688 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1255/2523] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:33.201345 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6b369-583d-404e-ab50-f2aa0ade021b None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:33.211038 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6b369-583d-404e-ab50-f2aa0ade021b None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:33.216023 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1454f3-c15b-43f0-9ee6-61d7e5e5f09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:33.216677 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1454f3-c15b-43f0-9ee6-61d7e5e5f09d admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:33.216960 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1454f3-c15b-43f0-9ee6-61d7e5e5f09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:33.217235 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1454f3-c15b-43f0-9ee6-61d7e5e5f09d admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:33.217972 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1454f3-c15b-43f0-9ee6-61d7e5e5f09d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:20:33.218274 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1454f3-c15b-43f0-9ee6-61d7e5e5f09d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:33.219869 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1454f3-c15b-43f0-9ee6-61d7e5e5f09d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:33.232574 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1269/2524] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:20:33.237010 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b593d1-2461-40fc-a4cf-54dbc11c954b None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:33.247007 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b593d1-2461-40fc-a4cf-54dbc11c954b None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:33.252201 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ba750-b36b-4c0a-a98e-dedd63e561de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:33.252854 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ba750-b36b-4c0a-a98e-dedd63e561de admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:33.253144 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ba750-b36b-4c0a-a98e-dedd63e561de admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:33.253420 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ba750-b36b-4c0a-a98e-dedd63e561de admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:33.254132 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ba750-b36b-4c0a-a98e-dedd63e561de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:33.256054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ba750-b36b-4c0a-a98e-dedd63e561de admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:33.282071 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1256/2525] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:20:33 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:20:33.286439 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1454f3-c15b-43f0-9ee6-61d7e5e5f09d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:33.298626 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1454f3-c15b-43f0-9ee6-61d7e5e5f09d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:33.354052 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae8bf1-8a5b-4b7e-ac5e-942f8f750b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:33.354765 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae8bf1-8a5b-4b7e-ac5e-942f8f750b7d admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:33.355024 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae8bf1-8a5b-4b7e-ac5e-942f8f750b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:33.355323 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae8bf1-8a5b-4b7e-ac5e-942f8f750b7d admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:33.356992 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae8bf1-8a5b-4b7e-ac5e-942f8f750b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:33.358898 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae8bf1-8a5b-4b7e-ac5e-942f8f750b7d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:33.380214 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1270/2526] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:20:33 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:20:33.384668 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ba750-b36b-4c0a-a98e-dedd63e561de admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:33.395203 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ba750-b36b-4c0a-a98e-dedd63e561de admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:33.400134 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a9a84-3da7-4485-9635-48ab284e8d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:33.400799 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a9a84-3da7-4485-9635-48ab284e8d91 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:33.401112 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a9a84-3da7-4485-9635-48ab284e8d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:33.401361 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a9a84-3da7-4485-9635-48ab284e8d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:33.402099 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a9a84-3da7-4485-9635-48ab284e8d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:33.404450 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a9a84-3da7-4485-9635-48ab284e8d91 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:33.415895 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1257/2527] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:20:33.420628 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae8bf1-8a5b-4b7e-ac5e-942f8f750b7d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:33.430101 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae8bf1-8a5b-4b7e-ac5e-942f8f750b7d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:33.435706 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0faf2a-095b-45f4-aeb4-660686f6f6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:33.436143 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0faf2a-095b-45f4-aeb4-660686f6f6df admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:33.436462 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0faf2a-095b-45f4-aeb4-660686f6f6df admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:33.436683 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0faf2a-095b-45f4-aeb4-660686f6f6df admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:33.437421 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0faf2a-095b-45f4-aeb4-660686f6f6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:33.439003 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0faf2a-095b-45f4-aeb4-660686f6f6df admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:33.450931 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1271/2528] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:20:33.454707 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a9a84-3da7-4485-9635-48ab284e8d91 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:33.468931 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a9a84-3da7-4485-9635-48ab284e8d91 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:33.475282 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9992d1a-09dd-42ee-b935-9f7694a1b066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:33.476538 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9992d1a-09dd-42ee-b935-9f7694a1b066 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:33.476803 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9992d1a-09dd-42ee-b935-9f7694a1b066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:33.477059 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9992d1a-09dd-42ee-b935-9f7694a1b066 admin admin] PATH_INFO: `/v3/projects/c4c4c96cf3844925af14b3a5b64e8cbc/users/5dff1aeae7494dffa46402a466aaec99/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:33.483249 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681f466-e292-4ec8-8c8e-f7738417fdb3 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:33.483539 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681f466-e292-4ec8-8c8e-f7738417fdb3 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:33.484666 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681f466-e292-4ec8-8c8e-f7738417fdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:33.495228 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9992d1a-09dd-42ee-b935-9f7694a1b066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c4c96cf3844925af14b3a5b64e8cbc, user_id=5dff1aeae7494dffa46402a466aaec99, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:33.498477 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9992d1a-09dd-42ee-b935-9f7694a1b066 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:33.513620 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-2681f466-e292-4ec8-8c8e-f7738417fdb3 None None] MFA Rules not processed for user `9dca4ea4f2c8490e823a73dca6c303ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:33.514812 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2681f466-e292-4ec8-8c8e-f7738417fdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:33.519324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1258/2529] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:20:33 2022] PUT /identity/v3/projects/c4c4c96cf3844925af14b3a5b64e8cbc/users/5dff1aeae7494dffa46402a466aaec99/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:20:33.531063 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42539ea-4009-4784-8514-2252b1d2a781 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:33.531453 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42539ea-4009-4784-8514-2252b1d2a781 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:33.531996 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42539ea-4009-4784-8514-2252b1d2a781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:33.562315 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-c42539ea-4009-4784-8514-2252b1d2a781 None None] MFA Rules not processed for user `5dff1aeae7494dffa46402a466aaec99`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:33.563850 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-c42539ea-4009-4784-8514-2252b1d2a781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:33.573201 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1272/2530] 10.222.0.77 () {58 vars in 967 bytes} [Thu Feb 10 23:20:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:33.585864 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681f466-e292-4ec8-8c8e-f7738417fdb3 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:33.587522 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2681f466-e292-4ec8-8c8e-f7738417fdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:33.632960 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1259/2531] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:20:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:20:33.642732 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42539ea-4009-4784-8514-2252b1d2a781 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:33.644078 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-c42539ea-4009-4784-8514-2252b1d2a781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:33.658172 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681f466-e292-4ec8-8c8e-f7738417fdb3 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:33.663807 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de478f6a-bb58-40bb-8594-0c8831c1a1d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce55b64dc528447993e32b00ae4d3a2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:33.664478 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de478f6a-bb58-40bb-8594-0c8831c1a1d2 service swift] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:33.664757 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de478f6a-bb58-40bb-8594-0c8831c1a1d2 service swift] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:33.665032 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de478f6a-bb58-40bb-8594-0c8831c1a1d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:33.673366 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de478f6a-bb58-40bb-8594-0c8831c1a1d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:33.674921 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de478f6a-bb58-40bb-8594-0c8831c1a1d2 service swift] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:33.682739 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1273/2532] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Feb 10 23:20:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 23:20:33.698710 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42539ea-4009-4784-8514-2252b1d2a781 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:33.702955 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc06af-9e87-4335-9c5c-b801363525b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:33.703494 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc06af-9e87-4335-9c5c-b801363525b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:33.703777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc06af-9e87-4335-9c5c-b801363525b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:33.704086 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc06af-9e87-4335-9c5c-b801363525b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:33.712653 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc06af-9e87-4335-9c5c-b801363525b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:33.714124 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc06af-9e87-4335-9c5c-b801363525b5 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:33.723027 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1260/2533] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:20:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:20:35.060743 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccff100-2e6c-43f6-a822-ec14dbd298a4 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:35.061280 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccff100-2e6c-43f6-a822-ec14dbd298a4 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:35.061375 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccff100-2e6c-43f6-a822-ec14dbd298a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:35.079849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-bccff100-2e6c-43f6-a822-ec14dbd298a4 None None] MFA Rules not processed for user `5dff1aeae7494dffa46402a466aaec99`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:35.081231 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-bccff100-2e6c-43f6-a822-ec14dbd298a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:35.088468 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1274/2534] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:20:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:35.578137 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc06af-9e87-4335-9c5c-b801363525b5 service cinder] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:35.579715 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-ffcc06af-9e87-4335-9c5c-b801363525b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:35.658046 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc06af-9e87-4335-9c5c-b801363525b5 service cinder] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:35.662966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1edc2-476e-4de8-9848-9ff6c28a3c9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f5243eef2a24a518b30526425c0b2c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:35.663611 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1edc2-476e-4de8-9848-9ff6c28a3c9f service placement] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:35.663917 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1edc2-476e-4de8-9848-9ff6c28a3c9f service placement] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:35.664193 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1edc2-476e-4de8-9848-9ff6c28a3c9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:35.665938 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-70e1edc2-476e-4de8-9848-9ff6c28a3c9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:35.677956 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1edc2-476e-4de8-9848-9ff6c28a3c9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:35.679739 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1edc2-476e-4de8-9848-9ff6c28a3c9f service placement] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:35.691198 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1261/2535] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:20:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:20:35.751096 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccff100-2e6c-43f6-a822-ec14dbd298a4 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:35.752477 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-bccff100-2e6c-43f6-a822-ec14dbd298a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:35.808720 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccff100-2e6c-43f6-a822-ec14dbd298a4 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:35.812800 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83e747-d4b2-479d-81ff-43f49ff7975f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:35.813435 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83e747-d4b2-479d-81ff-43f49ff7975f service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:35.813711 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83e747-d4b2-479d-81ff-43f49ff7975f service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:35.813979 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83e747-d4b2-479d-81ff-43f49ff7975f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:35.815773 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-7f83e747-d4b2-479d-81ff-43f49ff7975f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:35.882671 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83e747-d4b2-479d-81ff-43f49ff7975f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:35.884042 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83e747-d4b2-479d-81ff-43f49ff7975f service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:35.894575 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1275/2536] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:20:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:20:39.497031 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1edc2-476e-4de8-9848-9ff6c28a3c9f service placement] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:39.507194 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1edc2-476e-4de8-9848-9ff6c28a3c9f service placement] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:39.510943 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d2010-1741-4ce9-981f-d466b39befb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:39.511579 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d2010-1741-4ce9-981f-d466b39befb8 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:39.511891 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d2010-1741-4ce9-981f-d466b39befb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:39.512167 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d2010-1741-4ce9-981f-d466b39befb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:39.513932 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-5f8d2010-1741-4ce9-981f-d466b39befb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:39.525408 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d2010-1741-4ce9-981f-d466b39befb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:39.527037 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d2010-1741-4ce9-981f-d466b39befb8 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:39.538388 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1262/2537] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:20:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:20:48.356401 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83e747-d4b2-479d-81ff-43f49ff7975f service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:48.365952 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83e747-d4b2-479d-81ff-43f49ff7975f service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:48.369893 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4907ee-6dc9-4ff5-ab4f-16630e0e6389 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:48.370515 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4907ee-6dc9-4ff5-ab4f-16630e0e6389 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:48.370794 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4907ee-6dc9-4ff5-ab4f-16630e0e6389 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:48.371062 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4907ee-6dc9-4ff5-ab4f-16630e0e6389 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:48.373243 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-fe4907ee-6dc9-4ff5-ab4f-16630e0e6389 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:48.430085 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4907ee-6dc9-4ff5-ab4f-16630e0e6389 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:48.431505 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4907ee-6dc9-4ff5-ab4f-16630e0e6389 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:48.440401 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1276/2538] 10.222.0.77 () {60 vars in 1396 bytes} [Thu Feb 10 23:20:48 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:20:52.634183 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d2010-1741-4ce9-981f-d466b39befb8 service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:52.635629 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-5f8d2010-1741-4ce9-981f-d466b39befb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:52.722611 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d2010-1741-4ce9-981f-d466b39befb8 service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:52.729736 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372e2af-3c1e-495b-a1e0-17b0c7e30463 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:52.730395 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372e2af-3c1e-495b-a1e0-17b0c7e30463 service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:52.730679 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372e2af-3c1e-495b-a1e0-17b0c7e30463 service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:52.730951 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372e2af-3c1e-495b-a1e0-17b0c7e30463 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:52.732937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-6372e2af-3c1e-495b-a1e0-17b0c7e30463 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:52.746309 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372e2af-3c1e-495b-a1e0-17b0c7e30463 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:52.748168 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372e2af-3c1e-495b-a1e0-17b0c7e30463 service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:52.761312 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1263/2539] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:20:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:20:53.728983 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6626b-6c0f-4501-b070-b8ea82564c34 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:53.729556 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6626b-6c0f-4501-b070-b8ea82564c34 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:53.729556 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6626b-6c0f-4501-b070-b8ea82564c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:53.747530 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-72e6626b-6c0f-4501-b070-b8ea82564c34 None None] MFA Rules not processed for user `9dca4ea4f2c8490e823a73dca6c303ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:53.748747 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-72e6626b-6c0f-4501-b070-b8ea82564c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:53.756293 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1277/2540] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Feb 10 23:20:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:20:53.779030 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372e2af-3c1e-495b-a1e0-17b0c7e30463 service nova] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:53.790339 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372e2af-3c1e-495b-a1e0-17b0c7e30463 service nova] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:53.795512 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556bbce-339b-49de-a5ec-531cd05b5272 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce55b64dc528447993e32b00ae4d3a2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:53.796406 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556bbce-339b-49de-a5ec-531cd05b5272 service swift] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:53.796797 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556bbce-339b-49de-a5ec-531cd05b5272 service swift] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:53.797188 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556bbce-339b-49de-a5ec-531cd05b5272 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:53.806676 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556bbce-339b-49de-a5ec-531cd05b5272 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:53.809056 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556bbce-339b-49de-a5ec-531cd05b5272 service swift] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:53.818401 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1264/2541] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Feb 10 23:20:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:20:54.308664 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59368a6f-2f78-45ca-9392-b83bc6713e99 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:54.308944 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59368a6f-2f78-45ca-9392-b83bc6713e99 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:54.309214 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59368a6f-2f78-45ca-9392-b83bc6713e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:54.326126 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-59368a6f-2f78-45ca-9392-b83bc6713e99 None None] MFA Rules not processed for user `9dca4ea4f2c8490e823a73dca6c303ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:54.327274 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-59368a6f-2f78-45ca-9392-b83bc6713e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:54.334632 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1278/2542] 10.222.0.77 () {58 vars in 967 bytes} [Thu Feb 10 23:20:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:54.346670 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556bbce-339b-49de-a5ec-531cd05b5272 service swift] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:54.357287 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556bbce-339b-49de-a5ec-531cd05b5272 service swift] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:54.362503 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f4480-7b2f-49af-87f7-f16dc4767802 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce55b64dc528447993e32b00ae4d3a2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:54.363126 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f4480-7b2f-49af-87f7-f16dc4767802 service swift] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:54.363405 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f4480-7b2f-49af-87f7-f16dc4767802 service swift] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:54.363677 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f4480-7b2f-49af-87f7-f16dc4767802 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:54.372347 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f4480-7b2f-49af-87f7-f16dc4767802 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:54.373983 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f4480-7b2f-49af-87f7-f16dc4767802 service swift] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:54.383370 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1265/2543] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Feb 10 23:20:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:20:54.580592 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328656f-1bbc-493c-987c-2ea163fb469a None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:54.580883 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328656f-1bbc-493c-987c-2ea163fb469a None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:54.581158 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328656f-1bbc-493c-987c-2ea163fb469a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:54.598623 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-7328656f-1bbc-493c-987c-2ea163fb469a None None] MFA Rules not processed for user `9dca4ea4f2c8490e823a73dca6c303ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:54.599786 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-7328656f-1bbc-493c-987c-2ea163fb469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:54.607631 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1279/2544] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Feb 10 23:20:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:54.620143 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f4480-7b2f-49af-87f7-f16dc4767802 service swift] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:54.631050 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f4480-7b2f-49af-87f7-f16dc4767802 service swift] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:54.636165 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72c70f-1c07-46a1-b297-e0d92f791cb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce55b64dc528447993e32b00ae4d3a2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:54.636819 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72c70f-1c07-46a1-b297-e0d92f791cb6 service swift] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:54.637097 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72c70f-1c07-46a1-b297-e0d92f791cb6 service swift] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:54.637367 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72c70f-1c07-46a1-b297-e0d92f791cb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:54.645218 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72c70f-1c07-46a1-b297-e0d92f791cb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:54.646772 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72c70f-1c07-46a1-b297-e0d92f791cb6 service swift] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:54.654692 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1266/2545] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Feb 10 23:20:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:20:54.962816 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b07b1a-cd78-489c-9212-413a1508bcde None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:54.963279 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b07b1a-cd78-489c-9212-413a1508bcde None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:54.963386 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b07b1a-cd78-489c-9212-413a1508bcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:54.980445 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-b0b07b1a-cd78-489c-9212-413a1508bcde None None] MFA Rules not processed for user `9dca4ea4f2c8490e823a73dca6c303ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:54.981625 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-b0b07b1a-cd78-489c-9212-413a1508bcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:54.988511 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1280/2546] 10.222.0.77 () {58 vars in 967 bytes} [Thu Feb 10 23:20:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:55.001437 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72c70f-1c07-46a1-b297-e0d92f791cb6 service swift] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:55.012108 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72c70f-1c07-46a1-b297-e0d92f791cb6 service swift] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:55.016952 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41322187-1684-4b83-8673-1e0a49acb5a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce55b64dc528447993e32b00ae4d3a2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:55.017574 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41322187-1684-4b83-8673-1e0a49acb5a6 service swift] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:55.017926 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41322187-1684-4b83-8673-1e0a49acb5a6 service swift] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:55.018153 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41322187-1684-4b83-8673-1e0a49acb5a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:55.025854 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41322187-1684-4b83-8673-1e0a49acb5a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:55.027428 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41322187-1684-4b83-8673-1e0a49acb5a6 service swift] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:55.035091 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1267/2547] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Feb 10 23:20:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:20:57.020056 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b07b1a-cd78-489c-9212-413a1508bcde None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:57.080551 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b07b1a-cd78-489c-9212-413a1508bcde None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:57.085444 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775cedd-be65-4865-b32e-37fc6e823db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:57.086407 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775cedd-be65-4865-b32e-37fc6e823db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:57.086694 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775cedd-be65-4865-b32e-37fc6e823db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:57.086973 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775cedd-be65-4865-b32e-37fc6e823db3 admin admin] PATH_INFO: `/v3/users/5dff1aeae7494dffa46402a466aaec99` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:57.088705 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775cedd-be65-4865-b32e-37fc6e823db3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dff1aeae7494dffa46402a466aaec99)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:57.090787 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775cedd-be65-4865-b32e-37fc6e823db3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:57.136308 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4775cedd-be65-4865-b32e-37fc6e823db3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dff1aeae7494dffa46402a466aaec99'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:57.147295 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4775cedd-be65-4865-b32e-37fc6e823db3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dff1aeae7494dffa46402a466aaec99'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:57.147992 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4775cedd-be65-4865-b32e-37fc6e823db3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dff1aeae7494dffa46402a466aaec99'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:57.155527 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4775cedd-be65-4865-b32e-37fc6e823db3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dff1aeae7494dffa46402a466aaec99'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:57.156273 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4775cedd-be65-4865-b32e-37fc6e823db3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dff1aeae7494dffa46402a466aaec99'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:57.168727 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1281/2548] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:20:57 2022] DELETE /identity/v3/users/5dff1aeae7494dffa46402a466aaec99 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:20:57.173179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf2673-4c0a-4764-876c-8f7e69ae3d98 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:57.173681 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf2673-4c0a-4764-876c-8f7e69ae3d98 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:57.173790 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf2673-4c0a-4764-876c-8f7e69ae3d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:57.190863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-edbf2673-4c0a-4764-876c-8f7e69ae3d98 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:20:57.192076 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-edbf2673-4c0a-4764-876c-8f7e69ae3d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:57.248844 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1268/2549] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:20:57.258788 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775cedd-be65-4865-b32e-37fc6e823db3 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:57.260228 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-4775cedd-be65-4865-b32e-37fc6e823db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:57.316498 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775cedd-be65-4865-b32e-37fc6e823db3 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:57.320093 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c2cd4-87f1-4395-8ab0-0f5f132739b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:57.320728 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c2cd4-87f1-4395-8ab0-0f5f132739b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:57.321008 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c2cd4-87f1-4395-8ab0-0f5f132739b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:57.321282 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c2cd4-87f1-4395-8ab0-0f5f132739b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:57.330514 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c2cd4-87f1-4395-8ab0-0f5f132739b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:57.331944 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c2cd4-87f1-4395-8ab0-0f5f132739b0 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:57.341939 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1282/2550] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:20:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:20:57.509714 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf2673-4c0a-4764-876c-8f7e69ae3d98 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:20:57.512182 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-edbf2673-4c0a-4764-876c-8f7e69ae3d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:20:57.534057 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf2673-4c0a-4764-876c-8f7e69ae3d98 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:20:57.538875 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9ab37-901d-4ef0-9aa3-41d3b1b34d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:20:57.539729 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9ab37-901d-4ef0-9aa3-41d3b1b34d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:20:57.540041 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9ab37-901d-4ef0-9aa3-41d3b1b34d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:20:57.540316 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9ab37-901d-4ef0-9aa3-41d3b1b34d35 admin admin] PATH_INFO: `/v3/projects/c4c4c96cf3844925af14b3a5b64e8cbc` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:20:57.541563 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9ab37-901d-4ef0-9aa3-41d3b1b34d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4c4c96cf3844925af14b3a5b64e8cbc)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:20:57.543940 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9ab37-901d-4ef0-9aa3-41d3b1b34d35 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:20:57.593339 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4eb9ab37-901d-4ef0-9aa3-41d3b1b34d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4c4c96cf3844925af14b3a5b64e8cbc', 'request_id': 'req-4eb9ab37-901d-4ef0-9aa3-41d3b1b34d35'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:57.600146 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4eb9ab37-901d-4ef0-9aa3-41d3b1b34d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4c4c96cf3844925af14b3a5b64e8cbc', 'request_id': 'req-4eb9ab37-901d-4ef0-9aa3-41d3b1b34d35'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:57.605361 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4eb9ab37-901d-4ef0-9aa3-41d3b1b34d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4c4c96cf3844925af14b3a5b64e8cbc', 'request_id': 'req-4eb9ab37-901d-4ef0-9aa3-41d3b1b34d35'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:57.615937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4eb9ab37-901d-4ef0-9aa3-41d3b1b34d35 admin admin] The token cache is being invalidate because project c4c4c96cf3844925af14b3a5b64e8cbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:20:57.616218 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4eb9ab37-901d-4ef0-9aa3-41d3b1b34d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:57.616837 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-4eb9ab37-901d-4ef0-9aa3-41d3b1b34d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:20:57.618342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1269/2551] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:20:57 2022] DELETE /identity/v3/projects/c4c4c96cf3844925af14b3a5b64e8cbc => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:21:50.450305 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d7bb3-20fd-4840-846c-15f788e578ae None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:21:50.450836 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d7bb3-20fd-4840-846c-15f788e578ae None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:21:50.450949 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d7bb3-20fd-4840-846c-15f788e578ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:21:50.468529 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-b14d7bb3-20fd-4840-846c-15f788e578ae None None] MFA Rules not processed for user `d9ec05486d1f427c9dc6ef2fe1fe7469`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:21:50.469942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-b14d7bb3-20fd-4840-846c-15f788e578ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:21:50.521847 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1283/2552] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:21:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:21:50.819496 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9ab37-901d-4ef0-9aa3-41d3b1b34d35 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:21:50.821510 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-4eb9ab37-901d-4ef0-9aa3-41d3b1b34d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:21:50.876314 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9ab37-901d-4ef0-9aa3-41d3b1b34d35 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:21:50.879915 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda99000-5a57-4467-a462-f57e7e661da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:21:50.880495 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda99000-5a57-4467-a462-f57e7e661da1 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:21:50.880772 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda99000-5a57-4467-a462-f57e7e661da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:21:50.881043 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda99000-5a57-4467-a462-f57e7e661da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:21:50.882765 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-dda99000-5a57-4467-a462-f57e7e661da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:21:50.892479 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda99000-5a57-4467-a462-f57e7e661da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:21:50.893874 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda99000-5a57-4467-a462-f57e7e661da1 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:21:50.901876 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1270/2553] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:21:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:21:52.114983 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d7bb3-20fd-4840-846c-15f788e578ae None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:21:52.125142 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d7bb3-20fd-4840-846c-15f788e578ae None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:21:52.129689 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21516bd6-6522-4f70-ba66-89cebd12783e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:21:52.130331 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21516bd6-6522-4f70-ba66-89cebd12783e service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:21:52.130614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21516bd6-6522-4f70-ba66-89cebd12783e service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:21:52.130889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21516bd6-6522-4f70-ba66-89cebd12783e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:21:52.132715 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-21516bd6-6522-4f70-ba66-89cebd12783e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:21:52.143719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21516bd6-6522-4f70-ba66-89cebd12783e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:21:52.145164 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21516bd6-6522-4f70-ba66-89cebd12783e service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:21:52.154608 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1284/2554] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:21:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:21:59.310053 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda99000-5a57-4467-a462-f57e7e661da1 service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:21:59.311774 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-dda99000-5a57-4467-a462-f57e7e661da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:21:59.389150 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda99000-5a57-4467-a462-f57e7e661da1 service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:21:59.396526 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00574c24-6723-47cb-99f7-c98bb4560f3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:21:59.397202 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00574c24-6723-47cb-99f7-c98bb4560f3e service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:21:59.397707 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00574c24-6723-47cb-99f7-c98bb4560f3e service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:21:59.397963 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00574c24-6723-47cb-99f7-c98bb4560f3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:21:59.400022 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-00574c24-6723-47cb-99f7-c98bb4560f3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:21:59.412847 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00574c24-6723-47cb-99f7-c98bb4560f3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:21:59.414456 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00574c24-6723-47cb-99f7-c98bb4560f3e service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:21:59.424811 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1271/2555] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:21:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:22:02.878253 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21516bd6-6522-4f70-ba66-89cebd12783e service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:22:02.880416 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-21516bd6-6522-4f70-ba66-89cebd12783e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:22:02.897926 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21516bd6-6522-4f70-ba66-89cebd12783e service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:22:02.904724 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663a3ea-4b0a-4e5b-86ee-1bf74742c9dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:22:02.905378 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663a3ea-4b0a-4e5b-86ee-1bf74742c9dc service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:22:02.905647 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663a3ea-4b0a-4e5b-86ee-1bf74742c9dc service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:22:02.905916 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663a3ea-4b0a-4e5b-86ee-1bf74742c9dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:22:02.907735 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-6663a3ea-4b0a-4e5b-86ee-1bf74742c9dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:22:02.922037 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663a3ea-4b0a-4e5b-86ee-1bf74742c9dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:22:02.923800 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663a3ea-4b0a-4e5b-86ee-1bf74742c9dc service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:22:02.935480 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1285/2556] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:22:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:22:11.831562 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be1026-bf04-4d67-adc6-f2acd5359c75 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:22:11.832054 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be1026-bf04-4d67-adc6-f2acd5359c75 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:22:11.832261 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be1026-bf04-4d67-adc6-f2acd5359c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:22:11.849590 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-f2be1026-bf04-4d67-adc6-f2acd5359c75 None None] MFA Rules not processed for user `a1190ab3568d40ac81b172012b78d18c`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:22:11.851061 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-f2be1026-bf04-4d67-adc6-f2acd5359c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:22:11.904165 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1272/2557] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:22:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:22:12.207234 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663a3ea-4b0a-4e5b-86ee-1bf74742c9dc service nova] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:22:12.208649 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-6663a3ea-4b0a-4e5b-86ee-1bf74742c9dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:22:12.220533 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663a3ea-4b0a-4e5b-86ee-1bf74742c9dc service nova] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:22:12.224245 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35b2a2-b574-4522-80f2-a6d86063a03a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:22:12.225485 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35b2a2-b574-4522-80f2-a6d86063a03a service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:22:12.225853 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35b2a2-b574-4522-80f2-a6d86063a03a service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:22:12.226131 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35b2a2-b574-4522-80f2-a6d86063a03a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:22:12.227858 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-8c35b2a2-b574-4522-80f2-a6d86063a03a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:22:12.236909 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35b2a2-b574-4522-80f2-a6d86063a03a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:22:12.238303 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35b2a2-b574-4522-80f2-a6d86063a03a service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:22:12.246064 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1286/2558] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:22:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:23:19.619013 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a39d6c-e29c-41af-ad6f-c68706ec3918 None None] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:19.619598 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a39d6c-e29c-41af-ad6f-c68706ec3918 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:19.619598 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a39d6c-e29c-41af-ad6f-c68706ec3918 None None] PATH_INFO: `/` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:19.621494 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1273/2559] 10.222.0.77 () {54 vars in 921 bytes} [Thu Feb 10 23:23:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:23:19.627737 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a01b4-2eee-489d-af07-5ebdda329570 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:19.628281 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a01b4-2eee-489d-af07-5ebdda329570 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:19.628388 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a01b4-2eee-489d-af07-5ebdda329570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:19.646871 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-3d9a01b4-2eee-489d-af07-5ebdda329570 None None] MFA Rules not processed for user `0d2af52f48dc435ca9a48cc0a32c31e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:23:19.648257 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-3d9a01b4-2eee-489d-af07-5ebdda329570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:23:19.655730 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1287/2560] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Feb 10 23:23:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:23:19.667883 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a39d6c-e29c-41af-ad6f-c68706ec3918 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:23:19.678795 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a39d6c-e29c-41af-ad6f-c68706ec3918 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:23:19.682920 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2fbd1-9d51-4975-99cc-ffc612631a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:23:19.683629 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2fbd1-9d51-4975-99cc-ffc612631a20 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:19.684031 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2fbd1-9d51-4975-99cc-ffc612631a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:19.684380 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2fbd1-9d51-4975-99cc-ffc612631a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:19.692084 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2fbd1-9d51-4975-99cc-ffc612631a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:23:19.693631 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2fbd1-9d51-4975-99cc-ffc612631a20 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:23:19.703023 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1274/2561] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:23:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:23:19.798882 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0418e-a412-4042-8431-2a8d94b65daf None None] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:19.799255 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0418e-a412-4042-8431-2a8d94b65daf None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:19.799551 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0418e-a412-4042-8431-2a8d94b65daf None None] PATH_INFO: `/` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:19.801419 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1288/2562] 10.222.0.77 () {54 vars in 921 bytes} [Thu Feb 10 23:23:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 23:23:19.807966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b926-440a-447c-a6db-28cad7622d9c None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:19.808253 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b926-440a-447c-a6db-28cad7622d9c None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:19.808628 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b926-440a-447c-a6db-28cad7622d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:19.826981 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-af89b926-440a-447c-a6db-28cad7622d9c None None] MFA Rules not processed for user `551da2c9fab74cb8b14287a5634adb25`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:23:19.828203 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-af89b926-440a-447c-a6db-28cad7622d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:23:19.837329 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1275/2563] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Feb 10 23:23:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:23:19.848658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0418e-a412-4042-8431-2a8d94b65daf None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:23:19.859315 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0418e-a412-4042-8431-2a8d94b65daf None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:23:19.862810 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05798df5-4df2-4450-9421-54d6d613471b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:23:19.863426 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05798df5-4df2-4450-9421-54d6d613471b service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:19.863701 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05798df5-4df2-4450-9421-54d6d613471b service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:19.863998 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05798df5-4df2-4450-9421-54d6d613471b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:19.874231 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05798df5-4df2-4450-9421-54d6d613471b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:23:19.875558 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05798df5-4df2-4450-9421-54d6d613471b service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:23:19.886324 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1289/2564] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:23:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:23:41.604563 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c1f5d-d0b2-4328-adfa-79746b5b92d5 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:41.605100 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c1f5d-d0b2-4328-adfa-79746b5b92d5 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:41.605209 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c1f5d-d0b2-4328-adfa-79746b5b92d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:41.623481 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-869c1f5d-d0b2-4328-adfa-79746b5b92d5 None None] MFA Rules not processed for user `9dca4ea4f2c8490e823a73dca6c303ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:23:41.624718 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-869c1f5d-d0b2-4328-adfa-79746b5b92d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:23:41.678707 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1276/2565] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Feb 10 23:23:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:23:41.725576 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05798df5-4df2-4450-9421-54d6d613471b service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:23:41.726968 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-05798df5-4df2-4450-9421-54d6d613471b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:23:41.793539 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05798df5-4df2-4450-9421-54d6d613471b service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:23:41.798435 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c982d3-140f-487a-8965-fe13cdd82dff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce55b64dc528447993e32b00ae4d3a2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:23:41.799071 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c982d3-140f-487a-8965-fe13cdd82dff service swift] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:41.799354 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c982d3-140f-487a-8965-fe13cdd82dff service swift] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:41.799624 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c982d3-140f-487a-8965-fe13cdd82dff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:41.807713 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c982d3-140f-487a-8965-fe13cdd82dff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:23:41.809962 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c982d3-140f-487a-8965-fe13cdd82dff service swift] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:23:41.817784 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1290/2566] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Feb 10 23:23:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:23:49.008533 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c1f5d-d0b2-4328-adfa-79746b5b92d5 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:23:49.010138 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-869c1f5d-d0b2-4328-adfa-79746b5b92d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:23:49.114751 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c1f5d-d0b2-4328-adfa-79746b5b92d5 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:23:49.120977 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc15b6f-7f78-4329-8207-caaed5df300f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f5243eef2a24a518b30526425c0b2c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:23:49.121871 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc15b6f-7f78-4329-8207-caaed5df300f service placement] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:49.122330 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc15b6f-7f78-4329-8207-caaed5df300f service placement] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:49.122777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc15b6f-7f78-4329-8207-caaed5df300f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:49.125809 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-bdc15b6f-7f78-4329-8207-caaed5df300f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:23:49.141252 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc15b6f-7f78-4329-8207-caaed5df300f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:23:49.142875 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc15b6f-7f78-4329-8207-caaed5df300f service placement] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:23:49.164447 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1277/2567] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:23:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:23:54.592660 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c982d3-140f-487a-8965-fe13cdd82dff service swift] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:23:54.601603 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c982d3-140f-487a-8965-fe13cdd82dff service swift] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:23:54.605088 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502a4b4-2a62-4b68-bf0f-5cb19b19e6d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:23:54.606379 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502a4b4-2a62-4b68-bf0f-5cb19b19e6d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:54.606656 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502a4b4-2a62-4b68-bf0f-5cb19b19e6d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:54.606925 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502a4b4-2a62-4b68-bf0f-5cb19b19e6d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:54.608658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d502a4b4-2a62-4b68-bf0f-5cb19b19e6d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:23:54.674708 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502a4b4-2a62-4b68-bf0f-5cb19b19e6d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:23:54.676176 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502a4b4-2a62-4b68-bf0f-5cb19b19e6d1 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:23:54.685665 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1291/2568] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:23:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:23:58.680654 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e24b55-4aeb-4685-944b-b5e1707df309 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:58.681193 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e24b55-4aeb-4685-944b-b5e1707df309 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:58.682132 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e24b55-4aeb-4685-944b-b5e1707df309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:58.696528 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502a4b4-2a62-4b68-bf0f-5cb19b19e6d1 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:23:58.698700 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d502a4b4-2a62-4b68-bf0f-5cb19b19e6d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:23:58.710121 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-31e24b55-4aeb-4685-944b-b5e1707df309 None None] MFA Rules not processed for user `9dca4ea4f2c8490e823a73dca6c303ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:23:58.711336 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-31e24b55-4aeb-4685-944b-b5e1707df309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:23:58.711701 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502a4b4-2a62-4b68-bf0f-5cb19b19e6d1 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:23:58.716597 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83784b-8918-4683-a993-fabc533dc723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:23:58.717814 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83784b-8918-4683-a993-fabc533dc723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:58.718160 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83784b-8918-4683-a993-fabc533dc723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:58.718429 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83784b-8918-4683-a993-fabc533dc723 admin admin] PATH_INFO: `/v3/users/a1190ab3568d40ac81b172012b78d18c` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:58.719122 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1278/2569] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Feb 10 23:23:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:23:58.719680 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83784b-8918-4683-a993-fabc533dc723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1190ab3568d40ac81b172012b78d18c)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:23:58.721835 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83784b-8918-4683-a993-fabc533dc723 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:23:58.731306 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e24b55-4aeb-4685-944b-b5e1707df309 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:23:58.743175 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e24b55-4aeb-4685-944b-b5e1707df309 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:23:58.750213 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efcdba-b3bf-4423-9c76-2971bc8766f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce55b64dc528447993e32b00ae4d3a2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:23:58.750865 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efcdba-b3bf-4423-9c76-2971bc8766f4 service swift] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:58.751145 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efcdba-b3bf-4423-9c76-2971bc8766f4 service swift] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:58.751429 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efcdba-b3bf-4423-9c76-2971bc8766f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:58.760057 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efcdba-b3bf-4423-9c76-2971bc8766f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:23:58.761829 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efcdba-b3bf-4423-9c76-2971bc8766f4 service swift] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:23:58.768154 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4c83784b-8918-4683-a993-fabc533dc723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1190ab3568d40ac81b172012b78d18c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:23:58.770068 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1279/2570] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Feb 10 23:23:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 23:23:58.782792 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4c83784b-8918-4683-a993-fabc533dc723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1190ab3568d40ac81b172012b78d18c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:23:58.783606 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4c83784b-8918-4683-a993-fabc533dc723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1190ab3568d40ac81b172012b78d18c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:23:58.792046 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4c83784b-8918-4683-a993-fabc533dc723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1190ab3568d40ac81b172012b78d18c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:23:58.792712 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4c83784b-8918-4683-a993-fabc533dc723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1190ab3568d40ac81b172012b78d18c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:23:58.805395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1292/2571] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:23:58 2022] DELETE /identity/v3/users/a1190ab3568d40ac81b172012b78d18c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:23:59.065497 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efcdba-b3bf-4423-9c76-2971bc8766f4 service swift] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:23:59.086665 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efcdba-b3bf-4423-9c76-2971bc8766f4 service swift] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:23:59.177988 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83bf29-873c-40f2-83c2-8f80d65bc932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:23:59.179258 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83bf29-873c-40f2-83c2-8f80d65bc932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:59.179547 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83bf29-873c-40f2-83c2-8f80d65bc932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:59.179842 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83bf29-873c-40f2-83c2-8f80d65bc932 admin admin] PATH_INFO: `/v3/projects/77ee0d232a574e3e8ad570987e058990` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:59.181392 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83bf29-873c-40f2-83c2-8f80d65bc932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77ee0d232a574e3e8ad570987e058990)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:23:59.184229 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83bf29-873c-40f2-83c2-8f80d65bc932 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:23:59.255333 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-6b83bf29-873c-40f2-83c2-8f80d65bc932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ee0d232a574e3e8ad570987e058990', 'request_id': 'req-6b83bf29-873c-40f2-83c2-8f80d65bc932'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:23:59.270646 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-6b83bf29-873c-40f2-83c2-8f80d65bc932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ee0d232a574e3e8ad570987e058990', 'request_id': 'req-6b83bf29-873c-40f2-83c2-8f80d65bc932'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:23:59.279332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-6b83bf29-873c-40f2-83c2-8f80d65bc932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ee0d232a574e3e8ad570987e058990', 'request_id': 'req-6b83bf29-873c-40f2-83c2-8f80d65bc932'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:23:59.295863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-6b83bf29-873c-40f2-83c2-8f80d65bc932 admin admin] The token cache is being invalidate because project 77ee0d232a574e3e8ad570987e058990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:23:59.296200 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-6b83bf29-873c-40f2-83c2-8f80d65bc932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:23:59.296875 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-6b83bf29-873c-40f2-83c2-8f80d65bc932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:23:59.298472 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1280/2572] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:23:59 2022] DELETE /identity/v3/projects/77ee0d232a574e3e8ad570987e058990 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:23:59.303535 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045bcfc-3b76-4b7f-b919-ee9de7c0a31c None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:59.303938 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045bcfc-3b76-4b7f-b919-ee9de7c0a31c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:59.304456 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045bcfc-3b76-4b7f-b919-ee9de7c0a31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:59.327285 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-f045bcfc-3b76-4b7f-b919-ee9de7c0a31c None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:23:59.328915 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-f045bcfc-3b76-4b7f-b919-ee9de7c0a31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:23:59.395616 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1293/2573] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:23:59.404230 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04281f-b01e-4f90-ad78-1ee02fe1f7fd None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:59.404481 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04281f-b01e-4f90-ad78-1ee02fe1f7fd None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:59.404764 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04281f-b01e-4f90-ad78-1ee02fe1f7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:59.426134 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-ca04281f-b01e-4f90-ad78-1ee02fe1f7fd None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:23:59.427337 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-ca04281f-b01e-4f90-ad78-1ee02fe1f7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:23:59.436215 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1281/2574] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:23:59.440745 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045bcfc-3b76-4b7f-b919-ee9de7c0a31c None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:23:59.452297 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045bcfc-3b76-4b7f-b919-ee9de7c0a31c None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:23:59.457061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8c1ea-bfe0-43b4-b955-4a62ce1fb34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:23:59.457724 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8c1ea-bfe0-43b4-b955-4a62ce1fb34b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:59.458008 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8c1ea-bfe0-43b4-b955-4a62ce1fb34b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:59.458286 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8c1ea-bfe0-43b4-b955-4a62ce1fb34b admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:59.459031 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8c1ea-bfe0-43b4-b955-4a62ce1fb34b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:23:59.459341 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8c1ea-bfe0-43b4-b955-4a62ce1fb34b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:23:59.460965 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8c1ea-bfe0-43b4-b955-4a62ce1fb34b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:23:59.477056 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1294/2575] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:23:59.479324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04281f-b01e-4f90-ad78-1ee02fe1f7fd None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:23:59.493494 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04281f-b01e-4f90-ad78-1ee02fe1f7fd None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:23:59.499149 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f32d37-9bfb-42bc-b54a-e90e6282fdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:23:59.499847 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f32d37-9bfb-42bc-b54a-e90e6282fdf1 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:59.500762 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f32d37-9bfb-42bc-b54a-e90e6282fdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:59.501045 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f32d37-9bfb-42bc-b54a-e90e6282fdf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:59.504155 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f32d37-9bfb-42bc-b54a-e90e6282fdf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:23:59.506337 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f32d37-9bfb-42bc-b54a-e90e6282fdf1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:23:59.569563 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1282/2576] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:23:59 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:23:59.573704 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8c1ea-bfe0-43b4-b955-4a62ce1fb34b admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:23:59.587615 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8c1ea-bfe0-43b4-b955-4a62ce1fb34b admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:23:59.651754 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fad6b-fc59-49bc-93ff-7dc17867b854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:23:59.653056 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fad6b-fc59-49bc-93ff-7dc17867b854 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:59.653395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fad6b-fc59-49bc-93ff-7dc17867b854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:59.653586 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fad6b-fc59-49bc-93ff-7dc17867b854 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:59.654459 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fad6b-fc59-49bc-93ff-7dc17867b854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:23:59.656336 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fad6b-fc59-49bc-93ff-7dc17867b854 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:23:59.682201 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1295/2577] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:23:59 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:23:59.686701 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f32d37-9bfb-42bc-b54a-e90e6282fdf1 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:23:59.701490 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f32d37-9bfb-42bc-b54a-e90e6282fdf1 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:23:59.706656 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a245c5-d956-4370-934a-4499f0e5f1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:23:59.707326 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a245c5-d956-4370-934a-4499f0e5f1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:59.707607 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a245c5-d956-4370-934a-4499f0e5f1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:59.707914 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a245c5-d956-4370-934a-4499f0e5f1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:59.708680 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a245c5-d956-4370-934a-4499f0e5f1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:23:59.710273 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a245c5-d956-4370-934a-4499f0e5f1a7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:23:59.722002 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1283/2578] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:23:59.725818 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fad6b-fc59-49bc-93ff-7dc17867b854 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:23:59.736814 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fad6b-fc59-49bc-93ff-7dc17867b854 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:23:59.741509 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8969c02-5238-4b75-9388-9df06358a343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:23:59.742166 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8969c02-5238-4b75-9388-9df06358a343 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:59.742443 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8969c02-5238-4b75-9388-9df06358a343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:59.742716 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8969c02-5238-4b75-9388-9df06358a343 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:59.743448 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8969c02-5238-4b75-9388-9df06358a343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:23:59.745049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8969c02-5238-4b75-9388-9df06358a343 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:23:59.758505 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1296/2579] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:23:59.759797 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a245c5-d956-4370-934a-4499f0e5f1a7 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:23:59.770992 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a245c5-d956-4370-934a-4499f0e5f1a7 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:23:59.776267 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67796d0-aa3f-4218-a1ec-f087023b223a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:23:59.777188 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67796d0-aa3f-4218-a1ec-f087023b223a admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:59.778087 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67796d0-aa3f-4218-a1ec-f087023b223a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:59.778780 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67796d0-aa3f-4218-a1ec-f087023b223a admin admin] PATH_INFO: `/v3/projects/e3979c6b20a74123a49c15841de6e726/users/b66059c644f84207aa4b1edd0e8e1eb9/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:59.794536 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67796d0-aa3f-4218-a1ec-f087023b223a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3979c6b20a74123a49c15841de6e726, user_id=b66059c644f84207aa4b1edd0e8e1eb9, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:23:59.797241 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67796d0-aa3f-4218-a1ec-f087023b223a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:23:59.811371 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1284/2580] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:23:59 2022] PUT /identity/v3/projects/e3979c6b20a74123a49c15841de6e726/users/b66059c644f84207aa4b1edd0e8e1eb9/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:23:59.821460 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c3e29-b95b-4247-b71c-d503974a244d None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:23:59.821747 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c3e29-b95b-4247-b71c-d503974a244d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:23:59.822020 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c3e29-b95b-4247-b71c-d503974a244d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:23:59.852184 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-201c3e29-b95b-4247-b71c-d503974a244d None None] MFA Rules not processed for user `b66059c644f84207aa4b1edd0e8e1eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:23:59.853394 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-201c3e29-b95b-4247-b71c-d503974a244d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:23:59.922655 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1297/2581] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:23:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:23:59.935490 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67796d0-aa3f-4218-a1ec-f087023b223a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:23:59.937229 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-f67796d0-aa3f-4218-a1ec-f087023b223a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:00.012830 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67796d0-aa3f-4218-a1ec-f087023b223a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:00.018540 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8d490-707e-4945-bd5b-160031815a70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:00.019055 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8d490-707e-4945-bd5b-160031815a70 service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:00.019337 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8d490-707e-4945-bd5b-160031815a70 service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:00.019685 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8d490-707e-4945-bd5b-160031815a70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:00.027900 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8d490-707e-4945-bd5b-160031815a70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:00.029494 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8d490-707e-4945-bd5b-160031815a70 service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:00.045921 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1285/2582] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:23:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:24:12.651613 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c3e29-b95b-4247-b71c-d503974a244d None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:12.710944 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c3e29-b95b-4247-b71c-d503974a244d None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:12.715372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782d2e7-e5e4-425f-b5b8-a2d60782d4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:12.716256 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782d2e7-e5e4-425f-b5b8-a2d60782d4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:12.716541 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782d2e7-e5e4-425f-b5b8-a2d60782d4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:12.717383 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782d2e7-e5e4-425f-b5b8-a2d60782d4d0 admin admin] PATH_INFO: `/v3/users/b66059c644f84207aa4b1edd0e8e1eb9` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:12.718833 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782d2e7-e5e4-425f-b5b8-a2d60782d4d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66059c644f84207aa4b1edd0e8e1eb9)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:12.720763 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782d2e7-e5e4-425f-b5b8-a2d60782d4d0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:12.762389 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7782d2e7-e5e4-425f-b5b8-a2d60782d4d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66059c644f84207aa4b1edd0e8e1eb9'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:12.773903 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7782d2e7-e5e4-425f-b5b8-a2d60782d4d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66059c644f84207aa4b1edd0e8e1eb9'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:12.774547 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7782d2e7-e5e4-425f-b5b8-a2d60782d4d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66059c644f84207aa4b1edd0e8e1eb9'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:12.782048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7782d2e7-e5e4-425f-b5b8-a2d60782d4d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66059c644f84207aa4b1edd0e8e1eb9'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:12.782751 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7782d2e7-e5e4-425f-b5b8-a2d60782d4d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66059c644f84207aa4b1edd0e8e1eb9'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:12.794467 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1298/2583] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:24:12 2022] DELETE /identity/v3/users/b66059c644f84207aa4b1edd0e8e1eb9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:24:12.799037 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f61e92-f56f-4903-b5eb-3205cece8fba None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:12.799585 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f61e92-f56f-4903-b5eb-3205cece8fba None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:12.799585 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f61e92-f56f-4903-b5eb-3205cece8fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:12.816540 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-60f61e92-f56f-4903-b5eb-3205cece8fba None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:12.817753 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-60f61e92-f56f-4903-b5eb-3205cece8fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:12.874808 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1286/2584] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:24:12.884705 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782d2e7-e5e4-425f-b5b8-a2d60782d4d0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:12.886096 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-7782d2e7-e5e4-425f-b5b8-a2d60782d4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:12.942568 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782d2e7-e5e4-425f-b5b8-a2d60782d4d0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:12.946061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fafb4e-2624-428d-8a00-e94a3d97dc6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:12.946695 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fafb4e-2624-428d-8a00-e94a3d97dc6e service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:12.946976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fafb4e-2624-428d-8a00-e94a3d97dc6e service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:12.947243 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fafb4e-2624-428d-8a00-e94a3d97dc6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:12.956700 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fafb4e-2624-428d-8a00-e94a3d97dc6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:12.958103 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fafb4e-2624-428d-8a00-e94a3d97dc6e service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:12.968457 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1299/2585] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:24:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:24:13.225642 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f61e92-f56f-4903-b5eb-3205cece8fba None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:13.227081 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-60f61e92-f56f-4903-b5eb-3205cece8fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:13.239981 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f61e92-f56f-4903-b5eb-3205cece8fba None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:13.244584 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da04df-eb2c-4a8d-b88b-25afffa14ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:13.245436 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da04df-eb2c-4a8d-b88b-25afffa14ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:13.245718 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da04df-eb2c-4a8d-b88b-25afffa14ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:13.245988 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da04df-eb2c-4a8d-b88b-25afffa14ce6 admin admin] PATH_INFO: `/v3/projects/e3979c6b20a74123a49c15841de6e726` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:13.247173 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da04df-eb2c-4a8d-b88b-25afffa14ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3979c6b20a74123a49c15841de6e726)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:13.249715 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da04df-eb2c-4a8d-b88b-25afffa14ce6 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:13.295594 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-68da04df-eb2c-4a8d-b88b-25afffa14ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3979c6b20a74123a49c15841de6e726', 'request_id': 'req-68da04df-eb2c-4a8d-b88b-25afffa14ce6'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:13.302905 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-68da04df-eb2c-4a8d-b88b-25afffa14ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3979c6b20a74123a49c15841de6e726', 'request_id': 'req-68da04df-eb2c-4a8d-b88b-25afffa14ce6'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:13.308347 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-68da04df-eb2c-4a8d-b88b-25afffa14ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3979c6b20a74123a49c15841de6e726', 'request_id': 'req-68da04df-eb2c-4a8d-b88b-25afffa14ce6'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:13.319755 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-68da04df-eb2c-4a8d-b88b-25afffa14ce6 admin admin] The token cache is being invalidate because project e3979c6b20a74123a49c15841de6e726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:24:13.320070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-68da04df-eb2c-4a8d-b88b-25afffa14ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:13.320684 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-68da04df-eb2c-4a8d-b88b-25afffa14ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:13.322401 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1287/2586] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:24:13 2022] DELETE /identity/v3/projects/e3979c6b20a74123a49c15841de6e726 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:24:13.328004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea241b12-eba3-4900-ad59-d03dee07f8bd None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:13.328290 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea241b12-eba3-4900-ad59-d03dee07f8bd None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:13.328561 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea241b12-eba3-4900-ad59-d03dee07f8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:13.346563 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-ea241b12-eba3-4900-ad59-d03dee07f8bd None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:13.347733 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-ea241b12-eba3-4900-ad59-d03dee07f8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:13.404355 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1300/2587] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:24:13.412211 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada149e1-a1db-4383-86da-dfde132521cd None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:13.412498 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada149e1-a1db-4383-86da-dfde132521cd None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:13.412772 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada149e1-a1db-4383-86da-dfde132521cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:13.431317 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-ada149e1-a1db-4383-86da-dfde132521cd None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:13.432520 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-ada149e1-a1db-4383-86da-dfde132521cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:13.440952 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1288/2588] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:24:13.444967 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea241b12-eba3-4900-ad59-d03dee07f8bd None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:13.454708 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea241b12-eba3-4900-ad59-d03dee07f8bd None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:13.459246 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c6adc-7867-4024-b211-3bcd93d644ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:13.459913 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c6adc-7867-4024-b211-3bcd93d644ad admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:13.460197 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c6adc-7867-4024-b211-3bcd93d644ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:13.460469 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c6adc-7867-4024-b211-3bcd93d644ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:13.461195 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c6adc-7867-4024-b211-3bcd93d644ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:24:13.461499 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c6adc-7867-4024-b211-3bcd93d644ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:13.463070 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c6adc-7867-4024-b211-3bcd93d644ad admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:13.475231 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1301/2589] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:24:13.479287 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada149e1-a1db-4383-86da-dfde132521cd None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:13.492079 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada149e1-a1db-4383-86da-dfde132521cd None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:13.496801 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d08598-1bed-4249-af42-e70c6d4b20ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:13.497520 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d08598-1bed-4249-af42-e70c6d4b20ff admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:13.497980 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d08598-1bed-4249-af42-e70c6d4b20ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:13.498782 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d08598-1bed-4249-af42-e70c6d4b20ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:13.499577 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d08598-1bed-4249-af42-e70c6d4b20ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:13.501566 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d08598-1bed-4249-af42-e70c6d4b20ff admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:13.530615 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1289/2590] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:24:13 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:24:13.531813 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c6adc-7867-4024-b211-3bcd93d644ad admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:13.541471 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c6adc-7867-4024-b211-3bcd93d644ad admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:13.597947 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a9d38-a4ec-490f-95cf-3142c0360fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:13.598617 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a9d38-a4ec-490f-95cf-3142c0360fce admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:13.598903 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a9d38-a4ec-490f-95cf-3142c0360fce admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:13.599182 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a9d38-a4ec-490f-95cf-3142c0360fce admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:13.599924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a9d38-a4ec-490f-95cf-3142c0360fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:13.601852 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a9d38-a4ec-490f-95cf-3142c0360fce admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:13.621732 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1302/2591] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:24:13 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:24:13.626480 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d08598-1bed-4249-af42-e70c6d4b20ff admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:13.636525 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d08598-1bed-4249-af42-e70c6d4b20ff admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:13.641304 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceac1c1-a678-41fe-acbb-7072b2d94a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:13.641958 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceac1c1-a678-41fe-acbb-7072b2d94a20 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:13.642240 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceac1c1-a678-41fe-acbb-7072b2d94a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:13.642514 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceac1c1-a678-41fe-acbb-7072b2d94a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:13.643238 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceac1c1-a678-41fe-acbb-7072b2d94a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:13.644878 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceac1c1-a678-41fe-acbb-7072b2d94a20 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:13.655079 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1290/2592] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:24:13.659057 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a9d38-a4ec-490f-95cf-3142c0360fce admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:13.668757 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a9d38-a4ec-490f-95cf-3142c0360fce admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:13.673930 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0849f51-80e9-42b8-b98b-f08f51cf3da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:13.674584 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0849f51-80e9-42b8-b98b-f08f51cf3da8 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:13.674866 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0849f51-80e9-42b8-b98b-f08f51cf3da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:13.675144 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0849f51-80e9-42b8-b98b-f08f51cf3da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:13.675914 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0849f51-80e9-42b8-b98b-f08f51cf3da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:13.677483 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0849f51-80e9-42b8-b98b-f08f51cf3da8 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:13.687599 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1303/2593] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:24:13.691487 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceac1c1-a678-41fe-acbb-7072b2d94a20 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:13.701310 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceac1c1-a678-41fe-acbb-7072b2d94a20 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:13.706042 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87612a65-4f5e-4795-bd5f-0ca196c73da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:13.706905 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87612a65-4f5e-4795-bd5f-0ca196c73da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:13.707192 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87612a65-4f5e-4795-bd5f-0ca196c73da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:13.707465 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87612a65-4f5e-4795-bd5f-0ca196c73da7 admin admin] PATH_INFO: `/v3/projects/400dbc13a9dd4df68cac7495e1fbe763/users/0b253353106342ae9df69c8d8fa96b5d/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:13.722222 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87612a65-4f5e-4795-bd5f-0ca196c73da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=400dbc13a9dd4df68cac7495e1fbe763, user_id=0b253353106342ae9df69c8d8fa96b5d, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:13.724910 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87612a65-4f5e-4795-bd5f-0ca196c73da7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:13.738357 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1291/2594] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:24:13 2022] PUT /identity/v3/projects/400dbc13a9dd4df68cac7495e1fbe763/users/0b253353106342ae9df69c8d8fa96b5d/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:24:13.750345 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60817d-21e0-41a9-82e6-87f156bfc12b None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:13.750639 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60817d-21e0-41a9-82e6-87f156bfc12b None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:13.750915 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60817d-21e0-41a9-82e6-87f156bfc12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:13.776279 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-ea60817d-21e0-41a9-82e6-87f156bfc12b None None] MFA Rules not processed for user `0b253353106342ae9df69c8d8fa96b5d`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:13.777472 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-ea60817d-21e0-41a9-82e6-87f156bfc12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:13.838371 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1304/2595] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:24:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:24:13.843537 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87612a65-4f5e-4795-bd5f-0ca196c73da7 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:13.901932 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87612a65-4f5e-4795-bd5f-0ca196c73da7 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:13.907283 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a42b90-a687-4e7c-890b-6c1fd0cbbceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:13.907977 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a42b90-a687-4e7c-890b-6c1fd0cbbceb admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:13.908270 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a42b90-a687-4e7c-890b-6c1fd0cbbceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:13.908541 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a42b90-a687-4e7c-890b-6c1fd0cbbceb admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:13.909253 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a42b90-a687-4e7c-890b-6c1fd0cbbceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:13.911168 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a42b90-a687-4e7c-890b-6c1fd0cbbceb admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:13.935464 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1292/2596] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:24:13 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:24:13.939446 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60817d-21e0-41a9-82e6-87f156bfc12b None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:13.949932 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60817d-21e0-41a9-82e6-87f156bfc12b None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:14.004164 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1293e65-56fe-4271-8f17-81a3874fccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:14.004750 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1293e65-56fe-4271-8f17-81a3874fccb6 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:14.005034 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1293e65-56fe-4271-8f17-81a3874fccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:14.005311 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1293e65-56fe-4271-8f17-81a3874fccb6 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:14.006006 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1293e65-56fe-4271-8f17-81a3874fccb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:14.007914 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1293e65-56fe-4271-8f17-81a3874fccb6 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:14.026655 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1305/2597] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:24:13 2022] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:24:14.031322 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a42b90-a687-4e7c-890b-6c1fd0cbbceb admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:14.041312 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a42b90-a687-4e7c-890b-6c1fd0cbbceb admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:14.046841 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419d0d5-2c99-46e7-88a5-43db3912c78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:14.047491 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419d0d5-2c99-46e7-88a5-43db3912c78a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:14.047776 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419d0d5-2c99-46e7-88a5-43db3912c78a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:14.048097 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419d0d5-2c99-46e7-88a5-43db3912c78a admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:14.048829 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419d0d5-2c99-46e7-88a5-43db3912c78a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:14.050425 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419d0d5-2c99-46e7-88a5-43db3912c78a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:14.061849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1293/2598] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:24:14.065739 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1293e65-56fe-4271-8f17-81a3874fccb6 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:14.075356 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1293e65-56fe-4271-8f17-81a3874fccb6 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:14.079947 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa2e31-0a8f-4962-a8a3-8bff1cf01150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:14.080822 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa2e31-0a8f-4962-a8a3-8bff1cf01150 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:14.081126 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa2e31-0a8f-4962-a8a3-8bff1cf01150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:14.081409 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa2e31-0a8f-4962-a8a3-8bff1cf01150 admin admin] PATH_INFO: `/v3/projects/a309415492b6493a98d63b676e198061/users/1b59b03974e44bb6ac2d5efd26b742eb/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:14.097250 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa2e31-0a8f-4962-a8a3-8bff1cf01150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a309415492b6493a98d63b676e198061, user_id=1b59b03974e44bb6ac2d5efd26b742eb, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:14.099930 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa2e31-0a8f-4962-a8a3-8bff1cf01150 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:14.113349 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1306/2599] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:24:14 2022] PUT /identity/v3/projects/a309415492b6493a98d63b676e198061/users/1b59b03974e44bb6ac2d5efd26b742eb/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:24:14.117261 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419d0d5-2c99-46e7-88a5-43db3912c78a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:14.127038 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419d0d5-2c99-46e7-88a5-43db3912c78a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:14.182386 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eaee3b-4228-42e8-b76e-cc650e3fa332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:14.183035 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaee3b-4228-42e8-b76e-cc650e3fa332 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:14.183315 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaee3b-4228-42e8-b76e-cc650e3fa332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:14.183588 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaee3b-4228-42e8-b76e-cc650e3fa332 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:14.184355 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eaee3b-4228-42e8-b76e-cc650e3fa332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:14.186265 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eaee3b-4228-42e8-b76e-cc650e3fa332 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:14.196141 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1294/2600] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:24:14.200209 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa2e31-0a8f-4962-a8a3-8bff1cf01150 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:14.210798 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa2e31-0a8f-4962-a8a3-8bff1cf01150 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:14.215312 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96d9aa-20f1-4458-9f00-5215423d6562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:14.216211 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96d9aa-20f1-4458-9f00-5215423d6562 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:14.216496 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96d9aa-20f1-4458-9f00-5215423d6562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:14.216844 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96d9aa-20f1-4458-9f00-5215423d6562 admin admin] PATH_INFO: `/v3/projects/a309415492b6493a98d63b676e198061/users/1b59b03974e44bb6ac2d5efd26b742eb/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:14.219606 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96d9aa-20f1-4458-9f00-5215423d6562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a309415492b6493a98d63b676e198061, user_id=1b59b03974e44bb6ac2d5efd26b742eb, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:14.222238 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96d9aa-20f1-4458-9f00-5215423d6562 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:14.232082 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1307/2601] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:24:14 2022] PUT /identity/v3/projects/a309415492b6493a98d63b676e198061/users/1b59b03974e44bb6ac2d5efd26b742eb/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:24:14.242548 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52cbe2-9d38-4af4-87f4-33fe80815b7b None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:14.242840 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52cbe2-9d38-4af4-87f4-33fe80815b7b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:14.243122 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52cbe2-9d38-4af4-87f4-33fe80815b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:14.269171 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-8b52cbe2-9d38-4af4-87f4-33fe80815b7b None None] MFA Rules not processed for user `1b59b03974e44bb6ac2d5efd26b742eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:14.270314 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-8b52cbe2-9d38-4af4-87f4-33fe80815b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:14.335047 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1295/2602] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:24:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:24:14.345600 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96d9aa-20f1-4458-9f00-5215423d6562 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:14.347304 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-7e96d9aa-20f1-4458-9f00-5215423d6562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:14.403966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96d9aa-20f1-4458-9f00-5215423d6562 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:14.408656 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1036f52-9c27-4e53-8d96-1b47bcbaef46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:14.409371 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1036f52-9c27-4e53-8d96-1b47bcbaef46 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:14.409657 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1036f52-9c27-4e53-8d96-1b47bcbaef46 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:14.409929 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1036f52-9c27-4e53-8d96-1b47bcbaef46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:14.464037 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1036f52-9c27-4e53-8d96-1b47bcbaef46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:14.465387 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1036f52-9c27-4e53-8d96-1b47bcbaef46 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:14.474320 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1308/2603] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:24:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:24:21.096025 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52cbe2-9d38-4af4-87f4-33fe80815b7b None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:21.105613 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52cbe2-9d38-4af4-87f4-33fe80815b7b None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:21.109125 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22a263-97b5-477a-b450-ab436e94d1e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:21.110381 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22a263-97b5-477a-b450-ab436e94d1e4 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:21.110893 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22a263-97b5-477a-b450-ab436e94d1e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:21.111222 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22a263-97b5-477a-b450-ab436e94d1e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:21.120037 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22a263-97b5-477a-b450-ab436e94d1e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:21.121443 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22a263-97b5-477a-b450-ab436e94d1e4 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:21.132133 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1296/2604] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:24:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:24:27.344151 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a4f96-5e12-4deb-888d-695f3749abba None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:27.344859 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a4f96-5e12-4deb-888d-695f3749abba None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:27.344962 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a4f96-5e12-4deb-888d-695f3749abba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:27.363698 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-f22a4f96-5e12-4deb-888d-695f3749abba None None] MFA Rules not processed for user `9dca4ea4f2c8490e823a73dca6c303ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:27.364888 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-f22a4f96-5e12-4deb-888d-695f3749abba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:27.419723 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1309/2605] 10.222.0.77 () {58 vars in 967 bytes} [Thu Feb 10 23:24:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:24:27.433434 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22a263-97b5-477a-b450-ab436e94d1e4 service cinder] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:27.434821 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-8a22a263-97b5-477a-b450-ab436e94d1e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:27.505699 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22a263-97b5-477a-b450-ab436e94d1e4 service cinder] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:27.510554 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5f9e9-c42b-488d-90eb-4e34c3e89c09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce55b64dc528447993e32b00ae4d3a2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:27.511195 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5f9e9-c42b-488d-90eb-4e34c3e89c09 service swift] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:27.511478 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5f9e9-c42b-488d-90eb-4e34c3e89c09 service swift] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:27.511755 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5f9e9-c42b-488d-90eb-4e34c3e89c09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:27.520277 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5f9e9-c42b-488d-90eb-4e34c3e89c09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:27.521843 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5f9e9-c42b-488d-90eb-4e34c3e89c09 service swift] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:27.529599 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1297/2606] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Feb 10 23:24:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:24:49.782223 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a4f96-5e12-4deb-888d-695f3749abba None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:49.840284 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a4f96-5e12-4deb-888d-695f3749abba None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:49.845014 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc2b99-a4b9-4f8d-b25c-3692a453bdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:49.845858 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc2b99-a4b9-4f8d-b25c-3692a453bdc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:49.846136 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc2b99-a4b9-4f8d-b25c-3692a453bdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:49.846404 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc2b99-a4b9-4f8d-b25c-3692a453bdc7 admin admin] PATH_INFO: `/v3/users/0b253353106342ae9df69c8d8fa96b5d` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:49.847855 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc2b99-a4b9-4f8d-b25c-3692a453bdc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b253353106342ae9df69c8d8fa96b5d)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:49.849728 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc2b99-a4b9-4f8d-b25c-3692a453bdc7 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:49.893049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-50bc2b99-a4b9-4f8d-b25c-3692a453bdc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b253353106342ae9df69c8d8fa96b5d'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:49.905067 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-50bc2b99-a4b9-4f8d-b25c-3692a453bdc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b253353106342ae9df69c8d8fa96b5d'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:49.905711 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-50bc2b99-a4b9-4f8d-b25c-3692a453bdc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b253353106342ae9df69c8d8fa96b5d'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:49.913133 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-50bc2b99-a4b9-4f8d-b25c-3692a453bdc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b253353106342ae9df69c8d8fa96b5d'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:49.913903 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-50bc2b99-a4b9-4f8d-b25c-3692a453bdc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b253353106342ae9df69c8d8fa96b5d'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:49.925337 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1310/2607] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:24:49 2022] DELETE /identity/v3/users/0b253353106342ae9df69c8d8fa96b5d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:24:49.930014 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d8fbb-d1ac-479b-94a8-a7dbf8622b87 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:49.930504 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d8fbb-d1ac-479b-94a8-a7dbf8622b87 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:49.930610 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d8fbb-d1ac-479b-94a8-a7dbf8622b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:49.947867 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-3e1d8fbb-d1ac-479b-94a8-a7dbf8622b87 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:49.949391 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-3e1d8fbb-d1ac-479b-94a8-a7dbf8622b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:50.005570 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1298/2608] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:24:50.015059 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc2b99-a4b9-4f8d-b25c-3692a453bdc7 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:50.016494 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-50bc2b99-a4b9-4f8d-b25c-3692a453bdc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:50.069964 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc2b99-a4b9-4f8d-b25c-3692a453bdc7 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:50.073637 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c71d35-a24b-4297-a59d-97e5cfc7373c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:50.074269 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c71d35-a24b-4297-a59d-97e5cfc7373c service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:50.074620 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c71d35-a24b-4297-a59d-97e5cfc7373c service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:50.074818 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c71d35-a24b-4297-a59d-97e5cfc7373c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:50.085386 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c71d35-a24b-4297-a59d-97e5cfc7373c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:50.086816 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c71d35-a24b-4297-a59d-97e5cfc7373c service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:50.096495 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1311/2609] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:24:50.363753 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d8fbb-d1ac-479b-94a8-a7dbf8622b87 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:50.365263 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-3e1d8fbb-d1ac-479b-94a8-a7dbf8622b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:50.377286 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d8fbb-d1ac-479b-94a8-a7dbf8622b87 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:50.382579 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222f6a0-ce69-411e-80d1-51327991ed13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:50.383436 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222f6a0-ce69-411e-80d1-51327991ed13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:50.383718 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222f6a0-ce69-411e-80d1-51327991ed13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:50.384016 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222f6a0-ce69-411e-80d1-51327991ed13 admin admin] PATH_INFO: `/v3/projects/400dbc13a9dd4df68cac7495e1fbe763` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:50.385200 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222f6a0-ce69-411e-80d1-51327991ed13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=400dbc13a9dd4df68cac7495e1fbe763)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:50.387081 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222f6a0-ce69-411e-80d1-51327991ed13 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:50.435245 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5222f6a0-ce69-411e-80d1-51327991ed13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '400dbc13a9dd4df68cac7495e1fbe763', 'request_id': 'req-5222f6a0-ce69-411e-80d1-51327991ed13'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:50.441974 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5222f6a0-ce69-411e-80d1-51327991ed13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '400dbc13a9dd4df68cac7495e1fbe763', 'request_id': 'req-5222f6a0-ce69-411e-80d1-51327991ed13'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:50.447413 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5222f6a0-ce69-411e-80d1-51327991ed13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '400dbc13a9dd4df68cac7495e1fbe763', 'request_id': 'req-5222f6a0-ce69-411e-80d1-51327991ed13'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:50.458080 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5222f6a0-ce69-411e-80d1-51327991ed13 admin admin] The token cache is being invalidate because project 400dbc13a9dd4df68cac7495e1fbe763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:24:50.458366 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5222f6a0-ce69-411e-80d1-51327991ed13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:50.458981 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-5222f6a0-ce69-411e-80d1-51327991ed13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:50.460524 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1299/2610] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:24:50 2022] DELETE /identity/v3/projects/400dbc13a9dd4df68cac7495e1fbe763 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:24:50.464420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c71d35-a24b-4297-a59d-97e5cfc7373c service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:50.474474 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c71d35-a24b-4297-a59d-97e5cfc7373c service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:50.527694 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb2684-c7f9-4d27-92ed-3d9c981fe19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:50.528572 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb2684-c7f9-4d27-92ed-3d9c981fe19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:50.528849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb2684-c7f9-4d27-92ed-3d9c981fe19e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:50.529119 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb2684-c7f9-4d27-92ed-3d9c981fe19e admin admin] PATH_INFO: `/v3/users/1b59b03974e44bb6ac2d5efd26b742eb` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:50.530286 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb2684-c7f9-4d27-92ed-3d9c981fe19e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b59b03974e44bb6ac2d5efd26b742eb)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:50.532250 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb2684-c7f9-4d27-92ed-3d9c981fe19e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:50.575335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-d3fb2684-c7f9-4d27-92ed-3d9c981fe19e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b59b03974e44bb6ac2d5efd26b742eb'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:50.586717 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-d3fb2684-c7f9-4d27-92ed-3d9c981fe19e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b59b03974e44bb6ac2d5efd26b742eb'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:50.587381 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-d3fb2684-c7f9-4d27-92ed-3d9c981fe19e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b59b03974e44bb6ac2d5efd26b742eb'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:50.594312 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-d3fb2684-c7f9-4d27-92ed-3d9c981fe19e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b59b03974e44bb6ac2d5efd26b742eb'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:50.595115 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-d3fb2684-c7f9-4d27-92ed-3d9c981fe19e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b59b03974e44bb6ac2d5efd26b742eb'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:50.607440 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1312/2611] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:24:50 2022] DELETE /identity/v3/users/1b59b03974e44bb6ac2d5efd26b742eb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:24:50.868418 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222f6a0-ce69-411e-80d1-51327991ed13 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:50.869849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-5222f6a0-ce69-411e-80d1-51327991ed13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:50.883407 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222f6a0-ce69-411e-80d1-51327991ed13 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:50.939216 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74440cb-4af4-45d8-8dac-a3cb00f601f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:50.940096 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74440cb-4af4-45d8-8dac-a3cb00f601f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:50.940374 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74440cb-4af4-45d8-8dac-a3cb00f601f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:50.940648 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74440cb-4af4-45d8-8dac-a3cb00f601f2 admin admin] PATH_INFO: `/v3/projects/a309415492b6493a98d63b676e198061` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:50.942688 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74440cb-4af4-45d8-8dac-a3cb00f601f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a309415492b6493a98d63b676e198061)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:50.944603 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74440cb-4af4-45d8-8dac-a3cb00f601f2 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:50.990395 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e74440cb-4af4-45d8-8dac-a3cb00f601f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a309415492b6493a98d63b676e198061', 'request_id': 'req-e74440cb-4af4-45d8-8dac-a3cb00f601f2'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:50.997557 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e74440cb-4af4-45d8-8dac-a3cb00f601f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a309415492b6493a98d63b676e198061', 'request_id': 'req-e74440cb-4af4-45d8-8dac-a3cb00f601f2'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:51.002863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e74440cb-4af4-45d8-8dac-a3cb00f601f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a309415492b6493a98d63b676e198061', 'request_id': 'req-e74440cb-4af4-45d8-8dac-a3cb00f601f2'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:51.013492 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e74440cb-4af4-45d8-8dac-a3cb00f601f2 admin admin] The token cache is being invalidate because project a309415492b6493a98d63b676e198061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:24:51.013804 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e74440cb-4af4-45d8-8dac-a3cb00f601f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:51.014428 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e74440cb-4af4-45d8-8dac-a3cb00f601f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:51.015962 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1300/2612] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:24:50 2022] DELETE /identity/v3/projects/a309415492b6493a98d63b676e198061 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:24:51.021376 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2c38e-eb9a-458c-8604-6fbbe30e98fa None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:51.021865 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2c38e-eb9a-458c-8604-6fbbe30e98fa None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:51.022136 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2c38e-eb9a-458c-8604-6fbbe30e98fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:51.040618 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-0dc2c38e-eb9a-458c-8604-6fbbe30e98fa None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:51.041801 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-0dc2c38e-eb9a-458c-8604-6fbbe30e98fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:51.100227 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1313/2613] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:24:51.107999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac191b-151d-4bc2-8ca2-418207db2423 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:51.108296 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac191b-151d-4bc2-8ca2-418207db2423 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:51.108577 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac191b-151d-4bc2-8ca2-418207db2423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:51.126454 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-7fac191b-151d-4bc2-8ca2-418207db2423 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:51.128059 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-7fac191b-151d-4bc2-8ca2-418207db2423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:51.136167 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1301/2614] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:24:51.140239 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2c38e-eb9a-458c-8604-6fbbe30e98fa None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:51.150211 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2c38e-eb9a-458c-8604-6fbbe30e98fa None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:51.155020 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861273b8-0a0c-4625-a78a-0a917847cf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:51.155674 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861273b8-0a0c-4625-a78a-0a917847cf94 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:51.156007 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861273b8-0a0c-4625-a78a-0a917847cf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:51.156283 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861273b8-0a0c-4625-a78a-0a917847cf94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:51.157016 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861273b8-0a0c-4625-a78a-0a917847cf94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:24:51.157323 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861273b8-0a0c-4625-a78a-0a917847cf94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:51.159028 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861273b8-0a0c-4625-a78a-0a917847cf94 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:51.171166 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1314/2615] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:24:51.175062 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac191b-151d-4bc2-8ca2-418207db2423 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:51.184353 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac191b-151d-4bc2-8ca2-418207db2423 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:51.188960 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20011e-bc46-4554-8242-923dfe09d061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:51.189604 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20011e-bc46-4554-8242-923dfe09d061 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:51.189896 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20011e-bc46-4554-8242-923dfe09d061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:51.190177 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20011e-bc46-4554-8242-923dfe09d061 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:51.191430 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20011e-bc46-4554-8242-923dfe09d061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:51.193411 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20011e-bc46-4554-8242-923dfe09d061 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:51.219453 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1302/2616] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:24:51 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:24:51.223522 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861273b8-0a0c-4625-a78a-0a917847cf94 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:51.233109 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861273b8-0a0c-4625-a78a-0a917847cf94 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:51.287554 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7e370-20e6-4e8e-b944-daaeb5e9bae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:51.288319 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7e370-20e6-4e8e-b944-daaeb5e9bae9 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:51.288605 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7e370-20e6-4e8e-b944-daaeb5e9bae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:51.288876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7e370-20e6-4e8e-b944-daaeb5e9bae9 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:51.289572 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7e370-20e6-4e8e-b944-daaeb5e9bae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:51.291446 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7e370-20e6-4e8e-b944-daaeb5e9bae9 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:51.311233 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1315/2617] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:24:51 2022] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:24:51.315313 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20011e-bc46-4554-8242-923dfe09d061 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:51.325681 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20011e-bc46-4554-8242-923dfe09d061 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:51.330416 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7e5d4-3922-45bd-9ba7-053238e1c1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:51.331063 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7e5d4-3922-45bd-9ba7-053238e1c1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:51.331396 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7e5d4-3922-45bd-9ba7-053238e1c1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:51.331693 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7e5d4-3922-45bd-9ba7-053238e1c1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:51.332630 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7e5d4-3922-45bd-9ba7-053238e1c1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:51.334215 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7e5d4-3922-45bd-9ba7-053238e1c1e0 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:51.344800 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1303/2618] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:24:51.349234 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7e370-20e6-4e8e-b944-daaeb5e9bae9 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:51.359062 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7e370-20e6-4e8e-b944-daaeb5e9bae9 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:51.364619 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb7de0-7299-4abe-ba77-213c71d2430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:51.365257 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb7de0-7299-4abe-ba77-213c71d2430d admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:51.365540 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb7de0-7299-4abe-ba77-213c71d2430d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:51.365812 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb7de0-7299-4abe-ba77-213c71d2430d admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:51.366537 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb7de0-7299-4abe-ba77-213c71d2430d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:51.368154 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb7de0-7299-4abe-ba77-213c71d2430d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:51.377780 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1316/2619] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:24:51.381879 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7e5d4-3922-45bd-9ba7-053238e1c1e0 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:51.391326 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7e5d4-3922-45bd-9ba7-053238e1c1e0 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:51.396350 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fecb4-f58f-48ac-9aac-59bf0d4c5102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:51.397216 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fecb4-f58f-48ac-9aac-59bf0d4c5102 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:51.397498 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fecb4-f58f-48ac-9aac-59bf0d4c5102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:51.397773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fecb4-f58f-48ac-9aac-59bf0d4c5102 admin admin] PATH_INFO: `/v3/projects/71ad7789e0bc44888ddd8833bde47714/users/18d637dfea334033a56efc705ad166f9/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:51.412649 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fecb4-f58f-48ac-9aac-59bf0d4c5102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ad7789e0bc44888ddd8833bde47714, user_id=18d637dfea334033a56efc705ad166f9, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:51.415267 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fecb4-f58f-48ac-9aac-59bf0d4c5102 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:51.427689 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1304/2620] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:24:51 2022] PUT /identity/v3/projects/71ad7789e0bc44888ddd8833bde47714/users/18d637dfea334033a56efc705ad166f9/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:24:51.437909 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18ad23-4b5b-4923-a949-6a6d6711db5e None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:51.438202 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18ad23-4b5b-4923-a949-6a6d6711db5e None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:51.438508 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18ad23-4b5b-4923-a949-6a6d6711db5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:51.464164 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-5d18ad23-4b5b-4923-a949-6a6d6711db5e None None] MFA Rules not processed for user `18d637dfea334033a56efc705ad166f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:51.465354 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-5d18ad23-4b5b-4923-a949-6a6d6711db5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:51.528807 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1317/2621] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:24:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:24:51.533203 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fecb4-f58f-48ac-9aac-59bf0d4c5102 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:51.593072 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fecb4-f58f-48ac-9aac-59bf0d4c5102 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:51.597882 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3590a-4feb-41aa-8e0f-52304237ab19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:51.598527 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3590a-4feb-41aa-8e0f-52304237ab19 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:51.598806 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3590a-4feb-41aa-8e0f-52304237ab19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:51.599078 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3590a-4feb-41aa-8e0f-52304237ab19 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:51.599772 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3590a-4feb-41aa-8e0f-52304237ab19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:51.601712 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3590a-4feb-41aa-8e0f-52304237ab19 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:51.625611 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1305/2622] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:24:51 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:24:51.630375 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18ad23-4b5b-4923-a949-6a6d6711db5e None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:51.640746 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18ad23-4b5b-4923-a949-6a6d6711db5e None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:51.695075 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74749ca4-ffd9-4374-84eb-e60de4c857ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:51.695731 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74749ca4-ffd9-4374-84eb-e60de4c857ea admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:51.696042 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74749ca4-ffd9-4374-84eb-e60de4c857ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:51.696319 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74749ca4-ffd9-4374-84eb-e60de4c857ea admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:51.697028 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74749ca4-ffd9-4374-84eb-e60de4c857ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:51.698916 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74749ca4-ffd9-4374-84eb-e60de4c857ea admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:51.718775 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1318/2623] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:24:51 2022] POST /identity/v3/users => generated 297 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:24:51.723534 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3590a-4feb-41aa-8e0f-52304237ab19 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:51.733638 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3590a-4feb-41aa-8e0f-52304237ab19 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:51.738845 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cff29d-eebb-4f0a-b720-eb0a9429080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:51.739490 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cff29d-eebb-4f0a-b720-eb0a9429080a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:51.739769 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cff29d-eebb-4f0a-b720-eb0a9429080a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:51.740068 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cff29d-eebb-4f0a-b720-eb0a9429080a admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:51.740795 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cff29d-eebb-4f0a-b720-eb0a9429080a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:51.742490 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cff29d-eebb-4f0a-b720-eb0a9429080a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:51.752369 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1306/2624] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:24:51.757083 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74749ca4-ffd9-4374-84eb-e60de4c857ea admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:51.766618 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74749ca4-ffd9-4374-84eb-e60de4c857ea admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:51.771430 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d1e45-8ab3-4096-8811-0432d3a09eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:51.772320 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d1e45-8ab3-4096-8811-0432d3a09eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:51.772601 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d1e45-8ab3-4096-8811-0432d3a09eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:51.772869 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d1e45-8ab3-4096-8811-0432d3a09eb3 admin admin] PATH_INFO: `/v3/projects/f8ed0f7c335c4ca498ecb1f36706a996/users/00dd5de4aa804f9388d8a9a77a476a46/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:51.786601 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d1e45-8ab3-4096-8811-0432d3a09eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ed0f7c335c4ca498ecb1f36706a996, user_id=00dd5de4aa804f9388d8a9a77a476a46, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:51.789248 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d1e45-8ab3-4096-8811-0432d3a09eb3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:51.801779 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1319/2625] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:24:51 2022] PUT /identity/v3/projects/f8ed0f7c335c4ca498ecb1f36706a996/users/00dd5de4aa804f9388d8a9a77a476a46/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:24:51.805648 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cff29d-eebb-4f0a-b720-eb0a9429080a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:51.815373 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cff29d-eebb-4f0a-b720-eb0a9429080a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:51.870468 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d57c7-d099-47fa-a799-bd1d426b12f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:51.871057 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d57c7-d099-47fa-a799-bd1d426b12f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:51.871341 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d57c7-d099-47fa-a799-bd1d426b12f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:51.871620 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d57c7-d099-47fa-a799-bd1d426b12f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:51.872381 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d57c7-d099-47fa-a799-bd1d426b12f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:51.873963 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d57c7-d099-47fa-a799-bd1d426b12f5 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:51.883321 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1307/2626] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:24:51.887341 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d1e45-8ab3-4096-8811-0432d3a09eb3 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:51.898119 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d1e45-8ab3-4096-8811-0432d3a09eb3 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:51.902765 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d638a-c621-4380-98fd-4ba85c43cbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:51.903629 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d638a-c621-4380-98fd-4ba85c43cbdd admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:51.903946 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d638a-c621-4380-98fd-4ba85c43cbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:51.904245 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d638a-c621-4380-98fd-4ba85c43cbdd admin admin] PATH_INFO: `/v3/projects/f8ed0f7c335c4ca498ecb1f36706a996/users/00dd5de4aa804f9388d8a9a77a476a46/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:51.906201 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d638a-c621-4380-98fd-4ba85c43cbdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ed0f7c335c4ca498ecb1f36706a996, user_id=00dd5de4aa804f9388d8a9a77a476a46, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:51.908914 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d638a-c621-4380-98fd-4ba85c43cbdd admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:51.919409 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1320/2627] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:24:51 2022] PUT /identity/v3/projects/f8ed0f7c335c4ca498ecb1f36706a996/users/00dd5de4aa804f9388d8a9a77a476a46/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:24:51.930375 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabedc95-813c-46e2-82bc-b8af779242ad None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:51.930774 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabedc95-813c-46e2-82bc-b8af779242ad None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:51.931059 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabedc95-813c-46e2-82bc-b8af779242ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:51.957583 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-dabedc95-813c-46e2-82bc-b8af779242ad None None] MFA Rules not processed for user `00dd5de4aa804f9388d8a9a77a476a46`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:51.958795 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-dabedc95-813c-46e2-82bc-b8af779242ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:52.024076 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1308/2628] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:24:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:24:52.033284 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d638a-c621-4380-98fd-4ba85c43cbdd admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:52.034999 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-586d638a-c621-4380-98fd-4ba85c43cbdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:52.090314 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d638a-c621-4380-98fd-4ba85c43cbdd admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:52.093949 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12483cc7-4b7d-4f55-8f7f-4f5aa1291cbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:52.094838 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12483cc7-4b7d-4f55-8f7f-4f5aa1291cbf service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:52.095119 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12483cc7-4b7d-4f55-8f7f-4f5aa1291cbf service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:52.095389 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12483cc7-4b7d-4f55-8f7f-4f5aa1291cbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:52.104449 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12483cc7-4b7d-4f55-8f7f-4f5aa1291cbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:52.105854 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12483cc7-4b7d-4f55-8f7f-4f5aa1291cbf service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:52.115196 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1321/2629] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:24:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:24:52.446372 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabedc95-813c-46e2-82bc-b8af779242ad None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:52.506998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabedc95-813c-46e2-82bc-b8af779242ad None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:52.511462 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535f6c4-2424-4a68-b375-f62fb09936b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:52.512346 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535f6c4-2424-4a68-b375-f62fb09936b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:52.512634 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535f6c4-2424-4a68-b375-f62fb09936b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:52.512909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535f6c4-2424-4a68-b375-f62fb09936b9 admin admin] PATH_INFO: `/v3/users/18d637dfea334033a56efc705ad166f9` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:52.514096 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535f6c4-2424-4a68-b375-f62fb09936b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d637dfea334033a56efc705ad166f9)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:52.516021 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535f6c4-2424-4a68-b375-f62fb09936b9 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:52.558943 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-9535f6c4-2424-4a68-b375-f62fb09936b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d637dfea334033a56efc705ad166f9'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:52.570766 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-9535f6c4-2424-4a68-b375-f62fb09936b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d637dfea334033a56efc705ad166f9'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:52.571404 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-9535f6c4-2424-4a68-b375-f62fb09936b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d637dfea334033a56efc705ad166f9'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:52.572023 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-9535f6c4-2424-4a68-b375-f62fb09936b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d637dfea334033a56efc705ad166f9'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:52.578982 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-9535f6c4-2424-4a68-b375-f62fb09936b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d637dfea334033a56efc705ad166f9'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:52.591046 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1309/2630] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:24:52 2022] DELETE /identity/v3/users/18d637dfea334033a56efc705ad166f9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:24:52.595754 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0641b9-1dc0-44ab-a2c9-f0f92cabf3ed None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:52.596059 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0641b9-1dc0-44ab-a2c9-f0f92cabf3ed None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:52.596331 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0641b9-1dc0-44ab-a2c9-f0f92cabf3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:52.613860 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-7a0641b9-1dc0-44ab-a2c9-f0f92cabf3ed None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:52.615011 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-7a0641b9-1dc0-44ab-a2c9-f0f92cabf3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:52.677653 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1322/2631] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:24:52.687218 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535f6c4-2424-4a68-b375-f62fb09936b9 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:52.688610 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-9535f6c4-2424-4a68-b375-f62fb09936b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:52.743865 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535f6c4-2424-4a68-b375-f62fb09936b9 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:52.747438 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2ba5f-e43d-411f-9e20-5994970f4845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:52.748099 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2ba5f-e43d-411f-9e20-5994970f4845 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:52.748378 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2ba5f-e43d-411f-9e20-5994970f4845 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:52.748649 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2ba5f-e43d-411f-9e20-5994970f4845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:52.757650 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2ba5f-e43d-411f-9e20-5994970f4845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:52.759045 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2ba5f-e43d-411f-9e20-5994970f4845 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:52.768162 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1310/2632] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:24:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:24:53.023573 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0641b9-1dc0-44ab-a2c9-f0f92cabf3ed None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:53.025033 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-7a0641b9-1dc0-44ab-a2c9-f0f92cabf3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:53.038682 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0641b9-1dc0-44ab-a2c9-f0f92cabf3ed None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:53.043288 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edd82f-7e40-4d85-ac21-f946042875a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:53.044701 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edd82f-7e40-4d85-ac21-f946042875a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:53.045163 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edd82f-7e40-4d85-ac21-f946042875a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:53.045451 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edd82f-7e40-4d85-ac21-f946042875a8 admin admin] PATH_INFO: `/v3/projects/71ad7789e0bc44888ddd8833bde47714` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:53.046703 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edd82f-7e40-4d85-ac21-f946042875a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ad7789e0bc44888ddd8833bde47714)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:53.048762 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edd82f-7e40-4d85-ac21-f946042875a8 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:53.096270 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-31edd82f-7e40-4d85-ac21-f946042875a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ad7789e0bc44888ddd8833bde47714', 'request_id': 'req-31edd82f-7e40-4d85-ac21-f946042875a8'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:53.101983 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-31edd82f-7e40-4d85-ac21-f946042875a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ad7789e0bc44888ddd8833bde47714', 'request_id': 'req-31edd82f-7e40-4d85-ac21-f946042875a8'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:53.108026 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-31edd82f-7e40-4d85-ac21-f946042875a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ad7789e0bc44888ddd8833bde47714', 'request_id': 'req-31edd82f-7e40-4d85-ac21-f946042875a8'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:53.120011 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-31edd82f-7e40-4d85-ac21-f946042875a8 admin admin] The token cache is being invalidate because project 71ad7789e0bc44888ddd8833bde47714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:24:53.120298 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-31edd82f-7e40-4d85-ac21-f946042875a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:53.120910 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-31edd82f-7e40-4d85-ac21-f946042875a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:53.122407 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1323/2633] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:24:53 2022] DELETE /identity/v3/projects/71ad7789e0bc44888ddd8833bde47714 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:24:53.126347 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2ba5f-e43d-411f-9e20-5994970f4845 service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:53.136555 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2ba5f-e43d-411f-9e20-5994970f4845 service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:53.190648 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b6e0c-219b-4830-ac6b-74fbeb76c781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:53.191546 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b6e0c-219b-4830-ac6b-74fbeb76c781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:53.191848 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b6e0c-219b-4830-ac6b-74fbeb76c781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:53.192144 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b6e0c-219b-4830-ac6b-74fbeb76c781 admin admin] PATH_INFO: `/v3/users/00dd5de4aa804f9388d8a9a77a476a46` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:53.193323 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b6e0c-219b-4830-ac6b-74fbeb76c781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00dd5de4aa804f9388d8a9a77a476a46)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:53.195250 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b6e0c-219b-4830-ac6b-74fbeb76c781 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:53.239719 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-824b6e0c-219b-4830-ac6b-74fbeb76c781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00dd5de4aa804f9388d8a9a77a476a46'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:53.251420 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-824b6e0c-219b-4830-ac6b-74fbeb76c781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00dd5de4aa804f9388d8a9a77a476a46'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:53.252096 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-824b6e0c-219b-4830-ac6b-74fbeb76c781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00dd5de4aa804f9388d8a9a77a476a46'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:53.252684 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-824b6e0c-219b-4830-ac6b-74fbeb76c781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00dd5de4aa804f9388d8a9a77a476a46'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:53.259839 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-824b6e0c-219b-4830-ac6b-74fbeb76c781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00dd5de4aa804f9388d8a9a77a476a46'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:53.272415 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1311/2634] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:24:53 2022] DELETE /identity/v3/users/00dd5de4aa804f9388d8a9a77a476a46 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:24:53.536400 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edd82f-7e40-4d85-ac21-f946042875a8 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:53.537881 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-31edd82f-7e40-4d85-ac21-f946042875a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:53.552084 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edd82f-7e40-4d85-ac21-f946042875a8 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:53.608298 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec495348-a5c7-4ef0-9ab1-b845d809fcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:53.609184 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec495348-a5c7-4ef0-9ab1-b845d809fcde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:53.609458 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec495348-a5c7-4ef0-9ab1-b845d809fcde admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:53.609723 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec495348-a5c7-4ef0-9ab1-b845d809fcde admin admin] PATH_INFO: `/v3/projects/f8ed0f7c335c4ca498ecb1f36706a996` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:53.610915 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec495348-a5c7-4ef0-9ab1-b845d809fcde admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8ed0f7c335c4ca498ecb1f36706a996)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:53.613449 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec495348-a5c7-4ef0-9ab1-b845d809fcde admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:53.655505 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ec495348-a5c7-4ef0-9ab1-b845d809fcde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ed0f7c335c4ca498ecb1f36706a996', 'request_id': 'req-ec495348-a5c7-4ef0-9ab1-b845d809fcde'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:53.661231 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ec495348-a5c7-4ef0-9ab1-b845d809fcde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ed0f7c335c4ca498ecb1f36706a996', 'request_id': 'req-ec495348-a5c7-4ef0-9ab1-b845d809fcde'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:53.666944 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ec495348-a5c7-4ef0-9ab1-b845d809fcde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ed0f7c335c4ca498ecb1f36706a996', 'request_id': 'req-ec495348-a5c7-4ef0-9ab1-b845d809fcde'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:53.679170 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ec495348-a5c7-4ef0-9ab1-b845d809fcde admin admin] The token cache is being invalidate because project f8ed0f7c335c4ca498ecb1f36706a996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:24:53.679452 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ec495348-a5c7-4ef0-9ab1-b845d809fcde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:53.680093 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ec495348-a5c7-4ef0-9ab1-b845d809fcde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:53.681576 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1324/2635] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:24:53 2022] DELETE /identity/v3/projects/f8ed0f7c335c4ca498ecb1f36706a996 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:24:53.686518 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b5303-5c5c-45dd-bfc8-ed21541ac24e None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:53.686811 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b5303-5c5c-45dd-bfc8-ed21541ac24e None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:53.687092 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b5303-5c5c-45dd-bfc8-ed21541ac24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:53.705591 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-946b5303-5c5c-45dd-bfc8-ed21541ac24e None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:53.707427 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-946b5303-5c5c-45dd-bfc8-ed21541ac24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:53.764655 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1312/2636] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:24:53.772983 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846d578-972f-46ab-adc0-0fff713d4200 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:53.773389 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846d578-972f-46ab-adc0-0fff713d4200 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:53.773732 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846d578-972f-46ab-adc0-0fff713d4200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:53.791742 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-6846d578-972f-46ab-adc0-0fff713d4200 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:53.792942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-6846d578-972f-46ab-adc0-0fff713d4200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:53.801341 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1325/2637] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:24:53.805349 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b5303-5c5c-45dd-bfc8-ed21541ac24e None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:53.814861 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b5303-5c5c-45dd-bfc8-ed21541ac24e None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:53.820062 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b607aa9-e16f-4235-b302-46bf3f74a34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:53.820712 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b607aa9-e16f-4235-b302-46bf3f74a34d admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:53.820998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b607aa9-e16f-4235-b302-46bf3f74a34d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:53.821277 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b607aa9-e16f-4235-b302-46bf3f74a34d admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:53.822025 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b607aa9-e16f-4235-b302-46bf3f74a34d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:24:53.822314 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b607aa9-e16f-4235-b302-46bf3f74a34d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:53.823921 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b607aa9-e16f-4235-b302-46bf3f74a34d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:53.835111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1313/2638] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:24:53.839124 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846d578-972f-46ab-adc0-0fff713d4200 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:53.848525 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846d578-972f-46ab-adc0-0fff713d4200 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:53.853121 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9b4b3-1915-4dab-b3f3-ff46319f57a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:53.853750 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9b4b3-1915-4dab-b3f3-ff46319f57a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:53.854037 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9b4b3-1915-4dab-b3f3-ff46319f57a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:53.854311 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9b4b3-1915-4dab-b3f3-ff46319f57a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:53.855015 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9b4b3-1915-4dab-b3f3-ff46319f57a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:53.856915 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9b4b3-1915-4dab-b3f3-ff46319f57a9 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:53.881789 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1326/2639] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:24:53 2022] POST /identity/v3/projects => generated 359 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:24:53.885783 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b607aa9-e16f-4235-b302-46bf3f74a34d admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:53.895670 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b607aa9-e16f-4235-b302-46bf3f74a34d admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:53.950641 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0106c3-a9da-4fb8-a4e4-564376aa7ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:53.951307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0106c3-a9da-4fb8-a4e4-564376aa7ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:53.951595 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0106c3-a9da-4fb8-a4e4-564376aa7ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:53.951907 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0106c3-a9da-4fb8-a4e4-564376aa7ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:53.952604 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0106c3-a9da-4fb8-a4e4-564376aa7ed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:53.954527 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0106c3-a9da-4fb8-a4e4-564376aa7ed7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:53.973158 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1314/2640] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:24:53 2022] POST /identity/v3/users => generated 280 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:24:53.977257 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9b4b3-1915-4dab-b3f3-ff46319f57a9 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:53.987137 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9b4b3-1915-4dab-b3f3-ff46319f57a9 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:53.992279 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e266b12-880c-40cf-9919-9a715cffb799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:53.992921 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e266b12-880c-40cf-9919-9a715cffb799 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:53.993204 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e266b12-880c-40cf-9919-9a715cffb799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:53.993479 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e266b12-880c-40cf-9919-9a715cffb799 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:53.994208 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e266b12-880c-40cf-9919-9a715cffb799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:53.995785 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e266b12-880c-40cf-9919-9a715cffb799 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:54.006401 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1327/2641] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:24:54.010122 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0106c3-a9da-4fb8-a4e4-564376aa7ed7 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:54.020600 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0106c3-a9da-4fb8-a4e4-564376aa7ed7 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:54.025077 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc18cf3-e8e4-4593-87f9-a5b90b3401bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:54.025716 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc18cf3-e8e4-4593-87f9-a5b90b3401bf admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:54.025998 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc18cf3-e8e4-4593-87f9-a5b90b3401bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:54.026272 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc18cf3-e8e4-4593-87f9-a5b90b3401bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:54.027041 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc18cf3-e8e4-4593-87f9-a5b90b3401bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:54.028646 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc18cf3-e8e4-4593-87f9-a5b90b3401bf admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:54.040863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1315/2642] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:24:54.044866 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e266b12-880c-40cf-9919-9a715cffb799 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:54.054832 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e266b12-880c-40cf-9919-9a715cffb799 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:54.059356 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf200ff0-cdd0-4522-9e91-5fef4565ed44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:54.060440 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf200ff0-cdd0-4522-9e91-5fef4565ed44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:54.060720 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf200ff0-cdd0-4522-9e91-5fef4565ed44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:54.060996 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf200ff0-cdd0-4522-9e91-5fef4565ed44 admin admin] PATH_INFO: `/v3/projects/c45f7320dab743a5acd3ffdc379c566d/users/e297d266ac76440b9dd3a4b601f42bf3/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:54.075161 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf200ff0-cdd0-4522-9e91-5fef4565ed44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c45f7320dab743a5acd3ffdc379c566d, user_id=e297d266ac76440b9dd3a4b601f42bf3, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:54.077825 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf200ff0-cdd0-4522-9e91-5fef4565ed44 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:54.091449 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1328/2643] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:24:54 2022] PUT /identity/v3/projects/c45f7320dab743a5acd3ffdc379c566d/users/e297d266ac76440b9dd3a4b601f42bf3/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:24:54.102850 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5855a37-0c98-4fd0-b09c-fc3441044358 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:54.103138 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5855a37-0c98-4fd0-b09c-fc3441044358 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:54.103414 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5855a37-0c98-4fd0-b09c-fc3441044358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:54.128981 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-c5855a37-0c98-4fd0-b09c-fc3441044358 None None] MFA Rules not processed for user `e297d266ac76440b9dd3a4b601f42bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:54.130204 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-c5855a37-0c98-4fd0-b09c-fc3441044358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:54.192893 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1316/2644] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:24:54 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:24:54.219864 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf200ff0-cdd0-4522-9e91-5fef4565ed44 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:54.221545 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-bf200ff0-cdd0-4522-9e91-5fef4565ed44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:54.278179 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf200ff0-cdd0-4522-9e91-5fef4565ed44 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:54.281766 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091fa49-b119-4eec-805a-fae8cf5cc027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:54.282404 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091fa49-b119-4eec-805a-fae8cf5cc027 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:54.282686 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091fa49-b119-4eec-805a-fae8cf5cc027 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:54.282959 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091fa49-b119-4eec-805a-fae8cf5cc027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:54.291716 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091fa49-b119-4eec-805a-fae8cf5cc027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:54.293170 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091fa49-b119-4eec-805a-fae8cf5cc027 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:54.301873 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1329/2645] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:24:54 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:24:54.315634 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5855a37-0c98-4fd0-b09c-fc3441044358 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:54.376570 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5855a37-0c98-4fd0-b09c-fc3441044358 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:54.381300 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da795f4-78af-472f-b668-ba7f0c076435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:54.382166 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da795f4-78af-472f-b668-ba7f0c076435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:54.382467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da795f4-78af-472f-b668-ba7f0c076435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:54.382741 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da795f4-78af-472f-b668-ba7f0c076435 admin admin] PATH_INFO: `/v3/users/e297d266ac76440b9dd3a4b601f42bf3` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:54.384071 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da795f4-78af-472f-b668-ba7f0c076435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e297d266ac76440b9dd3a4b601f42bf3)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:54.385978 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da795f4-78af-472f-b668-ba7f0c076435 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:54.431430 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-6da795f4-78af-472f-b668-ba7f0c076435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e297d266ac76440b9dd3a4b601f42bf3'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:54.442545 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-6da795f4-78af-472f-b668-ba7f0c076435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e297d266ac76440b9dd3a4b601f42bf3'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:54.443187 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-6da795f4-78af-472f-b668-ba7f0c076435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e297d266ac76440b9dd3a4b601f42bf3'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:54.443782 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-6da795f4-78af-472f-b668-ba7f0c076435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e297d266ac76440b9dd3a4b601f42bf3'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:54.451062 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-6da795f4-78af-472f-b668-ba7f0c076435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e297d266ac76440b9dd3a4b601f42bf3'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:54.462846 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1317/2646] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:24:54 2022] DELETE /identity/v3/users/e297d266ac76440b9dd3a4b601f42bf3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:24:54.467308 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913710b8-f61f-4302-b750-b14ddbe49d02 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:54.467593 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913710b8-f61f-4302-b750-b14ddbe49d02 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:54.467903 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913710b8-f61f-4302-b750-b14ddbe49d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:54.485509 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-913710b8-f61f-4302-b750-b14ddbe49d02 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:54.486676 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-913710b8-f61f-4302-b750-b14ddbe49d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:54.541525 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1330/2647] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:24:54.551392 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da795f4-78af-472f-b668-ba7f0c076435 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:54.552905 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-6da795f4-78af-472f-b668-ba7f0c076435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:54.608507 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da795f4-78af-472f-b668-ba7f0c076435 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:54.612131 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11f03f-274b-47d8-b931-f299ab9c5a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:54.612972 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11f03f-274b-47d8-b931-f299ab9c5a65 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:54.613245 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11f03f-274b-47d8-b931-f299ab9c5a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:54.613516 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11f03f-274b-47d8-b931-f299ab9c5a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:54.622281 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11f03f-274b-47d8-b931-f299ab9c5a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:54.623688 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11f03f-274b-47d8-b931-f299ab9c5a65 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:54.633164 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1318/2648] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:24:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:24:54.920064 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913710b8-f61f-4302-b750-b14ddbe49d02 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:54.921501 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-913710b8-f61f-4302-b750-b14ddbe49d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:54.934548 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913710b8-f61f-4302-b750-b14ddbe49d02 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:54.939044 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7fff3-94a1-472e-a075-68521a19030c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:54.939921 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7fff3-94a1-472e-a075-68521a19030c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:54.941191 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7fff3-94a1-472e-a075-68521a19030c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:54.941480 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7fff3-94a1-472e-a075-68521a19030c admin admin] PATH_INFO: `/v3/projects/c45f7320dab743a5acd3ffdc379c566d` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:54.942850 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7fff3-94a1-472e-a075-68521a19030c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c45f7320dab743a5acd3ffdc379c566d)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:54.944813 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7fff3-94a1-472e-a075-68521a19030c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:54.989244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-8ef7fff3-94a1-472e-a075-68521a19030c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c45f7320dab743a5acd3ffdc379c566d', 'request_id': 'req-8ef7fff3-94a1-472e-a075-68521a19030c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:54.994424 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-8ef7fff3-94a1-472e-a075-68521a19030c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c45f7320dab743a5acd3ffdc379c566d', 'request_id': 'req-8ef7fff3-94a1-472e-a075-68521a19030c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:55.000253 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-8ef7fff3-94a1-472e-a075-68521a19030c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c45f7320dab743a5acd3ffdc379c566d', 'request_id': 'req-8ef7fff3-94a1-472e-a075-68521a19030c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:55.012427 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-8ef7fff3-94a1-472e-a075-68521a19030c admin admin] The token cache is being invalidate because project c45f7320dab743a5acd3ffdc379c566d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:24:55.012744 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-8ef7fff3-94a1-472e-a075-68521a19030c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:55.013360 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-8ef7fff3-94a1-472e-a075-68521a19030c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:24:55.014860 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1331/2649] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:24:54 2022] DELETE /identity/v3/projects/c45f7320dab743a5acd3ffdc379c566d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:24:55.020300 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae93bc2-5c07-47ce-becc-bed8da7da620 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:55.020589 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae93bc2-5c07-47ce-becc-bed8da7da620 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:55.020872 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae93bc2-5c07-47ce-becc-bed8da7da620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:55.038335 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-aae93bc2-5c07-47ce-becc-bed8da7da620 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:55.039518 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-aae93bc2-5c07-47ce-becc-bed8da7da620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:55.099611 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1319/2650] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:24:55.108184 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab2b1b-ae99-4144-b0a7-45b0ba66defa None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:55.108669 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab2b1b-ae99-4144-b0a7-45b0ba66defa None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:55.108769 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab2b1b-ae99-4144-b0a7-45b0ba66defa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:55.126832 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-74ab2b1b-ae99-4144-b0a7-45b0ba66defa None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:55.128054 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-74ab2b1b-ae99-4144-b0a7-45b0ba66defa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:55.136598 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1332/2651] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:24:55.140681 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae93bc2-5c07-47ce-becc-bed8da7da620 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:55.150895 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae93bc2-5c07-47ce-becc-bed8da7da620 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:55.155490 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2cca1-7010-40af-89cb-717d77dc1e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:55.156172 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2cca1-7010-40af-89cb-717d77dc1e97 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:55.156457 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2cca1-7010-40af-89cb-717d77dc1e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:55.156732 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2cca1-7010-40af-89cb-717d77dc1e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:55.157459 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2cca1-7010-40af-89cb-717d77dc1e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:24:55.157760 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2cca1-7010-40af-89cb-717d77dc1e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:55.159335 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2cca1-7010-40af-89cb-717d77dc1e97 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:55.170491 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1320/2652] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:24:55.174631 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab2b1b-ae99-4144-b0a7-45b0ba66defa None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:55.183664 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab2b1b-ae99-4144-b0a7-45b0ba66defa None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:55.188237 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc229a6-95c7-491e-bfc1-b771f3eabf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:55.188871 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc229a6-95c7-491e-bfc1-b771f3eabf1a admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:55.189156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc229a6-95c7-491e-bfc1-b771f3eabf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:55.189429 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc229a6-95c7-491e-bfc1-b771f3eabf1a admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:55.190135 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc229a6-95c7-491e-bfc1-b771f3eabf1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:55.192588 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc229a6-95c7-491e-bfc1-b771f3eabf1a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:55.217503 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1333/2653] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:24:55 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:24:55.222095 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2cca1-7010-40af-89cb-717d77dc1e97 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:55.232330 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2cca1-7010-40af-89cb-717d77dc1e97 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:55.287072 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c907b5-1b1d-4468-b5e2-8b6d6e5c1c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:55.287721 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c907b5-1b1d-4468-b5e2-8b6d6e5c1c0e admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:55.288030 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c907b5-1b1d-4468-b5e2-8b6d6e5c1c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:55.288306 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c907b5-1b1d-4468-b5e2-8b6d6e5c1c0e admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:55.289001 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c907b5-1b1d-4468-b5e2-8b6d6e5c1c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:55.290883 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c907b5-1b1d-4468-b5e2-8b6d6e5c1c0e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:55.309487 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1321/2654] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:24:55 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:24:55.313889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc229a6-95c7-491e-bfc1-b771f3eabf1a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:55.324031 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc229a6-95c7-491e-bfc1-b771f3eabf1a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:55.328594 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde54d27-1e94-4615-ac02-70285b949da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:55.329242 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54d27-1e94-4615-ac02-70285b949da2 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:55.329532 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54d27-1e94-4615-ac02-70285b949da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:55.329811 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54d27-1e94-4615-ac02-70285b949da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:55.330542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde54d27-1e94-4615-ac02-70285b949da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:55.332247 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde54d27-1e94-4615-ac02-70285b949da2 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:55.342778 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1334/2655] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:24:55.347017 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c907b5-1b1d-4468-b5e2-8b6d6e5c1c0e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:55.357737 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c907b5-1b1d-4468-b5e2-8b6d6e5c1c0e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:55.362440 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cfbcd-bfed-4f3f-873d-e79d84b40c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:55.363084 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cfbcd-bfed-4f3f-873d-e79d84b40c2e admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:55.363366 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cfbcd-bfed-4f3f-873d-e79d84b40c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:55.363640 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cfbcd-bfed-4f3f-873d-e79d84b40c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:55.364583 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cfbcd-bfed-4f3f-873d-e79d84b40c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:55.366180 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cfbcd-bfed-4f3f-873d-e79d84b40c2e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:55.376118 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1322/2656] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:24:55.380264 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde54d27-1e94-4615-ac02-70285b949da2 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:55.390241 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde54d27-1e94-4615-ac02-70285b949da2 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:55.394837 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823e106-3022-4cca-ba21-0023362aa3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:55.396398 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823e106-3022-4cca-ba21-0023362aa3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:55.396676 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823e106-3022-4cca-ba21-0023362aa3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:55.396954 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823e106-3022-4cca-ba21-0023362aa3c8 admin admin] PATH_INFO: `/v3/projects/7e8f61a6a1804c6da8b0bf7798aa3c2f/users/9272be220ee940aa8e30f810aa4e9b30/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:55.412343 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823e106-3022-4cca-ba21-0023362aa3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8f61a6a1804c6da8b0bf7798aa3c2f, user_id=9272be220ee940aa8e30f810aa4e9b30, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:55.415053 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823e106-3022-4cca-ba21-0023362aa3c8 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:55.427247 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1335/2657] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:24:55 2022] PUT /identity/v3/projects/7e8f61a6a1804c6da8b0bf7798aa3c2f/users/9272be220ee940aa8e30f810aa4e9b30/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:24:55.437341 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3f20a-4cdd-4b5a-99c7-ed53c09cc08d None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:55.437631 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3f20a-4cdd-4b5a-99c7-ed53c09cc08d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:55.437912 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3f20a-4cdd-4b5a-99c7-ed53c09cc08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:55.464446 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-e7a3f20a-4cdd-4b5a-99c7-ed53c09cc08d None None] MFA Rules not processed for user `9272be220ee940aa8e30f810aa4e9b30`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:55.465672 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e7a3f20a-4cdd-4b5a-99c7-ed53c09cc08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:55.527675 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1323/2658] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:24:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:24:55.532111 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823e106-3022-4cca-ba21-0023362aa3c8 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:55.592179 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823e106-3022-4cca-ba21-0023362aa3c8 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:55.597085 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6100a4-6633-48ca-bc2b-866500cce483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:55.597729 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6100a4-6633-48ca-bc2b-866500cce483 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:55.598011 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6100a4-6633-48ca-bc2b-866500cce483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:55.598967 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6100a4-6633-48ca-bc2b-866500cce483 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:55.599679 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6100a4-6633-48ca-bc2b-866500cce483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:55.601583 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6100a4-6633-48ca-bc2b-866500cce483 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:55.625158 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1336/2659] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:24:55 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:24:55.629089 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3f20a-4cdd-4b5a-99c7-ed53c09cc08d None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:55.639916 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3f20a-4cdd-4b5a-99c7-ed53c09cc08d None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:55.694097 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18ef26-a987-401f-89b2-aba32b60d453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:55.694770 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18ef26-a987-401f-89b2-aba32b60d453 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:55.695055 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18ef26-a987-401f-89b2-aba32b60d453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:55.695333 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18ef26-a987-401f-89b2-aba32b60d453 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:55.696066 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18ef26-a987-401f-89b2-aba32b60d453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:55.697963 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18ef26-a987-401f-89b2-aba32b60d453 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:55.716729 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1324/2660] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:24:55 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:24:55.721054 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6100a4-6633-48ca-bc2b-866500cce483 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:55.731423 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6100a4-6633-48ca-bc2b-866500cce483 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:55.735926 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d883d-35a0-491f-b56f-5526da0528c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:55.736562 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d883d-35a0-491f-b56f-5526da0528c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:55.736842 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d883d-35a0-491f-b56f-5526da0528c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:55.737112 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d883d-35a0-491f-b56f-5526da0528c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:55.737839 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d883d-35a0-491f-b56f-5526da0528c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:55.740057 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d883d-35a0-491f-b56f-5526da0528c0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:55.749966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1337/2661] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:24:55.753685 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18ef26-a987-401f-89b2-aba32b60d453 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:55.763995 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18ef26-a987-401f-89b2-aba32b60d453 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:55.768891 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a870cd-b07b-448e-a5eb-06e16752ea80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:55.769547 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a870cd-b07b-448e-a5eb-06e16752ea80 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:55.769837 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a870cd-b07b-448e-a5eb-06e16752ea80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:55.770188 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a870cd-b07b-448e-a5eb-06e16752ea80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:55.771048 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a870cd-b07b-448e-a5eb-06e16752ea80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:55.772694 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a870cd-b07b-448e-a5eb-06e16752ea80 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:55.782420 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1325/2662] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:24:55.786924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d883d-35a0-491f-b56f-5526da0528c0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:55.796314 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d883d-35a0-491f-b56f-5526da0528c0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:55.800856 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf07b5-21a8-4991-9a4b-c3244593c43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:55.802405 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf07b5-21a8-4991-9a4b-c3244593c43e admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:55.802738 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf07b5-21a8-4991-9a4b-c3244593c43e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:55.803062 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf07b5-21a8-4991-9a4b-c3244593c43e admin admin] PATH_INFO: `/v3/projects/a14eeedf4f3044b298f212a7da245428/users/c9ca4790be7849b9b88e92ba66c7ad82/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:55.817056 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf07b5-21a8-4991-9a4b-c3244593c43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14eeedf4f3044b298f212a7da245428, user_id=c9ca4790be7849b9b88e92ba66c7ad82, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:55.819661 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf07b5-21a8-4991-9a4b-c3244593c43e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:55.832089 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1338/2663] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:24:55 2022] PUT /identity/v3/projects/a14eeedf4f3044b298f212a7da245428/users/c9ca4790be7849b9b88e92ba66c7ad82/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:24:55.842511 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0ea75-ea8c-47a4-8de8-68736877f86d None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:55.842746 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0ea75-ea8c-47a4-8de8-68736877f86d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:55.843032 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0ea75-ea8c-47a4-8de8-68736877f86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:55.870384 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-cda0ea75-ea8c-47a4-8de8-68736877f86d None None] MFA Rules not processed for user `c9ca4790be7849b9b88e92ba66c7ad82`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:55.871580 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-cda0ea75-ea8c-47a4-8de8-68736877f86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:55.934759 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1326/2664] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:24:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:24:55.939358 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf07b5-21a8-4991-9a4b-c3244593c43e admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:55.999412 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf07b5-21a8-4991-9a4b-c3244593c43e admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:56.004101 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febba71-d349-4ef1-ab73-ca51306df48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:56.005485 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febba71-d349-4ef1-ab73-ca51306df48e admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:56.005820 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febba71-d349-4ef1-ab73-ca51306df48e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:56.006131 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febba71-d349-4ef1-ab73-ca51306df48e admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:56.006834 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febba71-d349-4ef1-ab73-ca51306df48e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:56.008767 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febba71-d349-4ef1-ab73-ca51306df48e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:56.034214 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1339/2665] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:24:55 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:24:56.038346 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0ea75-ea8c-47a4-8de8-68736877f86d None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:56.048822 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0ea75-ea8c-47a4-8de8-68736877f86d None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:56.106735 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8870a-ec11-46b6-b8a1-d5f21881dfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:56.107335 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8870a-ec11-46b6-b8a1-d5f21881dfbf admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:56.107617 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8870a-ec11-46b6-b8a1-d5f21881dfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:56.107929 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8870a-ec11-46b6-b8a1-d5f21881dfbf admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:56.108636 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8870a-ec11-46b6-b8a1-d5f21881dfbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:56.110548 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8870a-ec11-46b6-b8a1-d5f21881dfbf admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:56.130593 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1327/2666] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:24:56 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:24:56.134639 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febba71-d349-4ef1-ab73-ca51306df48e admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:56.144572 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febba71-d349-4ef1-ab73-ca51306df48e admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:56.149987 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6ab68-e3c8-4b70-825f-31cd9fa36ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:56.150629 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6ab68-e3c8-4b70-825f-31cd9fa36ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:56.150913 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6ab68-e3c8-4b70-825f-31cd9fa36ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:56.151188 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6ab68-e3c8-4b70-825f-31cd9fa36ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:56.151984 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6ab68-e3c8-4b70-825f-31cd9fa36ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:56.154075 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6ab68-e3c8-4b70-825f-31cd9fa36ba0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:56.165343 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1340/2667] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:24:56.169294 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8870a-ec11-46b6-b8a1-d5f21881dfbf admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:56.179016 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8870a-ec11-46b6-b8a1-d5f21881dfbf admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:56.183594 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccee3e-9d96-4a6c-a1ce-11cf20a04623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:56.184476 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccee3e-9d96-4a6c-a1ce-11cf20a04623 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:56.184750 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccee3e-9d96-4a6c-a1ce-11cf20a04623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:56.185019 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccee3e-9d96-4a6c-a1ce-11cf20a04623 admin admin] PATH_INFO: `/v3/projects/a547240404bd4222a54b835da960303c/users/d59330c0428f4eb189aeba5976989c57/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:56.199079 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccee3e-9d96-4a6c-a1ce-11cf20a04623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a547240404bd4222a54b835da960303c, user_id=d59330c0428f4eb189aeba5976989c57, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:56.201827 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccee3e-9d96-4a6c-a1ce-11cf20a04623 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:56.215119 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1328/2668] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:24:56 2022] PUT /identity/v3/projects/a547240404bd4222a54b835da960303c/users/d59330c0428f4eb189aeba5976989c57/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:24:56.218965 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6ab68-e3c8-4b70-825f-31cd9fa36ba0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:56.229548 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6ab68-e3c8-4b70-825f-31cd9fa36ba0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:56.283613 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d159f-259a-4f20-bd06-9471e0cd2708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:56.284616 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d159f-259a-4f20-bd06-9471e0cd2708 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:56.284923 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d159f-259a-4f20-bd06-9471e0cd2708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:56.285196 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d159f-259a-4f20-bd06-9471e0cd2708 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:56.286542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d159f-259a-4f20-bd06-9471e0cd2708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:56.288343 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d159f-259a-4f20-bd06-9471e0cd2708 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:56.298039 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1341/2669] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:24:56.302122 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccee3e-9d96-4a6c-a1ce-11cf20a04623 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:56.312075 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccee3e-9d96-4a6c-a1ce-11cf20a04623 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:56.316625 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2ca43-0dbb-47ed-857d-796e1ca4068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:56.317683 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2ca43-0dbb-47ed-857d-796e1ca4068d admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:56.317964 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2ca43-0dbb-47ed-857d-796e1ca4068d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:56.318237 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2ca43-0dbb-47ed-857d-796e1ca4068d admin admin] PATH_INFO: `/v3/projects/a547240404bd4222a54b835da960303c/users/d59330c0428f4eb189aeba5976989c57/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:56.320240 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2ca43-0dbb-47ed-857d-796e1ca4068d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a547240404bd4222a54b835da960303c, user_id=d59330c0428f4eb189aeba5976989c57, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:56.322831 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2ca43-0dbb-47ed-857d-796e1ca4068d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:56.333552 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1329/2670] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:24:56 2022] PUT /identity/v3/projects/a547240404bd4222a54b835da960303c/users/d59330c0428f4eb189aeba5976989c57/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:24:56.345043 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fb0f7-7369-4f48-b556-9349371132ee None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:56.345334 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fb0f7-7369-4f48-b556-9349371132ee None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:56.345640 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fb0f7-7369-4f48-b556-9349371132ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:56.371609 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-724fb0f7-7369-4f48-b556-9349371132ee None None] MFA Rules not processed for user `d59330c0428f4eb189aeba5976989c57`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:24:56.372775 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-724fb0f7-7369-4f48-b556-9349371132ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:56.437589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1342/2671] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:24:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:24:56.448008 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2ca43-0dbb-47ed-857d-796e1ca4068d admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:56.449751 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-cdf2ca43-0dbb-47ed-857d-796e1ca4068d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:56.503668 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2ca43-0dbb-47ed-857d-796e1ca4068d admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:56.507922 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b90fca-df37-4d29-8d87-c3d17b6dcc48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:56.508553 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b90fca-df37-4d29-8d87-c3d17b6dcc48 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:56.508834 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b90fca-df37-4d29-8d87-c3d17b6dcc48 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:56.509111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b90fca-df37-4d29-8d87-c3d17b6dcc48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:56.561470 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b90fca-df37-4d29-8d87-c3d17b6dcc48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:56.562878 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b90fca-df37-4d29-8d87-c3d17b6dcc48 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:56.572089 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1330/2672] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:24:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:24:58.020748 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fb0f7-7369-4f48-b556-9349371132ee None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:58.022173 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-724fb0f7-7369-4f48-b556-9349371132ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:24:58.033513 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fb0f7-7369-4f48-b556-9349371132ee None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:58.037464 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d7af0-e45b-410a-bf5f-43911837413e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:58.038084 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d7af0-e45b-410a-bf5f-43911837413e service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:58.038360 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d7af0-e45b-410a-bf5f-43911837413e service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:58.038626 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d7af0-e45b-410a-bf5f-43911837413e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:58.093481 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d7af0-e45b-410a-bf5f-43911837413e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:58.095157 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d7af0-e45b-410a-bf5f-43911837413e service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:58.104149 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1343/2673] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:24:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:24:58.593655 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b90fca-df37-4d29-8d87-c3d17b6dcc48 service cinder] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:24:58.602972 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b90fca-df37-4d29-8d87-c3d17b6dcc48 service cinder] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:24:58.606571 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e0767-8263-4f3b-9df1-15833b16694b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:24:58.607208 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e0767-8263-4f3b-9df1-15833b16694b service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:24:58.607493 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e0767-8263-4f3b-9df1-15833b16694b service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:24:58.607773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e0767-8263-4f3b-9df1-15833b16694b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:24:58.617086 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e0767-8263-4f3b-9df1-15833b16694b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:24:58.618444 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e0767-8263-4f3b-9df1-15833b16694b service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:24:58.627686 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1331/2674] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:24:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:25:02.408202 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d7af0-e45b-410a-bf5f-43911837413e service cinder] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:02.469722 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d7af0-e45b-410a-bf5f-43911837413e service cinder] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:02.475342 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4471f-b202-40e9-ac9c-bbebb61cf053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:02.476234 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4471f-b202-40e9-ac9c-bbebb61cf053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:02.476521 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4471f-b202-40e9-ac9c-bbebb61cf053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:02.476789 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4471f-b202-40e9-ac9c-bbebb61cf053 admin admin] PATH_INFO: `/v3/users/9272be220ee940aa8e30f810aa4e9b30` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:02.477996 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4471f-b202-40e9-ac9c-bbebb61cf053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9272be220ee940aa8e30f810aa4e9b30)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:02.479940 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4471f-b202-40e9-ac9c-bbebb61cf053 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:02.527692 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f8f4471f-b202-40e9-ac9c-bbebb61cf053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9272be220ee940aa8e30f810aa4e9b30'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:02.540710 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f8f4471f-b202-40e9-ac9c-bbebb61cf053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9272be220ee940aa8e30f810aa4e9b30'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:02.542025 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f8f4471f-b202-40e9-ac9c-bbebb61cf053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9272be220ee940aa8e30f810aa4e9b30'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:02.549233 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f8f4471f-b202-40e9-ac9c-bbebb61cf053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9272be220ee940aa8e30f810aa4e9b30'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:02.549930 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-f8f4471f-b202-40e9-ac9c-bbebb61cf053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9272be220ee940aa8e30f810aa4e9b30'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:02.563419 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1344/2675] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:25:02 2022] DELETE /identity/v3/users/9272be220ee940aa8e30f810aa4e9b30 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:02.568454 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b96d3d-395d-474d-bb24-ea29fe0e3167 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:02.568925 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b96d3d-395d-474d-bb24-ea29fe0e3167 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:02.569025 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b96d3d-395d-474d-bb24-ea29fe0e3167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:02.586065 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-78b96d3d-395d-474d-bb24-ea29fe0e3167 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:25:02.587258 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-78b96d3d-395d-474d-bb24-ea29fe0e3167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:02.646041 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1332/2676] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:25:02.655655 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4471f-b202-40e9-ac9c-bbebb61cf053 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:02.657055 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-f8f4471f-b202-40e9-ac9c-bbebb61cf053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:02.724390 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4471f-b202-40e9-ac9c-bbebb61cf053 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:02.727935 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2050a-8edc-4c37-b36b-436fa53038b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:02.728564 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2050a-8edc-4c37-b36b-436fa53038b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:02.728844 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2050a-8edc-4c37-b36b-436fa53038b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:02.729115 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2050a-8edc-4c37-b36b-436fa53038b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:02.737808 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2050a-8edc-4c37-b36b-436fa53038b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:02.739973 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2050a-8edc-4c37-b36b-436fa53038b1 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:02.748853 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1345/2677] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:25:03.003543 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b96d3d-395d-474d-bb24-ea29fe0e3167 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:03.005088 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-78b96d3d-395d-474d-bb24-ea29fe0e3167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:03.016863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b96d3d-395d-474d-bb24-ea29fe0e3167 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:03.022338 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38f061-cddd-4502-bb12-f287b68e9940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:03.023488 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38f061-cddd-4502-bb12-f287b68e9940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:03.023748 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38f061-cddd-4502-bb12-f287b68e9940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:03.024205 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38f061-cddd-4502-bb12-f287b68e9940 admin admin] PATH_INFO: `/v3/projects/7e8f61a6a1804c6da8b0bf7798aa3c2f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:03.025589 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38f061-cddd-4502-bb12-f287b68e9940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e8f61a6a1804c6da8b0bf7798aa3c2f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:03.027719 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38f061-cddd-4502-bb12-f287b68e9940 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:03.073597 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1b38f061-cddd-4502-bb12-f287b68e9940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e8f61a6a1804c6da8b0bf7798aa3c2f', 'request_id': 'req-1b38f061-cddd-4502-bb12-f287b68e9940'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:03.082503 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1b38f061-cddd-4502-bb12-f287b68e9940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e8f61a6a1804c6da8b0bf7798aa3c2f', 'request_id': 'req-1b38f061-cddd-4502-bb12-f287b68e9940'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:03.088690 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1b38f061-cddd-4502-bb12-f287b68e9940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e8f61a6a1804c6da8b0bf7798aa3c2f', 'request_id': 'req-1b38f061-cddd-4502-bb12-f287b68e9940'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:03.100342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1b38f061-cddd-4502-bb12-f287b68e9940 admin admin] The token cache is being invalidate because project 7e8f61a6a1804c6da8b0bf7798aa3c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:25:03.100632 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1b38f061-cddd-4502-bb12-f287b68e9940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:03.101266 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1b38f061-cddd-4502-bb12-f287b68e9940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:03.102774 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1333/2678] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:25:03 2022] DELETE /identity/v3/projects/7e8f61a6a1804c6da8b0bf7798aa3c2f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:03.106679 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2050a-8edc-4c37-b36b-436fa53038b1 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:03.116223 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2050a-8edc-4c37-b36b-436fa53038b1 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:03.170389 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2eac83-a7fb-4dd4-a5e6-2bcf8daed456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:03.171242 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2eac83-a7fb-4dd4-a5e6-2bcf8daed456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:03.171522 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2eac83-a7fb-4dd4-a5e6-2bcf8daed456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:03.171792 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2eac83-a7fb-4dd4-a5e6-2bcf8daed456 admin admin] PATH_INFO: `/v3/users/c9ca4790be7849b9b88e92ba66c7ad82` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:03.173015 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2eac83-a7fb-4dd4-a5e6-2bcf8daed456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ca4790be7849b9b88e92ba66c7ad82)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:03.174952 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2eac83-a7fb-4dd4-a5e6-2bcf8daed456 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:03.218265 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5f2eac83-a7fb-4dd4-a5e6-2bcf8daed456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ca4790be7849b9b88e92ba66c7ad82'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:03.229934 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5f2eac83-a7fb-4dd4-a5e6-2bcf8daed456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ca4790be7849b9b88e92ba66c7ad82'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:03.230572 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5f2eac83-a7fb-4dd4-a5e6-2bcf8daed456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ca4790be7849b9b88e92ba66c7ad82'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:03.236967 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5f2eac83-a7fb-4dd4-a5e6-2bcf8daed456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ca4790be7849b9b88e92ba66c7ad82'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:03.237762 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-5f2eac83-a7fb-4dd4-a5e6-2bcf8daed456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ca4790be7849b9b88e92ba66c7ad82'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:03.249769 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1346/2679] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:25:03 2022] DELETE /identity/v3/users/c9ca4790be7849b9b88e92ba66c7ad82 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:03.510207 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38f061-cddd-4502-bb12-f287b68e9940 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:03.511868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-1b38f061-cddd-4502-bb12-f287b68e9940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:03.525350 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38f061-cddd-4502-bb12-f287b68e9940 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:03.579727 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4801c24-d293-4361-a052-15904ae79803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:03.580618 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4801c24-d293-4361-a052-15904ae79803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:03.580899 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4801c24-d293-4361-a052-15904ae79803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:03.581176 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4801c24-d293-4361-a052-15904ae79803 admin admin] PATH_INFO: `/v3/projects/a14eeedf4f3044b298f212a7da245428` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:03.582375 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4801c24-d293-4361-a052-15904ae79803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a14eeedf4f3044b298f212a7da245428)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:03.585094 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4801c24-d293-4361-a052-15904ae79803 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:03.628960 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-d4801c24-d293-4361-a052-15904ae79803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a14eeedf4f3044b298f212a7da245428', 'request_id': 'req-d4801c24-d293-4361-a052-15904ae79803'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:03.636960 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-d4801c24-d293-4361-a052-15904ae79803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a14eeedf4f3044b298f212a7da245428', 'request_id': 'req-d4801c24-d293-4361-a052-15904ae79803'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:03.642323 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-d4801c24-d293-4361-a052-15904ae79803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a14eeedf4f3044b298f212a7da245428', 'request_id': 'req-d4801c24-d293-4361-a052-15904ae79803'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:03.653921 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-d4801c24-d293-4361-a052-15904ae79803 admin admin] The token cache is being invalidate because project a14eeedf4f3044b298f212a7da245428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:25:03.654232 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-d4801c24-d293-4361-a052-15904ae79803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:03.654859 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-d4801c24-d293-4361-a052-15904ae79803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:03.656397 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1334/2680] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:25:03 2022] DELETE /identity/v3/projects/a14eeedf4f3044b298f212a7da245428 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:03.660549 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2eac83-a7fb-4dd4-a5e6-2bcf8daed456 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:03.662918 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-5f2eac83-a7fb-4dd4-a5e6-2bcf8daed456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:03.675089 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2eac83-a7fb-4dd4-a5e6-2bcf8daed456 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:03.728574 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94d821-d0e0-4475-81c1-65a163104618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:03.729422 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94d821-d0e0-4475-81c1-65a163104618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:03.729699 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94d821-d0e0-4475-81c1-65a163104618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:03.729966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94d821-d0e0-4475-81c1-65a163104618 admin admin] PATH_INFO: `/v3/users/d59330c0428f4eb189aeba5976989c57` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:03.731175 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94d821-d0e0-4475-81c1-65a163104618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d59330c0428f4eb189aeba5976989c57)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:03.733064 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94d821-d0e0-4475-81c1-65a163104618 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:03.775721 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7a94d821-d0e0-4475-81c1-65a163104618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd59330c0428f4eb189aeba5976989c57'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:03.786786 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7a94d821-d0e0-4475-81c1-65a163104618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd59330c0428f4eb189aeba5976989c57'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:03.787982 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7a94d821-d0e0-4475-81c1-65a163104618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd59330c0428f4eb189aeba5976989c57'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:03.794203 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7a94d821-d0e0-4475-81c1-65a163104618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd59330c0428f4eb189aeba5976989c57'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:03.794966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7a94d821-d0e0-4475-81c1-65a163104618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd59330c0428f4eb189aeba5976989c57'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:03.806966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1347/2681] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:25:03 2022] DELETE /identity/v3/users/d59330c0428f4eb189aeba5976989c57 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:04.073152 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4801c24-d293-4361-a052-15904ae79803 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:04.074664 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-d4801c24-d293-4361-a052-15904ae79803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:04.091232 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4801c24-d293-4361-a052-15904ae79803 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:04.147711 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa4d2e-fb29-4378-977a-11c28768f7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:04.148597 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa4d2e-fb29-4378-977a-11c28768f7dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:04.148881 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa4d2e-fb29-4378-977a-11c28768f7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:04.149154 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa4d2e-fb29-4378-977a-11c28768f7dc admin admin] PATH_INFO: `/v3/projects/a547240404bd4222a54b835da960303c` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:04.150342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa4d2e-fb29-4378-977a-11c28768f7dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a547240404bd4222a54b835da960303c)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:04.152276 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa4d2e-fb29-4378-977a-11c28768f7dc admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:04.196460 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a4fa4d2e-fb29-4378-977a-11c28768f7dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a547240404bd4222a54b835da960303c', 'request_id': 'req-a4fa4d2e-fb29-4378-977a-11c28768f7dc'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:04.203450 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a4fa4d2e-fb29-4378-977a-11c28768f7dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a547240404bd4222a54b835da960303c', 'request_id': 'req-a4fa4d2e-fb29-4378-977a-11c28768f7dc'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:04.209473 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a4fa4d2e-fb29-4378-977a-11c28768f7dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a547240404bd4222a54b835da960303c', 'request_id': 'req-a4fa4d2e-fb29-4378-977a-11c28768f7dc'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:04.220332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a4fa4d2e-fb29-4378-977a-11c28768f7dc admin admin] The token cache is being invalidate because project a547240404bd4222a54b835da960303c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:25:04.220613 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a4fa4d2e-fb29-4378-977a-11c28768f7dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:04.221231 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a4fa4d2e-fb29-4378-977a-11c28768f7dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:04.222747 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1335/2682] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:25:04 2022] DELETE /identity/v3/projects/a547240404bd4222a54b835da960303c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:04.227745 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93840ec3-73ac-4c7f-ade4-0bc10c20289e None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:04.228070 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93840ec3-73ac-4c7f-ade4-0bc10c20289e None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:04.228349 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93840ec3-73ac-4c7f-ade4-0bc10c20289e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:04.246700 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-93840ec3-73ac-4c7f-ade4-0bc10c20289e None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:25:04.247929 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-93840ec3-73ac-4c7f-ade4-0bc10c20289e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:04.305382 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1348/2683] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:25:04.313103 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c18232-f724-4e09-806f-941ae2d9845b None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:04.313388 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c18232-f724-4e09-806f-941ae2d9845b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:04.313688 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c18232-f724-4e09-806f-941ae2d9845b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:04.339005 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-a2c18232-f724-4e09-806f-941ae2d9845b None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:25:04.340224 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a2c18232-f724-4e09-806f-941ae2d9845b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:04.348375 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1336/2684] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:25:04.362626 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93840ec3-73ac-4c7f-ade4-0bc10c20289e None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:04.365143 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93840ec3-73ac-4c7f-ade4-0bc10c20289e None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:04.369823 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26284290-076b-49c6-89b1-d9517c271693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:04.370450 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26284290-076b-49c6-89b1-d9517c271693 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:04.370860 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26284290-076b-49c6-89b1-d9517c271693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:04.371038 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26284290-076b-49c6-89b1-d9517c271693 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:04.371697 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26284290-076b-49c6-89b1-d9517c271693 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:25:04.372029 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26284290-076b-49c6-89b1-d9517c271693 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:04.373614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26284290-076b-49c6-89b1-d9517c271693 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:04.386062 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1349/2685] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:25:04.390670 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c18232-f724-4e09-806f-941ae2d9845b None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:04.399704 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c18232-f724-4e09-806f-941ae2d9845b None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:04.404783 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0f31d-7e62-4f3f-8292-49c07a4f6ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:04.405433 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0f31d-7e62-4f3f-8292-49c07a4f6ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:04.405851 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0f31d-7e62-4f3f-8292-49c07a4f6ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:04.406118 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0f31d-7e62-4f3f-8292-49c07a4f6ad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:04.406913 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0f31d-7e62-4f3f-8292-49c07a4f6ad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:04.409235 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0f31d-7e62-4f3f-8292-49c07a4f6ad8 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:04.434757 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1337/2686] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:25:04 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:25:04.438984 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26284290-076b-49c6-89b1-d9517c271693 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:04.449220 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26284290-076b-49c6-89b1-d9517c271693 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:04.502807 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3274e-5d0e-4f3e-a522-8fdec15a08c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:04.503451 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3274e-5d0e-4f3e-a522-8fdec15a08c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:04.503730 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3274e-5d0e-4f3e-a522-8fdec15a08c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:04.504025 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3274e-5d0e-4f3e-a522-8fdec15a08c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:04.505317 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3274e-5d0e-4f3e-a522-8fdec15a08c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:04.507298 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3274e-5d0e-4f3e-a522-8fdec15a08c1 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:04.526363 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1350/2687] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:25:04 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:25:04.530457 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0f31d-7e62-4f3f-8292-49c07a4f6ad8 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:04.541031 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0f31d-7e62-4f3f-8292-49c07a4f6ad8 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:04.545587 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24749c9c-85a3-4e23-85be-b7a2308b5a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:04.546230 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24749c9c-85a3-4e23-85be-b7a2308b5a31 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:04.546508 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24749c9c-85a3-4e23-85be-b7a2308b5a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:04.546777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24749c9c-85a3-4e23-85be-b7a2308b5a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:04.547500 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24749c9c-85a3-4e23-85be-b7a2308b5a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:04.549112 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24749c9c-85a3-4e23-85be-b7a2308b5a31 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:04.561078 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1338/2688] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:25:04.565282 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3274e-5d0e-4f3e-a522-8fdec15a08c1 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:04.575909 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3274e-5d0e-4f3e-a522-8fdec15a08c1 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:04.580412 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2eedb3-7790-4fc0-b11f-757dff141daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:04.581048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eedb3-7790-4fc0-b11f-757dff141daf admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:04.581326 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eedb3-7790-4fc0-b11f-757dff141daf admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:04.581596 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eedb3-7790-4fc0-b11f-757dff141daf admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:04.582334 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2eedb3-7790-4fc0-b11f-757dff141daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:04.584194 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2eedb3-7790-4fc0-b11f-757dff141daf admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:04.593677 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1351/2689] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:25:04.598006 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24749c9c-85a3-4e23-85be-b7a2308b5a31 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:04.607993 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24749c9c-85a3-4e23-85be-b7a2308b5a31 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:04.612640 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3e683-dacc-4027-9c77-e3c7169d3c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:04.613591 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3e683-dacc-4027-9c77-e3c7169d3c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:04.613870 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3e683-dacc-4027-9c77-e3c7169d3c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:04.614655 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3e683-dacc-4027-9c77-e3c7169d3c5f admin admin] PATH_INFO: `/v3/projects/1169eb7e6d5d4c95b9f97bb4c5555d97/users/99d236900c8a4b46a1a2c59ac84937cb/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:04.628912 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3e683-dacc-4027-9c77-e3c7169d3c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1169eb7e6d5d4c95b9f97bb4c5555d97, user_id=99d236900c8a4b46a1a2c59ac84937cb, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:04.632392 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3e683-dacc-4027-9c77-e3c7169d3c5f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:04.644717 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1339/2690] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:25:04 2022] PUT /identity/v3/projects/1169eb7e6d5d4c95b9f97bb4c5555d97/users/99d236900c8a4b46a1a2c59ac84937cb/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:04.656068 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258b32c-1c6d-4e9c-b20c-9a751af51eb1 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:04.656356 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258b32c-1c6d-4e9c-b20c-9a751af51eb1 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:04.656631 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258b32c-1c6d-4e9c-b20c-9a751af51eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:04.682963 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-0258b32c-1c6d-4e9c-b20c-9a751af51eb1 None None] MFA Rules not processed for user `99d236900c8a4b46a1a2c59ac84937cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:25:04.684167 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-0258b32c-1c6d-4e9c-b20c-9a751af51eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:04.743788 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1352/2691] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:25:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:25:04.756057 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3e683-dacc-4027-9c77-e3c7169d3c5f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:04.757811 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-35d3e683-dacc-4027-9c77-e3c7169d3c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:04.812631 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3e683-dacc-4027-9c77-e3c7169d3c5f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:04.816267 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd2100-66fa-4b25-81e1-3cb38c38272e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd367d4b48c634351a427f2f1b468d4ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:04.816910 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd2100-66fa-4b25-81e1-3cb38c38272e service glance] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:04.817693 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd2100-66fa-4b25-81e1-3cb38c38272e service glance] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:04.817965 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd2100-66fa-4b25-81e1-3cb38c38272e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:04.825972 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd2100-66fa-4b25-81e1-3cb38c38272e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:04.827385 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd2100-66fa-4b25-81e1-3cb38c38272e service glance] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:04.836376 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1340/2692] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:25:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:25:35.100101 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258b32c-1c6d-4e9c-b20c-9a751af51eb1 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:35.101468 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-0258b32c-1c6d-4e9c-b20c-9a751af51eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:35.155454 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258b32c-1c6d-4e9c-b20c-9a751af51eb1 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:35.158933 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb43d0-f732-419e-80b6-0fd15f59f800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:35.159648 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb43d0-f732-419e-80b6-0fd15f59f800 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:35.159976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb43d0-f732-419e-80b6-0fd15f59f800 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:35.160251 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb43d0-f732-419e-80b6-0fd15f59f800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:35.161945 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d7bb43d0-f732-419e-80b6-0fd15f59f800 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:35.233266 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb43d0-f732-419e-80b6-0fd15f59f800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:35.234690 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb43d0-f732-419e-80b6-0fd15f59f800 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:35.245488 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1353/2693] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:25:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:25:36.429633 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd2100-66fa-4b25-81e1-3cb38c38272e service glance] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:36.431092 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-39cd2100-66fa-4b25-81e1-3cb38c38272e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:36.443428 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd2100-66fa-4b25-81e1-3cb38c38272e service glance] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:36.446971 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194f9af-58d4-4769-8e46-849604942dc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:36.447593 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f9af-58d4-4769-8e46-849604942dc8 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:36.447914 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f9af-58d4-4769-8e46-849604942dc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:36.448191 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f9af-58d4-4769-8e46-849604942dc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:36.450129 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-d194f9af-58d4-4769-8e46-849604942dc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:36.462673 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194f9af-58d4-4769-8e46-849604942dc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:36.464096 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194f9af-58d4-4769-8e46-849604942dc8 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:36.474889 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1341/2694] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:25:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:25:39.650345 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb43d0-f732-419e-80b6-0fd15f59f800 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:39.659327 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb43d0-f732-419e-80b6-0fd15f59f800 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:39.662870 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb30c4-eead-47df-a122-9f3bfec874e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:39.663496 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb30c4-eead-47df-a122-9f3bfec874e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:39.663778 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb30c4-eead-47df-a122-9f3bfec874e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:39.664085 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb30c4-eead-47df-a122-9f3bfec874e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:39.665806 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e0eb30c4-eead-47df-a122-9f3bfec874e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:39.722301 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb30c4-eead-47df-a122-9f3bfec874e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:39.723704 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb30c4-eead-47df-a122-9f3bfec874e0 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:39.732469 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1354/2695] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:25:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:25:41.649931 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194f9af-58d4-4769-8e46-849604942dc8 service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:41.659938 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194f9af-58d4-4769-8e46-849604942dc8 service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:41.663688 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94695be8-ba46-4d4a-9cb5-02d75edd3d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:41.664377 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94695be8-ba46-4d4a-9cb5-02d75edd3d9d service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:41.664663 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94695be8-ba46-4d4a-9cb5-02d75edd3d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:41.664939 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94695be8-ba46-4d4a-9cb5-02d75edd3d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:41.666804 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-94695be8-ba46-4d4a-9cb5-02d75edd3d9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:41.677568 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94695be8-ba46-4d4a-9cb5-02d75edd3d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:41.679038 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94695be8-ba46-4d4a-9cb5-02d75edd3d9d service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:41.688065 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1342/2696] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:25:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:25:43.891390 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb30c4-eead-47df-a122-9f3bfec874e0 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:43.900521 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb30c4-eead-47df-a122-9f3bfec874e0 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:43.904774 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab44261-09f4-40f2-be5d-b1111eafa5da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:43.905651 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab44261-09f4-40f2-be5d-b1111eafa5da service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:43.905924 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab44261-09f4-40f2-be5d-b1111eafa5da service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:43.906369 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab44261-09f4-40f2-be5d-b1111eafa5da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:43.908780 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-eab44261-09f4-40f2-be5d-b1111eafa5da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:43.983707 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab44261-09f4-40f2-be5d-b1111eafa5da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:43.985162 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab44261-09f4-40f2-be5d-b1111eafa5da service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:43.994784 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1355/2697] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:25:45.834411 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94695be8-ba46-4d4a-9cb5-02d75edd3d9d service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:45.843260 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94695be8-ba46-4d4a-9cb5-02d75edd3d9d service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:45.848063 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cfb2d-a536-435f-9185-7a0dafc1d3e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:45.849070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cfb2d-a536-435f-9185-7a0dafc1d3e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:45.849429 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cfb2d-a536-435f-9185-7a0dafc1d3e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:45.849995 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cfb2d-a536-435f-9185-7a0dafc1d3e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:45.851896 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-1f3cfb2d-a536-435f-9185-7a0dafc1d3e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:45.864983 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3cfb2d-a536-435f-9185-7a0dafc1d3e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:45.866445 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3cfb2d-a536-435f-9185-7a0dafc1d3e4 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:45.877643 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1343/2698] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:25:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:25:48.159342 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab44261-09f4-40f2-be5d-b1111eafa5da service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:48.160878 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-eab44261-09f4-40f2-be5d-b1111eafa5da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:48.173369 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab44261-09f4-40f2-be5d-b1111eafa5da service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:48.178372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ff657-31c3-4710-800f-f4de802a1e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:48.179182 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ff657-31c3-4710-800f-f4de802a1e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:48.179464 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ff657-31c3-4710-800f-f4de802a1e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:48.179739 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ff657-31c3-4710-800f-f4de802a1e6f admin admin] PATH_INFO: `/v3/users/d9ec05486d1f427c9dc6ef2fe1fe7469` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:48.181004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ff657-31c3-4710-800f-f4de802a1e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ec05486d1f427c9dc6ef2fe1fe7469)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:48.182914 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ff657-31c3-4710-800f-f4de802a1e6f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:48.229756 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a03ff657-31c3-4710-800f-f4de802a1e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ec05486d1f427c9dc6ef2fe1fe7469'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:48.242293 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a03ff657-31c3-4710-800f-f4de802a1e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ec05486d1f427c9dc6ef2fe1fe7469'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:48.242983 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a03ff657-31c3-4710-800f-f4de802a1e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ec05486d1f427c9dc6ef2fe1fe7469'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:48.250342 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a03ff657-31c3-4710-800f-f4de802a1e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ec05486d1f427c9dc6ef2fe1fe7469'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:48.251009 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a03ff657-31c3-4710-800f-f4de802a1e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ec05486d1f427c9dc6ef2fe1fe7469'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:48.262825 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1356/2699] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:25:48 2022] DELETE /identity/v3/users/d9ec05486d1f427c9dc6ef2fe1fe7469 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:48.419989 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cfb2d-a536-435f-9185-7a0dafc1d3e4 service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:48.429814 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cfb2d-a536-435f-9185-7a0dafc1d3e4 service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:48.494164 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad460f-6126-405f-abaf-3ba78d40b004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:48.495042 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad460f-6126-405f-abaf-3ba78d40b004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:48.495322 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad460f-6126-405f-abaf-3ba78d40b004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:48.495594 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad460f-6126-405f-abaf-3ba78d40b004 admin admin] PATH_INFO: `/v3/users/99d236900c8a4b46a1a2c59ac84937cb` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:48.496887 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad460f-6126-405f-abaf-3ba78d40b004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d236900c8a4b46a1a2c59ac84937cb)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:48.498868 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad460f-6126-405f-abaf-3ba78d40b004 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:48.547093 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-7cad460f-6126-405f-abaf-3ba78d40b004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d236900c8a4b46a1a2c59ac84937cb'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:48.558695 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-7cad460f-6126-405f-abaf-3ba78d40b004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d236900c8a4b46a1a2c59ac84937cb'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:48.559654 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-7cad460f-6126-405f-abaf-3ba78d40b004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d236900c8a4b46a1a2c59ac84937cb'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:48.560357 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-7cad460f-6126-405f-abaf-3ba78d40b004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d236900c8a4b46a1a2c59ac84937cb'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:48.569400 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-7cad460f-6126-405f-abaf-3ba78d40b004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d236900c8a4b46a1a2c59ac84937cb'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:48.582829 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1344/2700] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:25:48 2022] DELETE /identity/v3/users/99d236900c8a4b46a1a2c59ac84937cb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:48.587564 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a608b-2b1e-4b41-b235-ff4345173934 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:48.587972 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a608b-2b1e-4b41-b235-ff4345173934 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:48.588320 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a608b-2b1e-4b41-b235-ff4345173934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:48.607902 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-2a6a608b-2b1e-4b41-b235-ff4345173934 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:25:48.609115 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2a6a608b-2b1e-4b41-b235-ff4345173934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:48.669138 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1357/2701] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:25:48.679069 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad460f-6126-405f-abaf-3ba78d40b004 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:48.680530 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-7cad460f-6126-405f-abaf-3ba78d40b004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:48.739567 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad460f-6126-405f-abaf-3ba78d40b004 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:48.743286 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27eed67-c4bb-4504-b4c2-700cb6a39f0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:48.743975 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27eed67-c4bb-4504-b4c2-700cb6a39f0b service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:48.744262 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27eed67-c4bb-4504-b4c2-700cb6a39f0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:48.744553 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27eed67-c4bb-4504-b4c2-700cb6a39f0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:48.754378 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27eed67-c4bb-4504-b4c2-700cb6a39f0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:48.755880 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27eed67-c4bb-4504-b4c2-700cb6a39f0b service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:48.765873 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1345/2702] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:25:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:25:48.882035 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a608b-2b1e-4b41-b235-ff4345173934 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:48.883593 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-2a6a608b-2b1e-4b41-b235-ff4345173934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:48.897124 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a608b-2b1e-4b41-b235-ff4345173934 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:48.903687 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec730f6-65eb-4f90-ab0f-8950158f001a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:48.904695 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec730f6-65eb-4f90-ab0f-8950158f001a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:48.905070 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec730f6-65eb-4f90-ab0f-8950158f001a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:48.905735 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec730f6-65eb-4f90-ab0f-8950158f001a admin admin] PATH_INFO: `/v3/projects/893cb9e5a3dd4f8cbc746a73b7c03f74` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:48.906801 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec730f6-65eb-4f90-ab0f-8950158f001a admin admin] RBAC: Authorizing `identity:delete_project(project_id=893cb9e5a3dd4f8cbc746a73b7c03f74)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:48.909941 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec730f6-65eb-4f90-ab0f-8950158f001a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:48.974124 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4ec730f6-65eb-4f90-ab0f-8950158f001a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '893cb9e5a3dd4f8cbc746a73b7c03f74', 'request_id': 'req-4ec730f6-65eb-4f90-ab0f-8950158f001a'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:48.979982 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4ec730f6-65eb-4f90-ab0f-8950158f001a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '893cb9e5a3dd4f8cbc746a73b7c03f74', 'request_id': 'req-4ec730f6-65eb-4f90-ab0f-8950158f001a'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:48.989242 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4ec730f6-65eb-4f90-ab0f-8950158f001a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '893cb9e5a3dd4f8cbc746a73b7c03f74', 'request_id': 'req-4ec730f6-65eb-4f90-ab0f-8950158f001a'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:49.012306 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4ec730f6-65eb-4f90-ab0f-8950158f001a admin admin] The token cache is being invalidate because project 893cb9e5a3dd4f8cbc746a73b7c03f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:25:49.012848 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4ec730f6-65eb-4f90-ab0f-8950158f001a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:49.013697 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4ec730f6-65eb-4f90-ab0f-8950158f001a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:49.015744 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1358/2703] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:25:48 2022] DELETE /identity/v3/projects/893cb9e5a3dd4f8cbc746a73b7c03f74 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:49.020364 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274964b-efd6-4305-8484-6243ca089a9b None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:49.020859 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274964b-efd6-4305-8484-6243ca089a9b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:49.021297 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274964b-efd6-4305-8484-6243ca089a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:49.040968 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-b274964b-efd6-4305-8484-6243ca089a9b None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:25:49.042252 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-b274964b-efd6-4305-8484-6243ca089a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:49.084535 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec730f6-65eb-4f90-ab0f-8950158f001a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:49.087917 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-4ec730f6-65eb-4f90-ab0f-8950158f001a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:49.114680 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1346/2704] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:25:49.122334 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e821f-b66f-47a6-96c6-4584bd5a12cb None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:49.122620 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e821f-b66f-47a6-96c6-4584bd5a12cb None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:49.123092 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e821f-b66f-47a6-96c6-4584bd5a12cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:49.166368 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-bb5e821f-b66f-47a6-96c6-4584bd5a12cb None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:25:49.168246 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-bb5e821f-b66f-47a6-96c6-4584bd5a12cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:49.178881 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1347/2705] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:25:49.184500 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e821f-b66f-47a6-96c6-4584bd5a12cb None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:49.191585 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec730f6-65eb-4f90-ab0f-8950158f001a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:49.194932 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e821f-b66f-47a6-96c6-4584bd5a12cb None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:49.196970 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bf4f6-904d-4696-8e7d-be66086fa46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:49.197833 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bf4f6-904d-4696-8e7d-be66086fa46e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:49.198117 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bf4f6-904d-4696-8e7d-be66086fa46e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:49.198395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bf4f6-904d-4696-8e7d-be66086fa46e admin admin] PATH_INFO: `/v3/projects/1169eb7e6d5d4c95b9f97bb4c5555d97` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:49.199639 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428bf4f6-904d-4696-8e7d-be66086fa46e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1169eb7e6d5d4c95b9f97bb4c5555d97)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:49.201632 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9a205-480c-402c-b968-5959deedb9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:49.201794 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428bf4f6-904d-4696-8e7d-be66086fa46e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:49.202641 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9a205-480c-402c-b968-5959deedb9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:49.203116 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9a205-480c-402c-b968-5959deedb9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:49.203559 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9a205-480c-402c-b968-5959deedb9a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:49.205080 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9a205-480c-402c-b968-5959deedb9a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:25:49.205626 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9a205-480c-402c-b968-5959deedb9a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:49.207637 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9a205-480c-402c-b968-5959deedb9a5 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:49.222002 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1348/2706] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:25:49.226046 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9a205-480c-402c-b968-5959deedb9a5 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:49.244514 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9a205-480c-402c-b968-5959deedb9a5 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:49.252383 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0422966-0951-4f8c-8b54-7fea91fae73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:49.253388 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0422966-0951-4f8c-8b54-7fea91fae73a admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:49.253903 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0422966-0951-4f8c-8b54-7fea91fae73a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:49.254376 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0422966-0951-4f8c-8b54-7fea91fae73a admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:49.255280 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0422966-0951-4f8c-8b54-7fea91fae73a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:49.257692 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0422966-0951-4f8c-8b54-7fea91fae73a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:49.267407 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-428bf4f6-904d-4696-8e7d-be66086fa46e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1169eb7e6d5d4c95b9f97bb4c5555d97', 'request_id': 'req-428bf4f6-904d-4696-8e7d-be66086fa46e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:49.273745 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-428bf4f6-904d-4696-8e7d-be66086fa46e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1169eb7e6d5d4c95b9f97bb4c5555d97', 'request_id': 'req-428bf4f6-904d-4696-8e7d-be66086fa46e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:49.280987 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-428bf4f6-904d-4696-8e7d-be66086fa46e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1169eb7e6d5d4c95b9f97bb4c5555d97', 'request_id': 'req-428bf4f6-904d-4696-8e7d-be66086fa46e'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:49.290930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1349/2707] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:25:49 2022] POST /identity/v3/projects => generated 403 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:25:49.295511 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0422966-0951-4f8c-8b54-7fea91fae73a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:49.303297 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-428bf4f6-904d-4696-8e7d-be66086fa46e admin admin] The token cache is being invalidate because project 1169eb7e6d5d4c95b9f97bb4c5555d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:25:49.303588 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-428bf4f6-904d-4696-8e7d-be66086fa46e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:49.305308 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-428bf4f6-904d-4696-8e7d-be66086fa46e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:49.307004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1359/2708] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:25:49 2022] DELETE /identity/v3/projects/1169eb7e6d5d4c95b9f97bb4c5555d97 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:49.312832 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6493e-4856-48f9-a9a1-a57fa4342182 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:49.313311 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6493e-4856-48f9-a9a1-a57fa4342182 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:49.314036 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6493e-4856-48f9-a9a1-a57fa4342182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:49.335751 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-03b6493e-4856-48f9-a9a1-a57fa4342182 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:25:49.337255 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-03b6493e-4856-48f9-a9a1-a57fa4342182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:49.383216 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0422966-0951-4f8c-8b54-7fea91fae73a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:49.390334 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ef58b-bce4-495c-b998-20a1b5c0c05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:49.391852 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ef58b-bce4-495c-b998-20a1b5c0c05d admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:49.392307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ef58b-bce4-495c-b998-20a1b5c0c05d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:49.392748 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ef58b-bce4-495c-b998-20a1b5c0c05d admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:49.393955 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ef58b-bce4-495c-b998-20a1b5c0c05d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:49.397477 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ef58b-bce4-495c-b998-20a1b5c0c05d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:49.402138 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1360/2709] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:25:49.410129 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110630c5-ed7c-487e-b78e-d76d655d3264 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:49.410579 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110630c5-ed7c-487e-b78e-d76d655d3264 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:49.411048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110630c5-ed7c-487e-b78e-d76d655d3264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:49.428703 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1350/2710] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:25:49 2022] POST /identity/v3/users => generated 302 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:25:49.430770 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ef58b-bce4-495c-b998-20a1b5c0c05d admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:49.434177 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-128ef58b-bce4-495c-b998-20a1b5c0c05d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:49.437250 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-110630c5-ed7c-487e-b78e-d76d655d3264 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:25:49.440143 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-110630c5-ed7c-487e-b78e-d76d655d3264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:49.450641 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ef58b-bce4-495c-b998-20a1b5c0c05d admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:49.455306 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1361/2711] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:25:49.456605 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e189c-c779-4cac-a414-102b2fedf97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:49.457273 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e189c-c779-4cac-a414-102b2fedf97f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:49.457716 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e189c-c779-4cac-a414-102b2fedf97f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:49.458431 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e189c-c779-4cac-a414-102b2fedf97f admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:49.459330 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e189c-c779-4cac-a414-102b2fedf97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:49.459843 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110630c5-ed7c-487e-b78e-d76d655d3264 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:49.461301 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e189c-c779-4cac-a414-102b2fedf97f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:49.470091 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110630c5-ed7c-487e-b78e-d76d655d3264 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:49.477825 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce54a7-21a0-4d44-b031-96cbcd68d171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:49.477825 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce54a7-21a0-4d44-b031-96cbcd68d171 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:49.477825 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce54a7-21a0-4d44-b031-96cbcd68d171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:49.477825 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce54a7-21a0-4d44-b031-96cbcd68d171 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:49.478522 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce54a7-21a0-4d44-b031-96cbcd68d171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:25:49.478522 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce54a7-21a0-4d44-b031-96cbcd68d171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:49.479030 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1351/2712] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:25:49.479302 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce54a7-21a0-4d44-b031-96cbcd68d171 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:49.480849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e189c-c779-4cac-a414-102b2fedf97f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:49.494106 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e189c-c779-4cac-a414-102b2fedf97f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:49.499840 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bc46a-d07b-49fb-a06c-bb090f49c827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:49.500338 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1362/2713] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:25:49.501247 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bc46a-d07b-49fb-a06c-bb090f49c827 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:49.501706 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bc46a-d07b-49fb-a06c-bb090f49c827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:49.502139 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bc46a-d07b-49fb-a06c-bb090f49c827 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:49.503184 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bc46a-d07b-49fb-a06c-bb090f49c827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:49.505064 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bc46a-d07b-49fb-a06c-bb090f49c827 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:49.505216 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce54a7-21a0-4d44-b031-96cbcd68d171 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:49.519754 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce54a7-21a0-4d44-b031-96cbcd68d171 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:49.522651 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1352/2714] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:25:49.528508 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bc46a-d07b-49fb-a06c-bb090f49c827 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:49.532597 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004e157-5926-439b-930d-21863f3fd305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:49.533257 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004e157-5926-439b-930d-21863f3fd305 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:49.533536 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004e157-5926-439b-930d-21863f3fd305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:49.533979 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004e157-5926-439b-930d-21863f3fd305 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:49.534688 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004e157-5926-439b-930d-21863f3fd305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:49.537402 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004e157-5926-439b-930d-21863f3fd305 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:49.539111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bc46a-d07b-49fb-a06c-bb090f49c827 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:49.544952 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2662f5e-b72d-461f-9dc6-eafbe3a48267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:49.545832 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2662f5e-b72d-461f-9dc6-eafbe3a48267 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:49.546120 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2662f5e-b72d-461f-9dc6-eafbe3a48267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:49.546396 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2662f5e-b72d-461f-9dc6-eafbe3a48267 admin admin] PATH_INFO: `/v3/projects/bfc77e341c0849ecb676a9275eeb6410/users/791c0422a37b41ee859c3503ee86afba/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:49.563730 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2662f5e-b72d-461f-9dc6-eafbe3a48267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc77e341c0849ecb676a9275eeb6410, user_id=791c0422a37b41ee859c3503ee86afba, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:49.566864 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2662f5e-b72d-461f-9dc6-eafbe3a48267 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:49.587859 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1353/2715] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:25:49 2022] PUT /identity/v3/projects/bfc77e341c0849ecb676a9275eeb6410/users/791c0422a37b41ee859c3503ee86afba/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:49.588072 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1363/2716] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:25:49 2022] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:25:49.592037 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c1524-1a39-4d4c-b6c4-236017ee1e92 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:49.592285 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004e157-5926-439b-930d-21863f3fd305 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:49.592426 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c1524-1a39-4d4c-b6c4-236017ee1e92 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:49.592618 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c1524-1a39-4d4c-b6c4-236017ee1e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:49.611687 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-e47c1524-1a39-4d4c-b6c4-236017ee1e92 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:25:49.612945 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e47c1524-1a39-4d4c-b6c4-236017ee1e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:49.663358 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004e157-5926-439b-930d-21863f3fd305 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:49.669061 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1619b-9984-4d87-af13-e31d509a6ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:49.669790 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1619b-9984-4d87-af13-e31d509a6ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:49.670080 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1619b-9984-4d87-af13-e31d509a6ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:49.670356 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1619b-9984-4d87-af13-e31d509a6ec5 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:49.671063 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1619b-9984-4d87-af13-e31d509a6ec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:49.673169 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1619b-9984-4d87-af13-e31d509a6ec5 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:49.677530 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1354/2717] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:25:49.687743 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c1524-1a39-4d4c-b6c4-236017ee1e92 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:49.689472 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e47c1524-1a39-4d4c-b6c4-236017ee1e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:49.703981 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1364/2718] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:25:49 2022] POST /identity/v3/users => generated 285 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:25:49.707415 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1619b-9984-4d87-af13-e31d509a6ec5 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:49.718575 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1619b-9984-4d87-af13-e31d509a6ec5 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:49.723629 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c59134-9aec-4650-8693-f335f69be5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:49.724568 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c59134-9aec-4650-8693-f335f69be5df admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:49.724709 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c59134-9aec-4650-8693-f335f69be5df admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:49.724880 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c59134-9aec-4650-8693-f335f69be5df admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:49.725787 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c59134-9aec-4650-8693-f335f69be5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:49.727804 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c59134-9aec-4650-8693-f335f69be5df admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:49.741887 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1365/2719] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:25:49.742988 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c59134-9aec-4650-8693-f335f69be5df admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:49.753031 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c59134-9aec-4650-8693-f335f69be5df admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:49.755344 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c1524-1a39-4d4c-b6c4-236017ee1e92 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:49.758235 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8cf3ad-2984-4bd1-b640-af2a2aa14c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:49.759294 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cf3ad-2984-4bd1-b640-af2a2aa14c40 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:49.759437 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722280f8-52d7-4ae9-b507-5790c951e705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:49.759551 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cf3ad-2984-4bd1-b640-af2a2aa14c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:49.760543 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cf3ad-2984-4bd1-b640-af2a2aa14c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:49.760700 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722280f8-52d7-4ae9-b507-5790c951e705 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:49.760700 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722280f8-52d7-4ae9-b507-5790c951e705 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:49.760891 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8cf3ad-2984-4bd1-b640-af2a2aa14c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:49.760984 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722280f8-52d7-4ae9-b507-5790c951e705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:49.762434 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8cf3ad-2984-4bd1-b640-af2a2aa14c40 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:49.772532 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722280f8-52d7-4ae9-b507-5790c951e705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:49.774038 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722280f8-52d7-4ae9-b507-5790c951e705 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:49.780067 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1366/2720] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:25:49.781958 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8cf3ad-2984-4bd1-b640-af2a2aa14c40 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:49.788782 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1355/2721] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:25:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:25:49.792200 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8cf3ad-2984-4bd1-b640-af2a2aa14c40 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:49.798008 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c9567-0d50-45c1-9fb9-8eec66bd5182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:49.799011 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c9567-0d50-45c1-9fb9-8eec66bd5182 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:49.799397 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c9567-0d50-45c1-9fb9-8eec66bd5182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:49.799771 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c9567-0d50-45c1-9fb9-8eec66bd5182 admin admin] PATH_INFO: `/v3/projects/440d37fec8174e18b796f1306643f4b1/users/97f8169ea0294e07ac66bb63c3779f36/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:49.837158 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c9567-0d50-45c1-9fb9-8eec66bd5182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=440d37fec8174e18b796f1306643f4b1, user_id=97f8169ea0294e07ac66bb63c3779f36, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:49.841972 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c9567-0d50-45c1-9fb9-8eec66bd5182 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:49.867890 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1367/2722] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:25:49 2022] PUT /identity/v3/projects/440d37fec8174e18b796f1306643f4b1/users/97f8169ea0294e07ac66bb63c3779f36/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:25:49.879287 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e55e8b-cc27-4297-90ac-2738d53bb48d None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:49.879711 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e55e8b-cc27-4297-90ac-2738d53bb48d None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:49.880131 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e55e8b-cc27-4297-90ac-2738d53bb48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:49.923192 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-83e55e8b-cc27-4297-90ac-2738d53bb48d None None] MFA Rules not processed for user `97f8169ea0294e07ac66bb63c3779f36`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:25:49.924603 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-83e55e8b-cc27-4297-90ac-2738d53bb48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:50.010929 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1356/2723] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:25:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:25:50.021189 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c9567-0d50-45c1-9fb9-8eec66bd5182 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:50.023074 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a58c9567-0d50-45c1-9fb9-8eec66bd5182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:50.110159 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c9567-0d50-45c1-9fb9-8eec66bd5182 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:50.114387 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0eeca2-db2e-495e-99a7-be4aa4861fa3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd367d4b48c634351a427f2f1b468d4ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:50.115043 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eeca2-db2e-495e-99a7-be4aa4861fa3 service glance] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:50.115323 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eeca2-db2e-495e-99a7-be4aa4861fa3 service glance] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:50.115602 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eeca2-db2e-495e-99a7-be4aa4861fa3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:50.127253 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0eeca2-db2e-495e-99a7-be4aa4861fa3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:50.128793 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0eeca2-db2e-495e-99a7-be4aa4861fa3 service glance] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:50.140707 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1368/2724] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:25:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:25:50.678567 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d31126-2ffd-4c89-882a-f7bfaf0259a5 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:50.681184 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d31126-2ffd-4c89-882a-f7bfaf0259a5 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:50.681524 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d31126-2ffd-4c89-882a-f7bfaf0259a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:50.743965 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-17d31126-2ffd-4c89-882a-f7bfaf0259a5 None None] MFA Rules not processed for user `791c0422a37b41ee859c3503ee86afba`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:25:50.745285 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-17d31126-2ffd-4c89-882a-f7bfaf0259a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:50.914188 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1357/2725] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:25:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:25:50.919793 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0eeca2-db2e-495e-99a7-be4aa4861fa3 service glance] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:51.001762 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0eeca2-db2e-495e-99a7-be4aa4861fa3 service glance] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:51.006568 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0c4df-e270-4114-8240-4dfdb1485eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:51.007393 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0c4df-e270-4114-8240-4dfdb1485eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:51.007876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0c4df-e270-4114-8240-4dfdb1485eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:51.008163 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0c4df-e270-4114-8240-4dfdb1485eb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:51.008889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0c4df-e270-4114-8240-4dfdb1485eb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:51.010942 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0c4df-e270-4114-8240-4dfdb1485eb0 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:51.044614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1369/2726] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:25:50 2022] POST /identity/v3/projects => generated 403 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:25:51.045790 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d31126-2ffd-4c89-882a-f7bfaf0259a5 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:51.057161 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d31126-2ffd-4c89-882a-f7bfaf0259a5 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:51.119391 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ee8ad-de71-46e0-a5cb-0bb6da042de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:51.120129 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ee8ad-de71-46e0-a5cb-0bb6da042de9 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:51.120415 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ee8ad-de71-46e0-a5cb-0bb6da042de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:51.120724 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ee8ad-de71-46e0-a5cb-0bb6da042de9 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:51.121716 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ee8ad-de71-46e0-a5cb-0bb6da042de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:51.123602 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ee8ad-de71-46e0-a5cb-0bb6da042de9 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:51.151103 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1358/2727] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:25:51 2022] POST /identity/v3/users => generated 308 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:25:51.152868 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0c4df-e270-4114-8240-4dfdb1485eb0 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:51.163976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0c4df-e270-4114-8240-4dfdb1485eb0 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:51.169438 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45a026-da4e-4d5c-878a-a0c48a0bcc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:51.170106 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45a026-da4e-4d5c-878a-a0c48a0bcc71 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:51.170393 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45a026-da4e-4d5c-878a-a0c48a0bcc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:51.170672 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45a026-da4e-4d5c-878a-a0c48a0bcc71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:51.171473 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45a026-da4e-4d5c-878a-a0c48a0bcc71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:51.173169 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45a026-da4e-4d5c-878a-a0c48a0bcc71 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:51.184010 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1370/2728] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:25:51.188449 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ee8ad-de71-46e0-a5cb-0bb6da042de9 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:51.198509 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ee8ad-de71-46e0-a5cb-0bb6da042de9 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:51.203761 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfafb9-6ca7-48f3-8e6c-a1e469c1dd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:51.204634 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfafb9-6ca7-48f3-8e6c-a1e469c1dd8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:51.204923 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfafb9-6ca7-48f3-8e6c-a1e469c1dd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:51.205202 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfafb9-6ca7-48f3-8e6c-a1e469c1dd8b admin admin] PATH_INFO: `/v3/projects/b35a2bf9c7984e559df5dff62d9c408e/users/d0beff08d0e94cf988c0abf14ffb3aa0/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:51.222948 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfafb9-6ca7-48f3-8e6c-a1e469c1dd8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35a2bf9c7984e559df5dff62d9c408e, user_id=d0beff08d0e94cf988c0abf14ffb3aa0, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:51.225683 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfafb9-6ca7-48f3-8e6c-a1e469c1dd8b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:51.247974 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1359/2729] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:25:51 2022] PUT /identity/v3/projects/b35a2bf9c7984e559df5dff62d9c408e/users/d0beff08d0e94cf988c0abf14ffb3aa0/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:51.252651 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45a026-da4e-4d5c-878a-a0c48a0bcc71 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:51.264169 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45a026-da4e-4d5c-878a-a0c48a0bcc71 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:51.327071 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d713238-f1a4-4bfe-a828-d0745d372c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:51.327741 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d713238-f1a4-4bfe-a828-d0745d372c78 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:51.328078 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d713238-f1a4-4bfe-a828-d0745d372c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:51.328346 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d713238-f1a4-4bfe-a828-d0745d372c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:51.329091 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d713238-f1a4-4bfe-a828-d0745d372c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:51.330731 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d713238-f1a4-4bfe-a828-d0745d372c78 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:51.346023 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1371/2730] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:25:51.347330 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfafb9-6ca7-48f3-8e6c-a1e469c1dd8b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:51.358368 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfafb9-6ca7-48f3-8e6c-a1e469c1dd8b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:51.363037 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdfe23-e4eb-4aca-bb7e-246150c88ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:51.363956 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdfe23-e4eb-4aca-bb7e-246150c88ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:51.364245 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdfe23-e4eb-4aca-bb7e-246150c88ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:51.364522 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdfe23-e4eb-4aca-bb7e-246150c88ac2 admin admin] PATH_INFO: `/v3/projects/b35a2bf9c7984e559df5dff62d9c408e/users/d0beff08d0e94cf988c0abf14ffb3aa0/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:51.366474 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdfe23-e4eb-4aca-bb7e-246150c88ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35a2bf9c7984e559df5dff62d9c408e, user_id=d0beff08d0e94cf988c0abf14ffb3aa0, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:51.369297 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdfe23-e4eb-4aca-bb7e-246150c88ac2 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:51.385859 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1360/2731] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:25:51 2022] PUT /identity/v3/projects/b35a2bf9c7984e559df5dff62d9c408e/users/d0beff08d0e94cf988c0abf14ffb3aa0/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:52.077256 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef2657-8cd6-4a66-98a9-7e4a3b11a73a None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:52.078333 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef2657-8cd6-4a66-98a9-7e4a3b11a73a None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:52.078828 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef2657-8cd6-4a66-98a9-7e4a3b11a73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:52.115047 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-d3ef2657-8cd6-4a66-98a9-7e4a3b11a73a None None] MFA Rules not processed for user `d0beff08d0e94cf988c0abf14ffb3aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:25:52.116774 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d3ef2657-8cd6-4a66-98a9-7e4a3b11a73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:52.199617 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1372/2732] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:25:52 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:25:53.521065 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdfe23-e4eb-4aca-bb7e-246150c88ac2 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:53.617133 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdfe23-e4eb-4aca-bb7e-246150c88ac2 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:53.626219 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9564b-f026-42cc-9903-af7697bd7fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:53.627530 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9564b-f026-42cc-9903-af7697bd7fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:53.628003 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9564b-f026-42cc-9903-af7697bd7fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:53.628454 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9564b-f026-42cc-9903-af7697bd7fd2 admin admin] PATH_INFO: `/v3/users/791c0422a37b41ee859c3503ee86afba` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:53.630112 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9564b-f026-42cc-9903-af7697bd7fd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=791c0422a37b41ee859c3503ee86afba)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:53.632362 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9564b-f026-42cc-9903-af7697bd7fd2 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:53.689409 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-62b9564b-f026-42cc-9903-af7697bd7fd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '791c0422a37b41ee859c3503ee86afba'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:53.704267 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-62b9564b-f026-42cc-9903-af7697bd7fd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '791c0422a37b41ee859c3503ee86afba'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:53.705398 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-62b9564b-f026-42cc-9903-af7697bd7fd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '791c0422a37b41ee859c3503ee86afba'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:53.706366 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-62b9564b-f026-42cc-9903-af7697bd7fd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '791c0422a37b41ee859c3503ee86afba'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:53.716438 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-62b9564b-f026-42cc-9903-af7697bd7fd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '791c0422a37b41ee859c3503ee86afba'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:53.733039 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1361/2733] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:25:53 2022] DELETE /identity/v3/users/791c0422a37b41ee859c3503ee86afba => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:25:53.924845 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef2657-8cd6-4a66-98a9-7e4a3b11a73a None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:53.944520 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef2657-8cd6-4a66-98a9-7e4a3b11a73a None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:54.019191 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a30043-4f4e-4a64-b48a-ce232c2e491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:54.020091 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a30043-4f4e-4a64-b48a-ce232c2e491c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:54.020381 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a30043-4f4e-4a64-b48a-ce232c2e491c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:54.020659 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a30043-4f4e-4a64-b48a-ce232c2e491c admin admin] PATH_INFO: `/v3/projects/bfc77e341c0849ecb676a9275eeb6410` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:54.021877 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a30043-4f4e-4a64-b48a-ce232c2e491c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfc77e341c0849ecb676a9275eeb6410)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:54.023799 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a30043-4f4e-4a64-b48a-ce232c2e491c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:54.073048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-57a30043-4f4e-4a64-b48a-ce232c2e491c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfc77e341c0849ecb676a9275eeb6410', 'request_id': 'req-57a30043-4f4e-4a64-b48a-ce232c2e491c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:54.078647 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-57a30043-4f4e-4a64-b48a-ce232c2e491c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfc77e341c0849ecb676a9275eeb6410', 'request_id': 'req-57a30043-4f4e-4a64-b48a-ce232c2e491c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:54.085153 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-57a30043-4f4e-4a64-b48a-ce232c2e491c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfc77e341c0849ecb676a9275eeb6410', 'request_id': 'req-57a30043-4f4e-4a64-b48a-ce232c2e491c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:54.101888 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-57a30043-4f4e-4a64-b48a-ce232c2e491c admin admin] The token cache is being invalidate because project bfc77e341c0849ecb676a9275eeb6410 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:25:54.102176 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-57a30043-4f4e-4a64-b48a-ce232c2e491c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:54.102797 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-57a30043-4f4e-4a64-b48a-ce232c2e491c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:54.104454 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1373/2734] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:25:53 2022] DELETE /identity/v3/projects/bfc77e341c0849ecb676a9275eeb6410 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:54.109034 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9564b-f026-42cc-9903-af7697bd7fd2 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:54.110404 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-62b9564b-f026-42cc-9903-af7697bd7fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:54.123588 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9564b-f026-42cc-9903-af7697bd7fd2 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:54.192168 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef470a81-9d3f-4e50-bf37-3c7f21b344fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:54.193065 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef470a81-9d3f-4e50-bf37-3c7f21b344fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:54.193350 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef470a81-9d3f-4e50-bf37-3c7f21b344fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:54.193630 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef470a81-9d3f-4e50-bf37-3c7f21b344fb admin admin] PATH_INFO: `/v3/users/d0beff08d0e94cf988c0abf14ffb3aa0` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:54.194865 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef470a81-9d3f-4e50-bf37-3c7f21b344fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0beff08d0e94cf988c0abf14ffb3aa0)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:54.196855 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef470a81-9d3f-4e50-bf37-3c7f21b344fb admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:54.255395 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ef470a81-9d3f-4e50-bf37-3c7f21b344fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0beff08d0e94cf988c0abf14ffb3aa0'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:54.267530 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ef470a81-9d3f-4e50-bf37-3c7f21b344fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0beff08d0e94cf988c0abf14ffb3aa0'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:54.268186 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ef470a81-9d3f-4e50-bf37-3c7f21b344fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0beff08d0e94cf988c0abf14ffb3aa0'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:54.268803 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ef470a81-9d3f-4e50-bf37-3c7f21b344fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0beff08d0e94cf988c0abf14ffb3aa0'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:54.276912 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ef470a81-9d3f-4e50-bf37-3c7f21b344fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0beff08d0e94cf988c0abf14ffb3aa0'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:54.290931 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1362/2735] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:25:54 2022] DELETE /identity/v3/users/d0beff08d0e94cf988c0abf14ffb3aa0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:54.507415 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a30043-4f4e-4a64-b48a-ce232c2e491c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:54.509372 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-57a30043-4f4e-4a64-b48a-ce232c2e491c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:54.530382 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a30043-4f4e-4a64-b48a-ce232c2e491c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:54.594138 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80219cee-7ba5-46e6-bd08-5517b68ba5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:54.595324 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80219cee-7ba5-46e6-bd08-5517b68ba5ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:54.596075 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80219cee-7ba5-46e6-bd08-5517b68ba5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:54.596489 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80219cee-7ba5-46e6-bd08-5517b68ba5ab admin admin] PATH_INFO: `/v3/projects/b35a2bf9c7984e559df5dff62d9c408e` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:54.598010 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80219cee-7ba5-46e6-bd08-5517b68ba5ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b35a2bf9c7984e559df5dff62d9c408e)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:54.600193 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80219cee-7ba5-46e6-bd08-5517b68ba5ab admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:54.657186 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-80219cee-7ba5-46e6-bd08-5517b68ba5ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b35a2bf9c7984e559df5dff62d9c408e', 'request_id': 'req-80219cee-7ba5-46e6-bd08-5517b68ba5ab'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:54.668995 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-80219cee-7ba5-46e6-bd08-5517b68ba5ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b35a2bf9c7984e559df5dff62d9c408e', 'request_id': 'req-80219cee-7ba5-46e6-bd08-5517b68ba5ab'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:54.677516 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-80219cee-7ba5-46e6-bd08-5517b68ba5ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b35a2bf9c7984e559df5dff62d9c408e', 'request_id': 'req-80219cee-7ba5-46e6-bd08-5517b68ba5ab'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:54.709495 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-80219cee-7ba5-46e6-bd08-5517b68ba5ab admin admin] The token cache is being invalidate because project b35a2bf9c7984e559df5dff62d9c408e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:25:54.710392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-80219cee-7ba5-46e6-bd08-5517b68ba5ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:54.711465 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-80219cee-7ba5-46e6-bd08-5517b68ba5ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:54.718428 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1374/2736] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:25:54 2022] DELETE /identity/v3/projects/b35a2bf9c7984e559df5dff62d9c408e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:54.719631 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e1204-a0cf-4e9d-96f5-f653a6171f91 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:54.720295 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e1204-a0cf-4e9d-96f5-f653a6171f91 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:54.720295 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e1204-a0cf-4e9d-96f5-f653a6171f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:54.752690 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-1b8e1204-a0cf-4e9d-96f5-f653a6171f91 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:25:54.754024 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-1b8e1204-a0cf-4e9d-96f5-f653a6171f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:54.839161 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1363/2737] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:25:54.842376 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee27930-5753-4808-ac47-1f69e66004a2 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:54.842376 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee27930-5753-4808-ac47-1f69e66004a2 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:54.842376 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee27930-5753-4808-ac47-1f69e66004a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:54.864069 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-6ee27930-5753-4808-ac47-1f69e66004a2 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:25:54.865289 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-6ee27930-5753-4808-ac47-1f69e66004a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:54.874857 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1375/2738] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:25:54.879106 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e1204-a0cf-4e9d-96f5-f653a6171f91 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:54.890286 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e1204-a0cf-4e9d-96f5-f653a6171f91 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:54.895508 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8081c-f7fc-47f1-bdea-f58e2d8cf817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:54.896433 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8081c-f7fc-47f1-bdea-f58e2d8cf817 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:54.896993 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8081c-f7fc-47f1-bdea-f58e2d8cf817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:54.897250 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8081c-f7fc-47f1-bdea-f58e2d8cf817 admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:54.898531 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8081c-f7fc-47f1-bdea-f58e2d8cf817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:25:54.899026 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8081c-f7fc-47f1-bdea-f58e2d8cf817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:54.900852 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8081c-f7fc-47f1-bdea-f58e2d8cf817 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:54.915758 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee27930-5753-4808-ac47-1f69e66004a2 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:54.917542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-6ee27930-5753-4808-ac47-1f69e66004a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:54.920412 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1364/2739] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:25:54.924854 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8081c-f7fc-47f1-bdea-f58e2d8cf817 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:54.934770 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee27930-5753-4808-ac47-1f69e66004a2 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:54.939799 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8081c-f7fc-47f1-bdea-f58e2d8cf817 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:54.941080 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30bbd1-7fb9-454a-9915-94c0922ea87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:54.941954 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30bbd1-7fb9-454a-9915-94c0922ea87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:54.942241 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30bbd1-7fb9-454a-9915-94c0922ea87f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:54.942572 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30bbd1-7fb9-454a-9915-94c0922ea87f admin admin] PATH_INFO: `/v3/users/8493ae655d1a4859b8fdae636db2dde4` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:54.943871 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30bbd1-7fb9-454a-9915-94c0922ea87f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8493ae655d1a4859b8fdae636db2dde4)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:54.946071 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30bbd1-7fb9-454a-9915-94c0922ea87f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:54.946515 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda44ac-d5ca-4dea-af64-2e0d3e778188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:54.947326 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda44ac-d5ca-4dea-af64-2e0d3e778188 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:54.947742 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda44ac-d5ca-4dea-af64-2e0d3e778188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:54.948213 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda44ac-d5ca-4dea-af64-2e0d3e778188 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:54.951902 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda44ac-d5ca-4dea-af64-2e0d3e778188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:54.954146 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda44ac-d5ca-4dea-af64-2e0d3e778188 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:54.983588 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1365/2740] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:25:54 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:25:54.987721 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda44ac-d5ca-4dea-af64-2e0d3e778188 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:55.000253 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4f30bbd1-7fb9-454a-9915-94c0922ea87f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8493ae655d1a4859b8fdae636db2dde4'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:55.012514 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4f30bbd1-7fb9-454a-9915-94c0922ea87f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8493ae655d1a4859b8fdae636db2dde4'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:55.013224 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4f30bbd1-7fb9-454a-9915-94c0922ea87f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8493ae655d1a4859b8fdae636db2dde4'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:55.020727 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4f30bbd1-7fb9-454a-9915-94c0922ea87f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8493ae655d1a4859b8fdae636db2dde4'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:55.021361 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4f30bbd1-7fb9-454a-9915-94c0922ea87f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8493ae655d1a4859b8fdae636db2dde4'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:55.039071 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1376/2741] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:25:54 2022] DELETE /identity/v3/users/8493ae655d1a4859b8fdae636db2dde4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:55.053172 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda44ac-d5ca-4dea-af64-2e0d3e778188 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:55.127085 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45ac76-0682-4692-a150-281380f00f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:55.127796 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45ac76-0682-4692-a150-281380f00f37 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:55.128117 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45ac76-0682-4692-a150-281380f00f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:55.128389 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45ac76-0682-4692-a150-281380f00f37 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:55.129093 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45ac76-0682-4692-a150-281380f00f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:55.130999 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45ac76-0682-4692-a150-281380f00f37 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:55.151367 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1366/2742] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:25:54 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:25:55.155953 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30bbd1-7fb9-454a-9915-94c0922ea87f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:55.157329 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-4f30bbd1-7fb9-454a-9915-94c0922ea87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:55.170662 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30bbd1-7fb9-454a-9915-94c0922ea87f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:55.175374 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028fc12-2672-4414-b11a-2969a4f70be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:55.176081 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028fc12-2672-4414-b11a-2969a4f70be9 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:55.176367 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028fc12-2672-4414-b11a-2969a4f70be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:55.176642 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028fc12-2672-4414-b11a-2969a4f70be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:55.177390 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028fc12-2672-4414-b11a-2969a4f70be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:55.178975 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028fc12-2672-4414-b11a-2969a4f70be9 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:55.189805 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1377/2743] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:25:55.193877 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45ac76-0682-4692-a150-281380f00f37 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:55.206088 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45ac76-0682-4692-a150-281380f00f37 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:55.212195 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe6440-f678-4e6a-9733-097363fc5d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:55.212875 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6440-f678-4e6a-9733-097363fc5d9a admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:55.213223 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6440-f678-4e6a-9733-097363fc5d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:55.213839 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6440-f678-4e6a-9733-097363fc5d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:55.215362 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe6440-f678-4e6a-9733-097363fc5d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:55.217575 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe6440-f678-4e6a-9733-097363fc5d9a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:55.228933 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028fc12-2672-4414-b11a-2969a4f70be9 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:55.229372 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1367/2744] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:25:55.234449 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a028fc12-2672-4414-b11a-2969a4f70be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:55.235756 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe6440-f678-4e6a-9733-097363fc5d9a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:55.247194 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe6440-f678-4e6a-9733-097363fc5d9a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:55.252186 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67ac29-5051-4233-942e-fae98fac9d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:55.253243 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67ac29-5051-4233-942e-fae98fac9d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:55.253618 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67ac29-5051-4233-942e-fae98fac9d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:55.253996 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67ac29-5051-4233-942e-fae98fac9d34 admin admin] PATH_INFO: `/v3/projects/d9f8cbfedc624201aa80231b6917d76d/users/3548a3788c9a4bb199198604ee8b69da/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:55.254195 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028fc12-2672-4414-b11a-2969a4f70be9 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:55.260096 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f80b7-607e-4029-ac4c-96766758ff4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:55.261078 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f80b7-607e-4029-ac4c-96766758ff4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:55.262141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f80b7-607e-4029-ac4c-96766758ff4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:55.262427 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f80b7-607e-4029-ac4c-96766758ff4f admin admin] PATH_INFO: `/v3/projects/8112af212c7944688c5d2b566cd01406` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:55.263856 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f80b7-607e-4029-ac4c-96766758ff4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8112af212c7944688c5d2b566cd01406)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:55.266744 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f80b7-607e-4029-ac4c-96766758ff4f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:55.273923 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67ac29-5051-4233-942e-fae98fac9d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f8cbfedc624201aa80231b6917d76d, user_id=3548a3788c9a4bb199198604ee8b69da, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:55.276618 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67ac29-5051-4233-942e-fae98fac9d34 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:55.290878 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1368/2745] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:25:55 2022] PUT /identity/v3/projects/d9f8cbfedc624201aa80231b6917d76d/users/3548a3788c9a4bb199198604ee8b69da/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:55.302578 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a45eb-54c1-4067-a6c7-cbde34730979 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:55.302860 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a45eb-54c1-4067-a6c7-cbde34730979 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:55.303134 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a45eb-54c1-4067-a6c7-cbde34730979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:55.323656 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-635f80b7-607e-4029-ac4c-96766758ff4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8112af212c7944688c5d2b566cd01406', 'request_id': 'req-635f80b7-607e-4029-ac4c-96766758ff4f'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:55.329617 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-635f80b7-607e-4029-ac4c-96766758ff4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8112af212c7944688c5d2b566cd01406', 'request_id': 'req-635f80b7-607e-4029-ac4c-96766758ff4f'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:55.331512 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-e87a45eb-54c1-4067-a6c7-cbde34730979 None None] MFA Rules not processed for user `3548a3788c9a4bb199198604ee8b69da`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:25:55.332757 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e87a45eb-54c1-4067-a6c7-cbde34730979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:55.336541 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-635f80b7-607e-4029-ac4c-96766758ff4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8112af212c7944688c5d2b566cd01406', 'request_id': 'req-635f80b7-607e-4029-ac4c-96766758ff4f'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:55.349522 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-635f80b7-607e-4029-ac4c-96766758ff4f admin admin] The token cache is being invalidate because project 8112af212c7944688c5d2b566cd01406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:25:55.349812 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-635f80b7-607e-4029-ac4c-96766758ff4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:55.350448 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-635f80b7-607e-4029-ac4c-96766758ff4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:55.352310 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1378/2746] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:25:55 2022] DELETE /identity/v3/projects/8112af212c7944688c5d2b566cd01406 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:55.355995 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f80b7-607e-4029-ac4c-96766758ff4f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:55.357453 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-635f80b7-607e-4029-ac4c-96766758ff4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:55.408482 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1369/2747] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:25:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:25:55.413073 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a45eb-54c1-4067-a6c7-cbde34730979 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:55.414689 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e87a45eb-54c1-4067-a6c7-cbde34730979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:55.423859 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f80b7-607e-4029-ac4c-96766758ff4f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:55.429490 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e52d2-ef58-4243-96ff-9c579b407c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:55.430365 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e52d2-ef58-4243-96ff-9c579b407c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:55.430640 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e52d2-ef58-4243-96ff-9c579b407c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:55.430833 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a45eb-54c1-4067-a6c7-cbde34730979 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:55.430948 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e52d2-ef58-4243-96ff-9c579b407c82 admin admin] PATH_INFO: `/v3/users/fcbfa7c4a45c40bdbb53011e31f694a9` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:55.432156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e52d2-ef58-4243-96ff-9c579b407c82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcbfa7c4a45c40bdbb53011e31f694a9)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:55.434177 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e52d2-ef58-4243-96ff-9c579b407c82 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:55.437174 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744c9c6-0460-40f8-aca0-7a93988c3946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:55.438065 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744c9c6-0460-40f8-aca0-7a93988c3946 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:55.438349 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744c9c6-0460-40f8-aca0-7a93988c3946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:55.438629 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744c9c6-0460-40f8-aca0-7a93988c3946 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:55.439338 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744c9c6-0460-40f8-aca0-7a93988c3946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:55.441257 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744c9c6-0460-40f8-aca0-7a93988c3946 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:55.470451 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1370/2748] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:25:55 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:25:55.475330 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744c9c6-0460-40f8-aca0-7a93988c3946 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:55.482298 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ed8e52d2-ef58-4243-96ff-9c579b407c82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcbfa7c4a45c40bdbb53011e31f694a9'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:55.493852 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ed8e52d2-ef58-4243-96ff-9c579b407c82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcbfa7c4a45c40bdbb53011e31f694a9'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:55.494530 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ed8e52d2-ef58-4243-96ff-9c579b407c82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcbfa7c4a45c40bdbb53011e31f694a9'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:55.502728 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ed8e52d2-ef58-4243-96ff-9c579b407c82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcbfa7c4a45c40bdbb53011e31f694a9'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:55.503445 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ed8e52d2-ef58-4243-96ff-9c579b407c82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcbfa7c4a45c40bdbb53011e31f694a9'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:55.517654 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1379/2749] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:25:55 2022] DELETE /identity/v3/users/fcbfa7c4a45c40bdbb53011e31f694a9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:25:55.544540 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744c9c6-0460-40f8-aca0-7a93988c3946 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:55.618019 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8587d-bd4f-47ff-af63-f6d1a1dc6a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:55.618719 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8587d-bd4f-47ff-af63-f6d1a1dc6a8c admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:55.619003 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8587d-bd4f-47ff-af63-f6d1a1dc6a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:55.619286 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8587d-bd4f-47ff-af63-f6d1a1dc6a8c admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:55.620017 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8587d-bd4f-47ff-af63-f6d1a1dc6a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:55.622741 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8587d-bd4f-47ff-af63-f6d1a1dc6a8c admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:55.644502 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1371/2750] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:25:55 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:25:55.648529 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e52d2-ef58-4243-96ff-9c579b407c82 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:55.650291 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-ed8e52d2-ef58-4243-96ff-9c579b407c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:55.666107 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e52d2-ef58-4243-96ff-9c579b407c82 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:55.670698 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf84af4-9395-424d-a42a-6c9b1305d30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:55.671362 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf84af4-9395-424d-a42a-6c9b1305d30f admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:55.671643 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf84af4-9395-424d-a42a-6c9b1305d30f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:55.671943 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf84af4-9395-424d-a42a-6c9b1305d30f admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:55.672713 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf84af4-9395-424d-a42a-6c9b1305d30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:55.674295 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf84af4-9395-424d-a42a-6c9b1305d30f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:55.688671 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1380/2751] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:25:55.689303 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8587d-bd4f-47ff-af63-f6d1a1dc6a8c admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:55.700892 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8587d-bd4f-47ff-af63-f6d1a1dc6a8c admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:55.710818 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08451731-353b-46ef-b4d0-06beadd20ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:55.712069 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08451731-353b-46ef-b4d0-06beadd20ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:55.712507 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08451731-353b-46ef-b4d0-06beadd20ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:55.712975 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08451731-353b-46ef-b4d0-06beadd20ef4 admin admin] PATH_INFO: `/v3/projects/53f48303760944db9f3229c124a0a296/users/f57c239c6e444155ba1d54324945135d/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:55.731308 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf84af4-9395-424d-a42a-6c9b1305d30f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:55.731991 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08451731-353b-46ef-b4d0-06beadd20ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f48303760944db9f3229c124a0a296, user_id=f57c239c6e444155ba1d54324945135d, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:55.733222 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-bcf84af4-9395-424d-a42a-6c9b1305d30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:55.734685 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08451731-353b-46ef-b4d0-06beadd20ef4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:55.751368 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf84af4-9395-424d-a42a-6c9b1305d30f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:55.753239 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1372/2752] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:25:55 2022] PUT /identity/v3/projects/53f48303760944db9f3229c124a0a296/users/f57c239c6e444155ba1d54324945135d/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:25:55.757141 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08451731-353b-46ef-b4d0-06beadd20ef4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:55.820719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a52d7-e3ea-4d8d-af48-df5c19d5d8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:55.821500 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a52d7-e3ea-4d8d-af48-df5c19d5d8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:55.821776 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a52d7-e3ea-4d8d-af48-df5c19d5d8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:55.821888 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08451731-353b-46ef-b4d0-06beadd20ef4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:55.822051 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a52d7-e3ea-4d8d-af48-df5c19d5d8d5 admin admin] PATH_INFO: `/v3/projects/9deb71cc68ef4e24bc7d1dd36ed76d8b` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:55.823248 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a52d7-e3ea-4d8d-af48-df5c19d5d8d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9deb71cc68ef4e24bc7d1dd36ed76d8b)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:55.825193 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a52d7-e3ea-4d8d-af48-df5c19d5d8d5 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:55.826986 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1f7e3-a1bd-4e58-98b5-f875e9787e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:55.827672 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1f7e3-a1bd-4e58-98b5-f875e9787e0b admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:55.828010 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1f7e3-a1bd-4e58-98b5-f875e9787e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:55.828286 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1f7e3-a1bd-4e58-98b5-f875e9787e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:55.829015 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1f7e3-a1bd-4e58-98b5-f875e9787e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:55.830621 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1f7e3-a1bd-4e58-98b5-f875e9787e0b admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:55.847975 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1373/2753] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:25:55.849111 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1f7e3-a1bd-4e58-98b5-f875e9787e0b admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:55.859987 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1f7e3-a1bd-4e58-98b5-f875e9787e0b admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:55.873235 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-687a52d7-e3ea-4d8d-af48-df5c19d5d8d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9deb71cc68ef4e24bc7d1dd36ed76d8b', 'request_id': 'req-687a52d7-e3ea-4d8d-af48-df5c19d5d8d5'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:55.878914 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-687a52d7-e3ea-4d8d-af48-df5c19d5d8d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9deb71cc68ef4e24bc7d1dd36ed76d8b', 'request_id': 'req-687a52d7-e3ea-4d8d-af48-df5c19d5d8d5'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:55.885580 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-687a52d7-e3ea-4d8d-af48-df5c19d5d8d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9deb71cc68ef4e24bc7d1dd36ed76d8b', 'request_id': 'req-687a52d7-e3ea-4d8d-af48-df5c19d5d8d5'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:55.898876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-687a52d7-e3ea-4d8d-af48-df5c19d5d8d5 admin admin] The token cache is being invalidate because project 9deb71cc68ef4e24bc7d1dd36ed76d8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:25:55.899434 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-687a52d7-e3ea-4d8d-af48-df5c19d5d8d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:55.900108 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-687a52d7-e3ea-4d8d-af48-df5c19d5d8d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:25:55.901881 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1381/2754] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:25:55 2022] DELETE /identity/v3/projects/9deb71cc68ef4e24bc7d1dd36ed76d8b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:55.906989 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a599a98-8627-40e2-8615-3d8c3f7f9132 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:55.907271 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a599a98-8627-40e2-8615-3d8c3f7f9132 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:55.907542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a599a98-8627-40e2-8615-3d8c3f7f9132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:55.917773 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4b4d6-8750-492c-b10f-567eef18df6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:55.919398 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4b4d6-8750-492c-b10f-567eef18df6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:55.919961 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4b4d6-8750-492c-b10f-567eef18df6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:55.920248 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4b4d6-8750-492c-b10f-567eef18df6e admin admin] PATH_INFO: `/v3/projects/53f48303760944db9f3229c124a0a296/users/f57c239c6e444155ba1d54324945135d/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:55.922390 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4b4d6-8750-492c-b10f-567eef18df6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f48303760944db9f3229c124a0a296, user_id=f57c239c6e444155ba1d54324945135d, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:55.925099 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4b4d6-8750-492c-b10f-567eef18df6e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:55.926444 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-6a599a98-8627-40e2-8615-3d8c3f7f9132 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:25:55.927640 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-6a599a98-8627-40e2-8615-3d8c3f7f9132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:55.935577 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1382/2755] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:25:55.936417 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1374/2756] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:25:55 2022] PUT /identity/v3/projects/53f48303760944db9f3229c124a0a296/users/f57c239c6e444155ba1d54324945135d/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:25:55.943461 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378bb85-373f-4809-a421-757d887cf722 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:55.943769 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378bb85-373f-4809-a421-757d887cf722 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:55.944085 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378bb85-373f-4809-a421-757d887cf722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:55.946313 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de52cc-de3a-4dee-99b4-31f96f984163 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:55.946603 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de52cc-de3a-4dee-99b4-31f96f984163 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:55.946911 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de52cc-de3a-4dee-99b4-31f96f984163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:55.962539 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-a378bb85-373f-4809-a421-757d887cf722 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:25:55.963728 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a378bb85-373f-4809-a421-757d887cf722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:55.976447 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-58de52cc-de3a-4dee-99b4-31f96f984163 None None] MFA Rules not processed for user `f57c239c6e444155ba1d54324945135d`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:25:55.977632 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-58de52cc-de3a-4dee-99b4-31f96f984163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:56.026297 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1383/2757] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:25:56.031602 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378bb85-373f-4809-a421-757d887cf722 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:56.041091 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378bb85-373f-4809-a421-757d887cf722 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:56.046317 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478263af-ac38-4108-b6ed-0777d839c64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:56.047138 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478263af-ac38-4108-b6ed-0777d839c64c admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:56.047420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478263af-ac38-4108-b6ed-0777d839c64c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:56.047698 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478263af-ac38-4108-b6ed-0777d839c64c admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:56.048522 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478263af-ac38-4108-b6ed-0777d839c64c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:25:56.048827 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478263af-ac38-4108-b6ed-0777d839c64c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:56.050486 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478263af-ac38-4108-b6ed-0777d839c64c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:56.064321 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1384/2758] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 23:25:56.068606 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478263af-ac38-4108-b6ed-0777d839c64c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:56.080246 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478263af-ac38-4108-b6ed-0777d839c64c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:56.087842 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b128f-7453-4038-aa62-1ac157efc0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:56.087842 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b128f-7453-4038-aa62-1ac157efc0b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:56.087842 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b128f-7453-4038-aa62-1ac157efc0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:56.087842 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b128f-7453-4038-aa62-1ac157efc0b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:56.088347 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b128f-7453-4038-aa62-1ac157efc0b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:56.091218 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b128f-7453-4038-aa62-1ac157efc0b4 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:56.122859 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1385/2759] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:25:56 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:25:56.131626 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b128f-7453-4038-aa62-1ac157efc0b4 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:56.177405 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1375/2760] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:25:55 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:25:56.187861 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de52cc-de3a-4dee-99b4-31f96f984163 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:56.189159 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-58de52cc-de3a-4dee-99b4-31f96f984163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:56.195211 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b128f-7453-4038-aa62-1ac157efc0b4 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:56.200292 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e22e14-dd24-458b-af9d-cefae5357fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:56.201289 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e22e14-dd24-458b-af9d-cefae5357fbb admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:56.201742 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e22e14-dd24-458b-af9d-cefae5357fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:56.202288 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e22e14-dd24-458b-af9d-cefae5357fbb admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:56.203294 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e22e14-dd24-458b-af9d-cefae5357fbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:56.205329 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e22e14-dd24-458b-af9d-cefae5357fbb admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:56.226459 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1386/2761] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:25:56 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:25:56.231114 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e22e14-dd24-458b-af9d-cefae5357fbb admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:56.240922 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e22e14-dd24-458b-af9d-cefae5357fbb admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:56.246505 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03fa23-967a-42b2-9ab0-28ca82733521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:56.247351 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03fa23-967a-42b2-9ab0-28ca82733521 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:56.247636 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03fa23-967a-42b2-9ab0-28ca82733521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:56.247941 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03fa23-967a-42b2-9ab0-28ca82733521 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:56.248682 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03fa23-967a-42b2-9ab0-28ca82733521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:56.250267 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03fa23-967a-42b2-9ab0-28ca82733521 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:56.253384 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de52cc-de3a-4dee-99b4-31f96f984163 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:56.260364 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1387/2762] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 23:25:56.265336 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03fa23-967a-42b2-9ab0-28ca82733521 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:56.274666 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03fa23-967a-42b2-9ab0-28ca82733521 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:56.280498 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a1b97-92c3-4a61-a6e4-a2618b934755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:56.281503 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a1b97-92c3-4a61-a6e4-a2618b934755 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:56.281996 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a1b97-92c3-4a61-a6e4-a2618b934755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:56.282345 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a1b97-92c3-4a61-a6e4-a2618b934755 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:56.283190 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a1b97-92c3-4a61-a6e4-a2618b934755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:56.285099 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a1b97-92c3-4a61-a6e4-a2618b934755 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:56.295513 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1388/2763] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:25:56.299307 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a1b97-92c3-4a61-a6e4-a2618b934755 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:56.302262 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca042fbc-2ac3-419c-ace9-ab1e42206726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:56.302910 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca042fbc-2ac3-419c-ace9-ab1e42206726 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:56.303197 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca042fbc-2ac3-419c-ace9-ab1e42206726 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:56.303475 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca042fbc-2ac3-419c-ace9-ab1e42206726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:56.309566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a1b97-92c3-4a61-a6e4-a2618b934755 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:56.314157 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257c15c-fbf2-4e4d-b049-00321696b261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:56.315004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257c15c-fbf2-4e4d-b049-00321696b261 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:56.315283 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257c15c-fbf2-4e4d-b049-00321696b261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:56.315556 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257c15c-fbf2-4e4d-b049-00321696b261 admin admin] PATH_INFO: `/v3/projects/b55b4d0e04bf46e18d0f7a1d3851b603/users/90e38b215fc34b759e71c933c1a08eec/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:56.333014 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257c15c-fbf2-4e4d-b049-00321696b261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55b4d0e04bf46e18d0f7a1d3851b603, user_id=90e38b215fc34b759e71c933c1a08eec, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:56.335558 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257c15c-fbf2-4e4d-b049-00321696b261 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:56.348979 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1389/2764] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:25:56 2022] PUT /identity/v3/projects/b55b4d0e04bf46e18d0f7a1d3851b603/users/90e38b215fc34b759e71c933c1a08eec/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:25:56.353752 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a583a-c8dd-4c24-bed8-ab343e3fd171 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:56.354038 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a583a-c8dd-4c24-bed8-ab343e3fd171 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:56.354335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a583a-c8dd-4c24-bed8-ab343e3fd171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:56.365065 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca042fbc-2ac3-419c-ace9-ab1e42206726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:56.366614 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca042fbc-2ac3-419c-ace9-ab1e42206726 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:56.372119 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-820a583a-c8dd-4c24-bed8-ab343e3fd171 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:25:56.373513 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-820a583a-c8dd-4c24-bed8-ab343e3fd171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:56.378324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1376/2765] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:25:56 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:25:56.438502 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1390/2766] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:25:56.448250 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca042fbc-2ac3-419c-ace9-ab1e42206726 service cinder] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:56.450303 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-ca042fbc-2ac3-419c-ace9-ab1e42206726 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:56.451925 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a583a-c8dd-4c24-bed8-ab343e3fd171 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:25:56.508498 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a583a-c8dd-4c24-bed8-ab343e3fd171 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:56.513257 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1bdd8-c2b0-4e94-8997-2b977f6d11a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:56.514092 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1bdd8-c2b0-4e94-8997-2b977f6d11a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:56.514491 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1bdd8-c2b0-4e94-8997-2b977f6d11a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:56.514878 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1bdd8-c2b0-4e94-8997-2b977f6d11a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:56.515933 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca042fbc-2ac3-419c-ace9-ab1e42206726 service cinder] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:25:56.517038 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-1aa1bdd8-c2b0-4e94-8997-2b977f6d11a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:25:56.566241 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128050c1-99b9-466a-b60e-d3d9ca07e95f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:25:56.566908 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128050c1-99b9-466a-b60e-d3d9ca07e95f service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:25:56.567201 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128050c1-99b9-466a-b60e-d3d9ca07e95f service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:25:56.567462 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128050c1-99b9-466a-b60e-d3d9ca07e95f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:25:56.577118 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128050c1-99b9-466a-b60e-d3d9ca07e95f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:56.578533 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128050c1-99b9-466a-b60e-d3d9ca07e95f service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:56.579511 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1bdd8-c2b0-4e94-8997-2b977f6d11a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:25:56.580971 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1bdd8-c2b0-4e94-8997-2b977f6d11a6 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:25:56.587930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1377/2767] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:25:56.589717 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1391/2768] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:25:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:26:01.096853 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d207d-8d24-413b-9c11-7c5f1561da17 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:01.097334 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d207d-8d24-413b-9c11-7c5f1561da17 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:01.097456 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d207d-8d24-413b-9c11-7c5f1561da17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:01.127603 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-036d207d-8d24-413b-9c11-7c5f1561da17 None None] MFA Rules not processed for user `90e38b215fc34b759e71c933c1a08eec`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:26:01.129592 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-036d207d-8d24-413b-9c11-7c5f1561da17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:01.201461 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1378/2769] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:26:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:26:01.205694 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1bdd8-c2b0-4e94-8997-2b977f6d11a6 service cinder] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:01.217118 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1bdd8-c2b0-4e94-8997-2b977f6d11a6 service cinder] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:01.222273 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a98195-b86c-4e13-8b0e-97e529ab4ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:01.222934 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a98195-b86c-4e13-8b0e-97e529ab4ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:01.223217 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a98195-b86c-4e13-8b0e-97e529ab4ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:01.223493 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a98195-b86c-4e13-8b0e-97e529ab4ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:01.224241 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a98195-b86c-4e13-8b0e-97e529ab4ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:01.226126 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a98195-b86c-4e13-8b0e-97e529ab4ab9 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:01.255062 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1392/2770] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:26:01 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:26:01.259198 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d207d-8d24-413b-9c11-7c5f1561da17 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:01.270358 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d207d-8d24-413b-9c11-7c5f1561da17 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:01.328349 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3087acd-9194-4c80-ad38-3df75e36d8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:01.329028 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3087acd-9194-4c80-ad38-3df75e36d8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:01.329309 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3087acd-9194-4c80-ad38-3df75e36d8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:01.329614 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3087acd-9194-4c80-ad38-3df75e36d8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:01.330320 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3087acd-9194-4c80-ad38-3df75e36d8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:01.332261 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3087acd-9194-4c80-ad38-3df75e36d8a1 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:01.357661 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1379/2771] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:26:01 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:26:01.364495 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a98195-b86c-4e13-8b0e-97e529ab4ab9 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:01.389897 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a98195-b86c-4e13-8b0e-97e529ab4ab9 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:01.394931 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e851fd4-a0a6-4f9d-be10-eb293a27ea48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:01.395599 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e851fd4-a0a6-4f9d-be10-eb293a27ea48 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:01.395934 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e851fd4-a0a6-4f9d-be10-eb293a27ea48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:01.396211 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e851fd4-a0a6-4f9d-be10-eb293a27ea48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:01.396980 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e851fd4-a0a6-4f9d-be10-eb293a27ea48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:01.398564 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e851fd4-a0a6-4f9d-be10-eb293a27ea48 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:01.410846 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1393/2772] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:26:01.415778 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3087acd-9194-4c80-ad38-3df75e36d8a1 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:01.426458 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3087acd-9194-4c80-ad38-3df75e36d8a1 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:01.432760 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a458d3-ddda-4507-b174-e28eb221d9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:01.434394 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a458d3-ddda-4507-b174-e28eb221d9f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:01.434683 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a458d3-ddda-4507-b174-e28eb221d9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:01.434962 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a458d3-ddda-4507-b174-e28eb221d9f3 admin admin] PATH_INFO: `/v3/projects/038e7a50c141460eb8217c8b359b9456/users/bc16754667b24ee7aa43debd6565ced5/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:01.451125 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a458d3-ddda-4507-b174-e28eb221d9f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=038e7a50c141460eb8217c8b359b9456, user_id=bc16754667b24ee7aa43debd6565ced5, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:01.453820 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a458d3-ddda-4507-b174-e28eb221d9f3 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:01.469109 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1380/2773] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:26:01 2022] PUT /identity/v3/projects/038e7a50c141460eb8217c8b359b9456/users/bc16754667b24ee7aa43debd6565ced5/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:26:01.473171 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e851fd4-a0a6-4f9d-be10-eb293a27ea48 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:01.484922 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e851fd4-a0a6-4f9d-be10-eb293a27ea48 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:01.545219 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831688a-f59a-4ebc-8ef4-eb72f3035f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:01.545777 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831688a-f59a-4ebc-8ef4-eb72f3035f7b admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:01.546064 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831688a-f59a-4ebc-8ef4-eb72f3035f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:01.546337 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831688a-f59a-4ebc-8ef4-eb72f3035f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:01.547082 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831688a-f59a-4ebc-8ef4-eb72f3035f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:01.548714 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831688a-f59a-4ebc-8ef4-eb72f3035f7b admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:01.559856 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1394/2774] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:26:01.563688 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a458d3-ddda-4507-b174-e28eb221d9f3 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:01.575923 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a458d3-ddda-4507-b174-e28eb221d9f3 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:01.581058 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4218e-ec7f-4a83-a35d-61e3f6df816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:01.582101 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4218e-ec7f-4a83-a35d-61e3f6df816d admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:01.582458 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4218e-ec7f-4a83-a35d-61e3f6df816d admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:01.582809 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4218e-ec7f-4a83-a35d-61e3f6df816d admin admin] PATH_INFO: `/v3/projects/038e7a50c141460eb8217c8b359b9456/users/bc16754667b24ee7aa43debd6565ced5/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:01.584993 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4218e-ec7f-4a83-a35d-61e3f6df816d admin admin] RBAC: Authorizing `identity:create_grant(project_id=038e7a50c141460eb8217c8b359b9456, user_id=bc16754667b24ee7aa43debd6565ced5, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:01.587718 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4218e-ec7f-4a83-a35d-61e3f6df816d admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:01.599688 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1381/2775] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:26:01 2022] PUT /identity/v3/projects/038e7a50c141460eb8217c8b359b9456/users/bc16754667b24ee7aa43debd6565ced5/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:26:05.772248 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717687d8-87f7-4867-851b-6517b9811cac None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:05.772769 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717687d8-87f7-4867-851b-6517b9811cac None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:05.772993 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717687d8-87f7-4867-851b-6517b9811cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:05.799697 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-717687d8-87f7-4867-851b-6517b9811cac None None] MFA Rules not processed for user `bc16754667b24ee7aa43debd6565ced5`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:26:05.800918 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-717687d8-87f7-4867-851b-6517b9811cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:05.867335 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1395/2776] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:26:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:26:05.878991 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4218e-ec7f-4a83-a35d-61e3f6df816d admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:05.880797 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-33d4218e-ec7f-4a83-a35d-61e3f6df816d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:05.954871 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4218e-ec7f-4a83-a35d-61e3f6df816d admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:05.960400 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a82f08-1323-45f9-a420-d9c5b50739f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:05.961067 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a82f08-1323-45f9-a420-d9c5b50739f7 service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:05.961349 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a82f08-1323-45f9-a420-d9c5b50739f7 service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:05.961623 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a82f08-1323-45f9-a420-d9c5b50739f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:06.018203 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a82f08-1323-45f9-a420-d9c5b50739f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:06.019787 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a82f08-1323-45f9-a420-d9c5b50739f7 service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:06.029313 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1382/2777] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:26:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:26:44.186058 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717687d8-87f7-4867-851b-6517b9811cac None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:44.187880 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-717687d8-87f7-4867-851b-6517b9811cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:44.251637 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717687d8-87f7-4867-851b-6517b9811cac None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:44.256267 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564da83-07f1-43f2-abe5-cd9b3af0f72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:44.257137 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564da83-07f1-43f2-abe5-cd9b3af0f72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:44.257416 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564da83-07f1-43f2-abe5-cd9b3af0f72c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:44.257699 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564da83-07f1-43f2-abe5-cd9b3af0f72c admin admin] PATH_INFO: `/v3/users/97f8169ea0294e07ac66bb63c3779f36` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:44.258878 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564da83-07f1-43f2-abe5-cd9b3af0f72c admin admin] RBAC: Authorizing `identity:delete_user(user_id=97f8169ea0294e07ac66bb63c3779f36)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:44.260813 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564da83-07f1-43f2-abe5-cd9b3af0f72c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:44.305478 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6564da83-07f1-43f2-abe5-cd9b3af0f72c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97f8169ea0294e07ac66bb63c3779f36'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:44.319564 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6564da83-07f1-43f2-abe5-cd9b3af0f72c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97f8169ea0294e07ac66bb63c3779f36'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:44.320368 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6564da83-07f1-43f2-abe5-cd9b3af0f72c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97f8169ea0294e07ac66bb63c3779f36'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:44.328359 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6564da83-07f1-43f2-abe5-cd9b3af0f72c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97f8169ea0294e07ac66bb63c3779f36'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:44.329005 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6564da83-07f1-43f2-abe5-cd9b3af0f72c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97f8169ea0294e07ac66bb63c3779f36'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:44.341575 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1396/2778] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:26:44 2022] DELETE /identity/v3/users/97f8169ea0294e07ac66bb63c3779f36 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:26:44.346387 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e8128-bd0a-48a2-a68f-c2156dc784b7 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:44.346913 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e8128-bd0a-48a2-a68f-c2156dc784b7 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:44.347024 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e8128-bd0a-48a2-a68f-c2156dc784b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:44.363909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-394e8128-bd0a-48a2-a68f-c2156dc784b7 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:26:44.365266 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-394e8128-bd0a-48a2-a68f-c2156dc784b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:44.430120 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1383/2779] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:26:44.440832 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564da83-07f1-43f2-abe5-cd9b3af0f72c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:44.442408 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-6564da83-07f1-43f2-abe5-cd9b3af0f72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:44.501694 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564da83-07f1-43f2-abe5-cd9b3af0f72c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:44.505390 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fe3ce-c719-478b-b781-88953d6c8965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:44.506026 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fe3ce-c719-478b-b781-88953d6c8965 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:44.506312 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fe3ce-c719-478b-b781-88953d6c8965 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:44.506589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fe3ce-c719-478b-b781-88953d6c8965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:44.516322 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fe3ce-c719-478b-b781-88953d6c8965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:44.517776 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fe3ce-c719-478b-b781-88953d6c8965 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:44.527760 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1397/2780] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:26:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:26:44.609809 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b1192-94fb-47c3-8c71-3a04fab76d24 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:44.610208 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b1192-94fb-47c3-8c71-3a04fab76d24 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:44.610559 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b1192-94fb-47c3-8c71-3a04fab76d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:44.629170 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-2c6b1192-94fb-47c3-8c71-3a04fab76d24 None None] MFA Rules not processed for user `90e38b215fc34b759e71c933c1a08eec`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:26:44.630433 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-2c6b1192-94fb-47c3-8c71-3a04fab76d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:44.689213 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1384/2781] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:26:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:26:44.821426 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fe3ce-c719-478b-b781-88953d6c8965 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:44.822839 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-800fe3ce-c719-478b-b781-88953d6c8965 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:44.845197 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fe3ce-c719-478b-b781-88953d6c8965 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:44.850226 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3496707-bc32-493b-a870-7c10510409aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:44.851086 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3496707-bc32-493b-a870-7c10510409aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:44.851371 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3496707-bc32-493b-a870-7c10510409aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:44.851646 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3496707-bc32-493b-a870-7c10510409aa admin admin] PATH_INFO: `/v3/projects/440d37fec8174e18b796f1306643f4b1` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:44.852880 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3496707-bc32-493b-a870-7c10510409aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=440d37fec8174e18b796f1306643f4b1)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:44.854755 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3496707-bc32-493b-a870-7c10510409aa admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:44.921219 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a3496707-bc32-493b-a870-7c10510409aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440d37fec8174e18b796f1306643f4b1', 'request_id': 'req-a3496707-bc32-493b-a870-7c10510409aa'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:44.927062 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a3496707-bc32-493b-a870-7c10510409aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440d37fec8174e18b796f1306643f4b1', 'request_id': 'req-a3496707-bc32-493b-a870-7c10510409aa'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:44.933176 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a3496707-bc32-493b-a870-7c10510409aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440d37fec8174e18b796f1306643f4b1', 'request_id': 'req-a3496707-bc32-493b-a870-7c10510409aa'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:44.951089 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a3496707-bc32-493b-a870-7c10510409aa admin admin] The token cache is being invalidate because project 440d37fec8174e18b796f1306643f4b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:26:44.951812 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a3496707-bc32-493b-a870-7c10510409aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:44.952504 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-a3496707-bc32-493b-a870-7c10510409aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:44.967964 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1398/2782] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:26:44 2022] DELETE /identity/v3/projects/440d37fec8174e18b796f1306643f4b1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:26:45.509137 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b1192-94fb-47c3-8c71-3a04fab76d24 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:45.510572 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-2c6b1192-94fb-47c3-8c71-3a04fab76d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:45.583905 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b1192-94fb-47c3-8c71-3a04fab76d24 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:45.642730 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc267d2-563c-4e58-828c-e35a8bc8fec1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f5243eef2a24a518b30526425c0b2c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:45.643377 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc267d2-563c-4e58-828c-e35a8bc8fec1 service placement] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:45.643658 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc267d2-563c-4e58-828c-e35a8bc8fec1 service placement] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:45.643968 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc267d2-563c-4e58-828c-e35a8bc8fec1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:45.645722 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-8cc267d2-563c-4e58-828c-e35a8bc8fec1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:45.657605 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc267d2-563c-4e58-828c-e35a8bc8fec1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:45.659180 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc267d2-563c-4e58-828c-e35a8bc8fec1 service placement] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:45.668863 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1385/2783] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:26:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:26:48.021980 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3496707-bc32-493b-a870-7c10510409aa admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:48.024160 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a3496707-bc32-493b-a870-7c10510409aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:48.131395 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3496707-bc32-493b-a870-7c10510409aa admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:48.137277 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd45fc2-9783-4922-83b1-671c3197517f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:48.137950 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd45fc2-9783-4922-83b1-671c3197517f service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:48.138231 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd45fc2-9783-4922-83b1-671c3197517f service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:48.139119 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd45fc2-9783-4922-83b1-671c3197517f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:48.141022 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-ccd45fc2-9783-4922-83b1-671c3197517f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:48.154168 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd45fc2-9783-4922-83b1-671c3197517f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:48.156287 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd45fc2-9783-4922-83b1-671c3197517f service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:48.168844 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1399/2784] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:26:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:26:54.728856 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc267d2-563c-4e58-828c-e35a8bc8fec1 service placement] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:54.730609 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-8cc267d2-563c-4e58-828c-e35a8bc8fec1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:54.794406 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc267d2-563c-4e58-828c-e35a8bc8fec1 service placement] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:54.799777 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490877bd-1cef-4c80-b9c1-841863474f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:54.800675 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490877bd-1cef-4c80-b9c1-841863474f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:54.801033 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490877bd-1cef-4c80-b9c1-841863474f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:54.801262 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490877bd-1cef-4c80-b9c1-841863474f12 admin admin] PATH_INFO: `/v3/users/3548a3788c9a4bb199198604ee8b69da` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:54.802577 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490877bd-1cef-4c80-b9c1-841863474f12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3548a3788c9a4bb199198604ee8b69da)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:54.804530 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490877bd-1cef-4c80-b9c1-841863474f12 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:54.851173 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-490877bd-1cef-4c80-b9c1-841863474f12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3548a3788c9a4bb199198604ee8b69da'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:54.863776 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-490877bd-1cef-4c80-b9c1-841863474f12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3548a3788c9a4bb199198604ee8b69da'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:54.864530 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-490877bd-1cef-4c80-b9c1-841863474f12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3548a3788c9a4bb199198604ee8b69da'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:54.865144 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-490877bd-1cef-4c80-b9c1-841863474f12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3548a3788c9a4bb199198604ee8b69da'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:54.874267 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-490877bd-1cef-4c80-b9c1-841863474f12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3548a3788c9a4bb199198604ee8b69da'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:54.886981 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1386/2785] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:26:54 2022] DELETE /identity/v3/users/3548a3788c9a4bb199198604ee8b69da => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:26:54.892818 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efe11f-8faf-48ce-a43e-b438cbda92db None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:54.893308 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efe11f-8faf-48ce-a43e-b438cbda92db None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:54.893432 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efe11f-8faf-48ce-a43e-b438cbda92db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:54.911154 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-08efe11f-8faf-48ce-a43e-b438cbda92db None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:26:54.912295 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-08efe11f-8faf-48ce-a43e-b438cbda92db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:54.968415 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1400/2786] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:26:54.978321 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490877bd-1cef-4c80-b9c1-841863474f12 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:54.979702 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-490877bd-1cef-4c80-b9c1-841863474f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:55.034867 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490877bd-1cef-4c80-b9c1-841863474f12 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:55.038499 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59975b31-e9e2-49dc-8a54-802556431f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:55.039137 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59975b31-e9e2-49dc-8a54-802556431f18 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:55.039423 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59975b31-e9e2-49dc-8a54-802556431f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:55.039700 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59975b31-e9e2-49dc-8a54-802556431f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:55.049318 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59975b31-e9e2-49dc-8a54-802556431f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:55.050734 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59975b31-e9e2-49dc-8a54-802556431f18 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:55.059853 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1387/2787] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:26:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:26:55.317648 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efe11f-8faf-48ce-a43e-b438cbda92db None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:55.319187 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-08efe11f-8faf-48ce-a43e-b438cbda92db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:55.334052 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efe11f-8faf-48ce-a43e-b438cbda92db None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:55.339719 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfa9ab-cefe-4b93-9965-b164e5996f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:55.340581 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfa9ab-cefe-4b93-9965-b164e5996f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:55.340980 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfa9ab-cefe-4b93-9965-b164e5996f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:55.341221 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfa9ab-cefe-4b93-9965-b164e5996f6d admin admin] PATH_INFO: `/v3/projects/d9f8cbfedc624201aa80231b6917d76d` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:55.342337 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfa9ab-cefe-4b93-9965-b164e5996f6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9f8cbfedc624201aa80231b6917d76d)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:55.344254 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfa9ab-cefe-4b93-9965-b164e5996f6d admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:55.389368 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-01dfa9ab-cefe-4b93-9965-b164e5996f6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9f8cbfedc624201aa80231b6917d76d', 'request_id': 'req-01dfa9ab-cefe-4b93-9965-b164e5996f6d'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:55.394698 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-01dfa9ab-cefe-4b93-9965-b164e5996f6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9f8cbfedc624201aa80231b6917d76d', 'request_id': 'req-01dfa9ab-cefe-4b93-9965-b164e5996f6d'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:55.400761 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-01dfa9ab-cefe-4b93-9965-b164e5996f6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9f8cbfedc624201aa80231b6917d76d', 'request_id': 'req-01dfa9ab-cefe-4b93-9965-b164e5996f6d'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:55.412705 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-01dfa9ab-cefe-4b93-9965-b164e5996f6d admin admin] The token cache is being invalidate because project d9f8cbfedc624201aa80231b6917d76d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:26:55.412993 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-01dfa9ab-cefe-4b93-9965-b164e5996f6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:55.413632 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-01dfa9ab-cefe-4b93-9965-b164e5996f6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:55.415851 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1401/2788] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:26:55 2022] DELETE /identity/v3/projects/d9f8cbfedc624201aa80231b6917d76d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:26:55.420856 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59975b31-e9e2-49dc-8a54-802556431f18 service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:55.430882 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59975b31-e9e2-49dc-8a54-802556431f18 service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:55.485836 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddacd6-4e00-4db8-a375-a5ad77eefb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:55.486619 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddacd6-4e00-4db8-a375-a5ad77eefb46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:55.486903 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddacd6-4e00-4db8-a375-a5ad77eefb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:55.487178 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddacd6-4e00-4db8-a375-a5ad77eefb46 admin admin] PATH_INFO: `/v3/users/f57c239c6e444155ba1d54324945135d` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:55.488386 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddacd6-4e00-4db8-a375-a5ad77eefb46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f57c239c6e444155ba1d54324945135d)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:55.490278 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddacd6-4e00-4db8-a375-a5ad77eefb46 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:55.533612 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1cddacd6-4e00-4db8-a375-a5ad77eefb46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f57c239c6e444155ba1d54324945135d'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:55.545562 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1cddacd6-4e00-4db8-a375-a5ad77eefb46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f57c239c6e444155ba1d54324945135d'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:55.546219 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1cddacd6-4e00-4db8-a375-a5ad77eefb46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f57c239c6e444155ba1d54324945135d'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:55.546821 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1cddacd6-4e00-4db8-a375-a5ad77eefb46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f57c239c6e444155ba1d54324945135d'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:55.555976 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-1cddacd6-4e00-4db8-a375-a5ad77eefb46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f57c239c6e444155ba1d54324945135d'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:55.568813 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1388/2789] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:26:55 2022] DELETE /identity/v3/users/f57c239c6e444155ba1d54324945135d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:26:55.832141 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfa9ab-cefe-4b93-9965-b164e5996f6d admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:55.833580 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-01dfa9ab-cefe-4b93-9965-b164e5996f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:55.849687 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfa9ab-cefe-4b93-9965-b164e5996f6d admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:55.906357 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1253519-d4c2-45d3-b057-dc25153eecf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:55.907210 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1253519-d4c2-45d3-b057-dc25153eecf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:55.907487 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1253519-d4c2-45d3-b057-dc25153eecf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:55.907757 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1253519-d4c2-45d3-b057-dc25153eecf3 admin admin] PATH_INFO: `/v3/projects/53f48303760944db9f3229c124a0a296` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:55.908955 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1253519-d4c2-45d3-b057-dc25153eecf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53f48303760944db9f3229c124a0a296)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:55.911172 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1253519-d4c2-45d3-b057-dc25153eecf3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:55.957319 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-b1253519-d4c2-45d3-b057-dc25153eecf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53f48303760944db9f3229c124a0a296', 'request_id': 'req-b1253519-d4c2-45d3-b057-dc25153eecf3'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:55.962739 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-b1253519-d4c2-45d3-b057-dc25153eecf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53f48303760944db9f3229c124a0a296', 'request_id': 'req-b1253519-d4c2-45d3-b057-dc25153eecf3'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:55.969325 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-b1253519-d4c2-45d3-b057-dc25153eecf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53f48303760944db9f3229c124a0a296', 'request_id': 'req-b1253519-d4c2-45d3-b057-dc25153eecf3'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:55.982080 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-b1253519-d4c2-45d3-b057-dc25153eecf3 admin admin] The token cache is being invalidate because project 53f48303760944db9f3229c124a0a296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:26:55.982433 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-b1253519-d4c2-45d3-b057-dc25153eecf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:55.983420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-b1253519-d4c2-45d3-b057-dc25153eecf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:55.984985 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1402/2790] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:26:55 2022] DELETE /identity/v3/projects/53f48303760944db9f3229c124a0a296 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:26:55.990084 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42790b36-7d60-40a1-aded-edd26a7ce899 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:55.990577 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42790b36-7d60-40a1-aded-edd26a7ce899 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:55.990685 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42790b36-7d60-40a1-aded-edd26a7ce899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:56.008928 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-42790b36-7d60-40a1-aded-edd26a7ce899 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:26:56.010041 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-42790b36-7d60-40a1-aded-edd26a7ce899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:56.068132 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1389/2791] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:26:56.075836 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b13558-e2a1-4ea1-9305-fd4267217c5c None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:56.076684 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b13558-e2a1-4ea1-9305-fd4267217c5c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:56.076963 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b13558-e2a1-4ea1-9305-fd4267217c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:56.095520 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-b8b13558-e2a1-4ea1-9305-fd4267217c5c None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:26:56.096729 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-b8b13558-e2a1-4ea1-9305-fd4267217c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:56.104644 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1403/2792] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:26:56.109034 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42790b36-7d60-40a1-aded-edd26a7ce899 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:56.118536 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42790b36-7d60-40a1-aded-edd26a7ce899 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:56.123425 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0365c-8b0c-48ff-93de-67616eb4fcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:56.124109 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0365c-8b0c-48ff-93de-67616eb4fcaa admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:56.124388 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0365c-8b0c-48ff-93de-67616eb4fcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:56.124656 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0365c-8b0c-48ff-93de-67616eb4fcaa admin admin] PATH_INFO: `/v3/domains` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:56.125373 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0365c-8b0c-48ff-93de-67616eb4fcaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:26:56.125671 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0365c-8b0c-48ff-93de-67616eb4fcaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:56.127233 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0365c-8b0c-48ff-93de-67616eb4fcaa admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:56.138321 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1390/2793] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:26:56.143127 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b13558-e2a1-4ea1-9305-fd4267217c5c None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:56.152289 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b13558-e2a1-4ea1-9305-fd4267217c5c None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:56.157969 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519d2ff-af30-4916-9034-fb7d16312648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:56.158600 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519d2ff-af30-4916-9034-fb7d16312648 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:56.158881 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519d2ff-af30-4916-9034-fb7d16312648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:56.159154 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519d2ff-af30-4916-9034-fb7d16312648 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:56.159895 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519d2ff-af30-4916-9034-fb7d16312648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:56.161778 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519d2ff-af30-4916-9034-fb7d16312648 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:56.187247 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1404/2794] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:26:56 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:26:56.191380 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0365c-8b0c-48ff-93de-67616eb4fcaa admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:56.200797 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0365c-8b0c-48ff-93de-67616eb4fcaa admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:56.254637 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31617086-389d-4974-ba64-fb348f5223ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:56.255288 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31617086-389d-4974-ba64-fb348f5223ac admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:56.255568 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31617086-389d-4974-ba64-fb348f5223ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:56.255866 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31617086-389d-4974-ba64-fb348f5223ac admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:56.256561 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31617086-389d-4974-ba64-fb348f5223ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:56.258427 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31617086-389d-4974-ba64-fb348f5223ac admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:56.278099 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1391/2795] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:26:56 2022] POST /identity/v3/users => generated 282 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:26:56.282851 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519d2ff-af30-4916-9034-fb7d16312648 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:56.292754 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519d2ff-af30-4916-9034-fb7d16312648 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:56.297932 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfc87b-6bf8-49a5-aec5-f22131dba3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:56.298579 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfc87b-6bf8-49a5-aec5-f22131dba3be admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:56.298863 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfc87b-6bf8-49a5-aec5-f22131dba3be admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:56.299137 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfc87b-6bf8-49a5-aec5-f22131dba3be admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:56.299916 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfc87b-6bf8-49a5-aec5-f22131dba3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:56.301511 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfc87b-6bf8-49a5-aec5-f22131dba3be admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:56.311578 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1405/2796] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:26:56.315578 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31617086-389d-4974-ba64-fb348f5223ac admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:56.325169 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31617086-389d-4974-ba64-fb348f5223ac admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:56.330072 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac9a48-0f3a-47f3-865d-5e119a42f995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:56.330713 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac9a48-0f3a-47f3-865d-5e119a42f995 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:56.330994 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac9a48-0f3a-47f3-865d-5e119a42f995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:56.331267 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac9a48-0f3a-47f3-865d-5e119a42f995 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:56.332023 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac9a48-0f3a-47f3-865d-5e119a42f995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:56.333586 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac9a48-0f3a-47f3-865d-5e119a42f995 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:56.344099 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1392/2797] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:26:56.347847 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfc87b-6bf8-49a5-aec5-f22131dba3be admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:56.358496 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfc87b-6bf8-49a5-aec5-f22131dba3be admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:56.363193 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b73cb2-ac1e-4e81-9ccd-63f7c24e8306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:56.364083 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b73cb2-ac1e-4e81-9ccd-63f7c24e8306 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:56.364373 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b73cb2-ac1e-4e81-9ccd-63f7c24e8306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:56.364646 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b73cb2-ac1e-4e81-9ccd-63f7c24e8306 admin admin] PATH_INFO: `/v3/projects/11da9f994bd2497ca70f1abca0d8bc42/users/0d0cca1437e84d47b35c2f4459145ac3/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:56.378889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b73cb2-ac1e-4e81-9ccd-63f7c24e8306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11da9f994bd2497ca70f1abca0d8bc42, user_id=0d0cca1437e84d47b35c2f4459145ac3, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:56.381551 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b73cb2-ac1e-4e81-9ccd-63f7c24e8306 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:56.395010 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1406/2798] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:26:56 2022] PUT /identity/v3/projects/11da9f994bd2497ca70f1abca0d8bc42/users/0d0cca1437e84d47b35c2f4459145ac3/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:26:56.406041 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725afd2-79a7-4b2a-b92f-d8105a487810 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:56.406352 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725afd2-79a7-4b2a-b92f-d8105a487810 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:56.406611 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725afd2-79a7-4b2a-b92f-d8105a487810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:56.433485 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-9725afd2-79a7-4b2a-b92f-d8105a487810 None None] MFA Rules not processed for user `0d0cca1437e84d47b35c2f4459145ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:26:56.434674 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-9725afd2-79a7-4b2a-b92f-d8105a487810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:56.496197 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1393/2799] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:26:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:26:56.500848 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b73cb2-ac1e-4e81-9ccd-63f7c24e8306 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:56.559413 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b73cb2-ac1e-4e81-9ccd-63f7c24e8306 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:56.564073 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4de63-ea21-42bd-91f6-2e18c20b0a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:56.564720 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4de63-ea21-42bd-91f6-2e18c20b0a24 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:56.564998 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4de63-ea21-42bd-91f6-2e18c20b0a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:56.565268 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4de63-ea21-42bd-91f6-2e18c20b0a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:56.565970 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4de63-ea21-42bd-91f6-2e18c20b0a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:56.567846 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4de63-ea21-42bd-91f6-2e18c20b0a24 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:56.592723 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1407/2800] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:26:56 2022] POST /identity/v3/projects => generated 363 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:26:56.596720 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725afd2-79a7-4b2a-b92f-d8105a487810 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:56.607673 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725afd2-79a7-4b2a-b92f-d8105a487810 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:56.661426 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3adcd-c4b5-4c2d-925a-9e90b443cac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:56.662090 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3adcd-c4b5-4c2d-925a-9e90b443cac7 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:56.662376 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3adcd-c4b5-4c2d-925a-9e90b443cac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:56.662660 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3adcd-c4b5-4c2d-925a-9e90b443cac7 admin admin] PATH_INFO: `/v3/users` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:56.663366 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3adcd-c4b5-4c2d-925a-9e90b443cac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:56.665287 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3adcd-c4b5-4c2d-925a-9e90b443cac7 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:56.684159 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1394/2801] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:26:56 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:26:56.688495 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4de63-ea21-42bd-91f6-2e18c20b0a24 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:56.698436 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4de63-ea21-42bd-91f6-2e18c20b0a24 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:56.703971 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85013fb-9f3e-4888-9ad0-ceffe359b929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:56.704617 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85013fb-9f3e-4888-9ad0-ceffe359b929 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:56.704902 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85013fb-9f3e-4888-9ad0-ceffe359b929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:56.705175 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85013fb-9f3e-4888-9ad0-ceffe359b929 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:56.705911 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85013fb-9f3e-4888-9ad0-ceffe359b929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:56.707521 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85013fb-9f3e-4888-9ad0-ceffe359b929 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:56.718798 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1408/2802] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:26:56.722822 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3adcd-c4b5-4c2d-925a-9e90b443cac7 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:56.732706 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3adcd-c4b5-4c2d-925a-9e90b443cac7 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:56.737253 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbf126-07da-4afe-9910-051098a69781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:56.738140 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbf126-07da-4afe-9910-051098a69781 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:56.738426 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbf126-07da-4afe-9910-051098a69781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:56.738696 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbf126-07da-4afe-9910-051098a69781 admin admin] PATH_INFO: `/v3/projects/fbc7b3800ac04073b57d73db0433ef37/users/f0be594abea94b3bb641600a05f48785/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:56.752738 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbf126-07da-4afe-9910-051098a69781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc7b3800ac04073b57d73db0433ef37, user_id=f0be594abea94b3bb641600a05f48785, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:56.755342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbf126-07da-4afe-9910-051098a69781 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:56.769020 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1395/2803] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:26:56 2022] PUT /identity/v3/projects/fbc7b3800ac04073b57d73db0433ef37/users/f0be594abea94b3bb641600a05f48785/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:26:56.773027 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85013fb-9f3e-4888-9ad0-ceffe359b929 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:56.783454 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85013fb-9f3e-4888-9ad0-ceffe359b929 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:56.836334 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060e71c-4577-4340-bc73-802484e61762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:56.836920 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060e71c-4577-4340-bc73-802484e61762 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:56.837201 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060e71c-4577-4340-bc73-802484e61762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:56.837469 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060e71c-4577-4340-bc73-802484e61762 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:56.838191 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060e71c-4577-4340-bc73-802484e61762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:56.839785 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060e71c-4577-4340-bc73-802484e61762 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:56.850166 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1409/2804] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:26:56.854290 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbf126-07da-4afe-9910-051098a69781 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:56.865215 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbf126-07da-4afe-9910-051098a69781 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:56.869740 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136212d9-15ad-4d0e-bc8d-8de7acde8728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:56.870602 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136212d9-15ad-4d0e-bc8d-8de7acde8728 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:56.870879 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136212d9-15ad-4d0e-bc8d-8de7acde8728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:56.871147 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136212d9-15ad-4d0e-bc8d-8de7acde8728 admin admin] PATH_INFO: `/v3/projects/fbc7b3800ac04073b57d73db0433ef37/users/f0be594abea94b3bb641600a05f48785/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:56.873255 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136212d9-15ad-4d0e-bc8d-8de7acde8728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc7b3800ac04073b57d73db0433ef37, user_id=f0be594abea94b3bb641600a05f48785, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:56.875883 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136212d9-15ad-4d0e-bc8d-8de7acde8728 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:56.892842 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1396/2805] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:26:56 2022] PUT /identity/v3/projects/fbc7b3800ac04073b57d73db0433ef37/users/f0be594abea94b3bb641600a05f48785/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:26:56.903574 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b15703-e46d-4eb0-a819-b6bcd8ae6c6d None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:56.903897 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b15703-e46d-4eb0-a819-b6bcd8ae6c6d None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:56.904176 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b15703-e46d-4eb0-a819-b6bcd8ae6c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:56.930667 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-63b15703-e46d-4eb0-a819-b6bcd8ae6c6d None None] MFA Rules not processed for user `f0be594abea94b3bb641600a05f48785`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:26:56.931875 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-63b15703-e46d-4eb0-a819-b6bcd8ae6c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:56.997741 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1410/2806] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:26:56 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:26:57.008476 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136212d9-15ad-4d0e-bc8d-8de7acde8728 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:57.010186 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-136212d9-15ad-4d0e-bc8d-8de7acde8728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:57.064816 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136212d9-15ad-4d0e-bc8d-8de7acde8728 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:57.068652 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146533d1-05d3-4905-91bd-752fb2a3a140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:57.069048 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146533d1-05d3-4905-91bd-752fb2a3a140 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:57.069330 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146533d1-05d3-4905-91bd-752fb2a3a140 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:57.069609 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146533d1-05d3-4905-91bd-752fb2a3a140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:57.079753 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146533d1-05d3-4905-91bd-752fb2a3a140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:57.081222 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146533d1-05d3-4905-91bd-752fb2a3a140 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:57.090930 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1397/2807] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:26:57 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:26:57.250793 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b15703-e46d-4eb0-a819-b6bcd8ae6c6d None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:57.308309 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b15703-e46d-4eb0-a819-b6bcd8ae6c6d None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:57.313544 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa17d53-c5b3-4528-833c-681815add48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:57.314392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa17d53-c5b3-4528-833c-681815add48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:57.314676 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa17d53-c5b3-4528-833c-681815add48c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:57.314952 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa17d53-c5b3-4528-833c-681815add48c admin admin] PATH_INFO: `/v3/users/0d0cca1437e84d47b35c2f4459145ac3` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:57.316155 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa17d53-c5b3-4528-833c-681815add48c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d0cca1437e84d47b35c2f4459145ac3)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:57.318055 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa17d53-c5b3-4528-833c-681815add48c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:57.362255 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-1aa17d53-c5b3-4528-833c-681815add48c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d0cca1437e84d47b35c2f4459145ac3'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:57.373848 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-1aa17d53-c5b3-4528-833c-681815add48c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d0cca1437e84d47b35c2f4459145ac3'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:57.374517 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-1aa17d53-c5b3-4528-833c-681815add48c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d0cca1437e84d47b35c2f4459145ac3'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:57.381523 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-1aa17d53-c5b3-4528-833c-681815add48c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d0cca1437e84d47b35c2f4459145ac3'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:57.382127 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-1aa17d53-c5b3-4528-833c-681815add48c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d0cca1437e84d47b35c2f4459145ac3'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:57.393869 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1411/2808] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:26:57 2022] DELETE /identity/v3/users/0d0cca1437e84d47b35c2f4459145ac3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:26:57.398346 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ef91f-4ca2-4ffb-8573-f7f30c33285b None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:57.398636 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ef91f-4ca2-4ffb-8573-f7f30c33285b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:57.398921 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ef91f-4ca2-4ffb-8573-f7f30c33285b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:57.416677 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-1d3ef91f-4ca2-4ffb-8573-f7f30c33285b None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:26:57.417855 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-1d3ef91f-4ca2-4ffb-8573-f7f30c33285b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:57.475882 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1398/2809] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:26:57.486029 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa17d53-c5b3-4528-833c-681815add48c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:57.487404 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-1aa17d53-c5b3-4528-833c-681815add48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:57.543413 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa17d53-c5b3-4528-833c-681815add48c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:57.547966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983fc88-7f57-46c5-9170-d75a88cb56fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:57.548613 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983fc88-7f57-46c5-9170-d75a88cb56fb service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:57.548893 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983fc88-7f57-46c5-9170-d75a88cb56fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:57.549163 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983fc88-7f57-46c5-9170-d75a88cb56fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:57.558089 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983fc88-7f57-46c5-9170-d75a88cb56fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:57.559514 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983fc88-7f57-46c5-9170-d75a88cb56fb service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:57.569258 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1412/2810] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:26:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:26:57.830287 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ef91f-4ca2-4ffb-8573-f7f30c33285b None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:57.831771 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-1d3ef91f-4ca2-4ffb-8573-f7f30c33285b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:57.843457 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ef91f-4ca2-4ffb-8573-f7f30c33285b None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:57.848152 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc225e5c-9215-484e-b982-491b0711263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:57.849113 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc225e5c-9215-484e-b982-491b0711263a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:57.849715 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc225e5c-9215-484e-b982-491b0711263a admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:57.850055 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc225e5c-9215-484e-b982-491b0711263a admin admin] PATH_INFO: `/v3/projects/11da9f994bd2497ca70f1abca0d8bc42` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:57.851311 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc225e5c-9215-484e-b982-491b0711263a admin admin] RBAC: Authorizing `identity:delete_project(project_id=11da9f994bd2497ca70f1abca0d8bc42)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:57.853297 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc225e5c-9215-484e-b982-491b0711263a admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:57.898561 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cc225e5c-9215-484e-b982-491b0711263a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11da9f994bd2497ca70f1abca0d8bc42', 'request_id': 'req-cc225e5c-9215-484e-b982-491b0711263a'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:57.905886 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cc225e5c-9215-484e-b982-491b0711263a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11da9f994bd2497ca70f1abca0d8bc42', 'request_id': 'req-cc225e5c-9215-484e-b982-491b0711263a'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:57.911380 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cc225e5c-9215-484e-b982-491b0711263a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11da9f994bd2497ca70f1abca0d8bc42', 'request_id': 'req-cc225e5c-9215-484e-b982-491b0711263a'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:57.922517 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cc225e5c-9215-484e-b982-491b0711263a admin admin] The token cache is being invalidate because project 11da9f994bd2497ca70f1abca0d8bc42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:26:57.922802 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cc225e5c-9215-484e-b982-491b0711263a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:57.923426 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-cc225e5c-9215-484e-b982-491b0711263a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:57.924989 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1399/2811] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:26:57 2022] DELETE /identity/v3/projects/11da9f994bd2497ca70f1abca0d8bc42 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:26:57.929021 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983fc88-7f57-46c5-9170-d75a88cb56fb service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:57.938811 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983fc88-7f57-46c5-9170-d75a88cb56fb service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:57.992546 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352f32c-325d-46c7-9419-76265c6033c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:57.993391 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352f32c-325d-46c7-9419-76265c6033c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:57.993669 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352f32c-325d-46c7-9419-76265c6033c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:57.993938 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352f32c-325d-46c7-9419-76265c6033c1 admin admin] PATH_INFO: `/v3/users/f0be594abea94b3bb641600a05f48785` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:57.995095 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352f32c-325d-46c7-9419-76265c6033c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0be594abea94b3bb641600a05f48785)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:57.997036 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352f32c-325d-46c7-9419-76265c6033c1 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:58.040682 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4352f32c-325d-46c7-9419-76265c6033c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0be594abea94b3bb641600a05f48785'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:58.051876 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4352f32c-325d-46c7-9419-76265c6033c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0be594abea94b3bb641600a05f48785'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:58.052554 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4352f32c-325d-46c7-9419-76265c6033c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0be594abea94b3bb641600a05f48785'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:58.059566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4352f32c-325d-46c7-9419-76265c6033c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0be594abea94b3bb641600a05f48785'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:58.060255 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-4352f32c-325d-46c7-9419-76265c6033c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0be594abea94b3bb641600a05f48785'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:58.072485 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1413/2812] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:26:57 2022] DELETE /identity/v3/users/f0be594abea94b3bb641600a05f48785 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:26:58.378156 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc225e5c-9215-484e-b982-491b0711263a admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:58.379647 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-cc225e5c-9215-484e-b982-491b0711263a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:58.393845 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc225e5c-9215-484e-b982-491b0711263a admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:58.455807 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9659e5-921a-4b82-9acd-bf20a78c2811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:58.456698 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9659e5-921a-4b82-9acd-bf20a78c2811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:58.456982 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9659e5-921a-4b82-9acd-bf20a78c2811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:58.457258 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9659e5-921a-4b82-9acd-bf20a78c2811 admin admin] PATH_INFO: `/v3/projects/fbc7b3800ac04073b57d73db0433ef37` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:58.458426 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9659e5-921a-4b82-9acd-bf20a78c2811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc7b3800ac04073b57d73db0433ef37)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:58.460377 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9659e5-921a-4b82-9acd-bf20a78c2811 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:58.505537 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ae9659e5-921a-4b82-9acd-bf20a78c2811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc7b3800ac04073b57d73db0433ef37', 'request_id': 'req-ae9659e5-921a-4b82-9acd-bf20a78c2811'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:58.512401 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ae9659e5-921a-4b82-9acd-bf20a78c2811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc7b3800ac04073b57d73db0433ef37', 'request_id': 'req-ae9659e5-921a-4b82-9acd-bf20a78c2811'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:58.517914 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ae9659e5-921a-4b82-9acd-bf20a78c2811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc7b3800ac04073b57d73db0433ef37', 'request_id': 'req-ae9659e5-921a-4b82-9acd-bf20a78c2811'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:58.528296 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ae9659e5-921a-4b82-9acd-bf20a78c2811 admin admin] The token cache is being invalidate because project fbc7b3800ac04073b57d73db0433ef37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:26:58.528579 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ae9659e5-921a-4b82-9acd-bf20a78c2811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:58.529195 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-ae9659e5-921a-4b82-9acd-bf20a78c2811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:26:58.531408 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1400/2813] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:26:58 2022] DELETE /identity/v3/projects/fbc7b3800ac04073b57d73db0433ef37 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:26:58.536368 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26466b-1417-4894-9cdb-d66397895f56 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:58.536659 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26466b-1417-4894-9cdb-d66397895f56 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:58.536935 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26466b-1417-4894-9cdb-d66397895f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:58.555276 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-cd26466b-1417-4894-9cdb-d66397895f56 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:26:58.556543 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-cd26466b-1417-4894-9cdb-d66397895f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:58.613232 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1414/2814] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:26:58.621242 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665340b-902d-495f-b378-9f6466459763 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:58.621530 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665340b-902d-495f-b378-9f6466459763 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:58.621806 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665340b-902d-495f-b378-9f6466459763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:58.640893 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-b665340b-902d-495f-b378-9f6466459763 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:26:58.642061 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-b665340b-902d-495f-b378-9f6466459763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:58.649618 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1401/2815] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:26:58.653659 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26466b-1417-4894-9cdb-d66397895f56 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:58.663632 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26466b-1417-4894-9cdb-d66397895f56 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:58.668214 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7b8cf-2c4c-479c-a07a-24a36f73e77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:58.668797 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7b8cf-2c4c-479c-a07a-24a36f73e77e admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:58.669079 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7b8cf-2c4c-479c-a07a-24a36f73e77e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:58.669353 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7b8cf-2c4c-479c-a07a-24a36f73e77e admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:58.670781 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7b8cf-2c4c-479c-a07a-24a36f73e77e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:26:58.671094 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7b8cf-2c4c-479c-a07a-24a36f73e77e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:58.672738 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7b8cf-2c4c-479c-a07a-24a36f73e77e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:58.684076 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1415/2816] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:26:58.688013 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665340b-902d-495f-b378-9f6466459763 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:58.696766 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665340b-902d-495f-b378-9f6466459763 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:58.701366 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54f665-3a10-4e64-81ef-bdda44d39fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:58.701992 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54f665-3a10-4e64-81ef-bdda44d39fbd admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:58.702268 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54f665-3a10-4e64-81ef-bdda44d39fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:58.702536 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54f665-3a10-4e64-81ef-bdda44d39fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:58.703227 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54f665-3a10-4e64-81ef-bdda44d39fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:58.705094 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54f665-3a10-4e64-81ef-bdda44d39fbd admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:58.730570 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1402/2817] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:26:58 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:26:58.735695 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7b8cf-2c4c-479c-a07a-24a36f73e77e admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:58.745545 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7b8cf-2c4c-479c-a07a-24a36f73e77e admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:58.798646 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde52ab0-dd75-4368-bf82-30dc59283f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:58.799294 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde52ab0-dd75-4368-bf82-30dc59283f87 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:58.799579 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde52ab0-dd75-4368-bf82-30dc59283f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:58.799885 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde52ab0-dd75-4368-bf82-30dc59283f87 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:58.800589 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde52ab0-dd75-4368-bf82-30dc59283f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:58.802474 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde52ab0-dd75-4368-bf82-30dc59283f87 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:58.822288 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1416/2818] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:26:58 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:26:58.827170 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54f665-3a10-4e64-81ef-bdda44d39fbd admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:58.837242 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54f665-3a10-4e64-81ef-bdda44d39fbd admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:58.841963 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244815e-b71e-47a3-a537-7bb321436936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:58.842733 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244815e-b71e-47a3-a537-7bb321436936 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:58.843015 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244815e-b71e-47a3-a537-7bb321436936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:58.843291 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244815e-b71e-47a3-a537-7bb321436936 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:58.844087 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244815e-b71e-47a3-a537-7bb321436936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:58.845656 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244815e-b71e-47a3-a537-7bb321436936 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:58.855846 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1403/2819] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:26:58.860051 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde52ab0-dd75-4368-bf82-30dc59283f87 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:58.869658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde52ab0-dd75-4368-bf82-30dc59283f87 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:58.874877 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488acf5-9f45-4e7a-971f-bbafb6c13c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:58.875519 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488acf5-9f45-4e7a-971f-bbafb6c13c42 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:58.875804 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488acf5-9f45-4e7a-971f-bbafb6c13c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:58.876109 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488acf5-9f45-4e7a-971f-bbafb6c13c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:58.876844 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488acf5-9f45-4e7a-971f-bbafb6c13c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:58.878419 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488acf5-9f45-4e7a-971f-bbafb6c13c42 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:58.894301 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1417/2820] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:26:58.898439 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244815e-b71e-47a3-a537-7bb321436936 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:58.908314 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244815e-b71e-47a3-a537-7bb321436936 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:58.913061 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec59ed9-9cbf-477f-8874-956476300385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:58.913922 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec59ed9-9cbf-477f-8874-956476300385 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:58.914201 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec59ed9-9cbf-477f-8874-956476300385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:58.914473 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec59ed9-9cbf-477f-8874-956476300385 admin admin] PATH_INFO: `/v3/projects/3a36bafa36314310bf05b87a89c55dd4/users/b9c09bfa6da34afe948ef21ae0a11284/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:58.929129 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec59ed9-9cbf-477f-8874-956476300385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a36bafa36314310bf05b87a89c55dd4, user_id=b9c09bfa6da34afe948ef21ae0a11284, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:58.931664 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec59ed9-9cbf-477f-8874-956476300385 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:58.944932 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1404/2821] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:26:58 2022] PUT /identity/v3/projects/3a36bafa36314310bf05b87a89c55dd4/users/b9c09bfa6da34afe948ef21ae0a11284/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:26:58.949966 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dc9f2-dc0d-426f-acf7-aa53d0ac7129 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:58.950468 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dc9f2-dc0d-426f-acf7-aa53d0ac7129 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:58.950577 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dc9f2-dc0d-426f-acf7-aa53d0ac7129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:58.967867 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-868dc9f2-dc0d-426f-acf7-aa53d0ac7129 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:26:58.969051 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-868dc9f2-dc0d-426f-acf7-aa53d0ac7129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:59.025800 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1418/2822] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:26:59.035332 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec59ed9-9cbf-477f-8874-956476300385 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:59.037031 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-6ec59ed9-9cbf-477f-8874-956476300385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:59.091646 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec59ed9-9cbf-477f-8874-956476300385 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:59.095435 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51450a5e-2662-4c8b-b2c1-b8dc06097c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:59.096102 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51450a5e-2662-4c8b-b2c1-b8dc06097c28 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:59.096384 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51450a5e-2662-4c8b-b2c1-b8dc06097c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:59.096655 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51450a5e-2662-4c8b-b2c1-b8dc06097c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:59.105767 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51450a5e-2662-4c8b-b2c1-b8dc06097c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:59.107209 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51450a5e-2662-4c8b-b2c1-b8dc06097c28 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:59.117184 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1405/2823] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:26:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:26:59.778503 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661f18f-f37b-4510-b6b9-becfe955ff37 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:59.778793 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661f18f-f37b-4510-b6b9-becfe955ff37 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:59.779123 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661f18f-f37b-4510-b6b9-becfe955ff37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:59.805213 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-e661f18f-f37b-4510-b6b9-becfe955ff37 None None] MFA Rules not processed for user `b9c09bfa6da34afe948ef21ae0a11284`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:26:59.806431 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-e661f18f-f37b-4510-b6b9-becfe955ff37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:59.876735 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1419/2824] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:26:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:26:59.886003 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51450a5e-2662-4c8b-b2c1-b8dc06097c28 service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:26:59.887929 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-51450a5e-2662-4c8b-b2c1-b8dc06097c28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:26:59.944101 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51450a5e-2662-4c8b-b2c1-b8dc06097c28 service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:26:59.947605 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbb103-4ff2-4425-9255-e27758981b20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:26:59.948276 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbb103-4ff2-4425-9255-e27758981b20 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:26:59.948560 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbb103-4ff2-4425-9255-e27758981b20 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:26:59.948903 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbb103-4ff2-4425-9255-e27758981b20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:26:59.957479 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbb103-4ff2-4425-9255-e27758981b20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:26:59.958884 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbb103-4ff2-4425-9255-e27758981b20 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:26:59.968147 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1406/2825] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:26:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:27:01.294826 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51448ad3-5f4c-4c15-a886-58144586691c None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:27:01.295915 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51448ad3-5f4c-4c15-a886-58144586691c None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:27:01.296075 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51448ad3-5f4c-4c15-a886-58144586691c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:27:01.313420 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-51448ad3-5f4c-4c15-a886-58144586691c None None] MFA Rules not processed for user `b9c09bfa6da34afe948ef21ae0a11284`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:27:01.314604 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-51448ad3-5f4c-4c15-a886-58144586691c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:27:01.321349 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1420/2826] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:27:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:27:01.548383 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbb103-4ff2-4425-9255-e27758981b20 service cinder] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:27:01.549753 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-44bbb103-4ff2-4425-9255-e27758981b20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:27:01.561540 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbb103-4ff2-4425-9255-e27758981b20 service cinder] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:27:01.564973 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d22eb-7ad9-454b-be66-17273f07faeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:27:01.565597 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d22eb-7ad9-454b-be66-17273f07faeb service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:27:01.565885 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d22eb-7ad9-454b-be66-17273f07faeb service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:27:01.566159 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d22eb-7ad9-454b-be66-17273f07faeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:27:01.567859 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-f71d22eb-7ad9-454b-be66-17273f07faeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:27:01.576876 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d22eb-7ad9-454b-be66-17273f07faeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:27:01.578282 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d22eb-7ad9-454b-be66-17273f07faeb service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:27:01.585974 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1407/2827] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:27:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:27:02.634347 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51448ad3-5f4c-4c15-a886-58144586691c None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:27:02.635759 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-51448ad3-5f4c-4c15-a886-58144586691c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:27:02.710933 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51448ad3-5f4c-4c15-a886-58144586691c None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:27:02.716557 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0189b9-1245-49cc-885c-44237a4ecbf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:27:02.717117 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0189b9-1245-49cc-885c-44237a4ecbf5 service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:27:02.717487 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0189b9-1245-49cc-885c-44237a4ecbf5 service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:27:02.717823 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0189b9-1245-49cc-885c-44237a4ecbf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:27:02.719548 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-5c0189b9-1245-49cc-885c-44237a4ecbf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:27:02.731764 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0189b9-1245-49cc-885c-44237a4ecbf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:27:02.734049 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0189b9-1245-49cc-885c-44237a4ecbf5 service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:27:02.744150 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1421/2828] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:27:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 23:27:05.765275 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d22eb-7ad9-454b-be66-17273f07faeb service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:27:05.773634 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d22eb-7ad9-454b-be66-17273f07faeb service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:27:05.777187 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23a95a-8410-4bf5-84f3-fff825a5dc22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:27:05.777815 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23a95a-8410-4bf5-84f3-fff825a5dc22 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:27:05.778091 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23a95a-8410-4bf5-84f3-fff825a5dc22 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:27:05.778364 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23a95a-8410-4bf5-84f3-fff825a5dc22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:27:05.780700 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-6a23a95a-8410-4bf5-84f3-fff825a5dc22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:27:05.838940 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23a95a-8410-4bf5-84f3-fff825a5dc22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:27:05.840364 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23a95a-8410-4bf5-84f3-fff825a5dc22 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:27:05.850398 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1408/2829] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:27:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:28:24.243470 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d45679-d201-4cb6-9d71-1bc8a64af0ed None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:28:24.244004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d45679-d201-4cb6-9d71-1bc8a64af0ed None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:28:24.244239 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d45679-d201-4cb6-9d71-1bc8a64af0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:28:24.262946 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-b8d45679-d201-4cb6-9d71-1bc8a64af0ed None None] MFA Rules not processed for user `b9c09bfa6da34afe948ef21ae0a11284`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:28:24.264157 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-b8d45679-d201-4cb6-9d71-1bc8a64af0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:28:24.270828 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1422/2830] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:28:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:29:01.009920 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23a95a-8410-4bf5-84f3-fff825a5dc22 service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:01.011316 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-6a23a95a-8410-4bf5-84f3-fff825a5dc22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:29:01.145075 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23a95a-8410-4bf5-84f3-fff825a5dc22 service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:01.150036 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d8510-2c9a-4a12-831a-c12694a5edb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f5243eef2a24a518b30526425c0b2c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:01.150673 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d8510-2c9a-4a12-831a-c12694a5edb6 service placement] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:01.150961 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d8510-2c9a-4a12-831a-c12694a5edb6 service placement] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:01.151233 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d8510-2c9a-4a12-831a-c12694a5edb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:01.152969 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-765d8510-2c9a-4a12-831a-c12694a5edb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:29:01.163961 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d8510-2c9a-4a12-831a-c12694a5edb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:01.165501 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d8510-2c9a-4a12-831a-c12694a5edb6 service placement] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:01.174935 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1409/2831] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:29:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:29:25.246600 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d45679-d201-4cb6-9d71-1bc8a64af0ed None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:25.294810 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d45679-d201-4cb6-9d71-1bc8a64af0ed None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:25.299447 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a4d30-49d1-4541-8ec8-b96b48e2b144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:25.300351 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a4d30-49d1-4541-8ec8-b96b48e2b144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:25.300799 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a4d30-49d1-4541-8ec8-b96b48e2b144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:25.301727 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a4d30-49d1-4541-8ec8-b96b48e2b144 admin admin] PATH_INFO: `/v3/users/b9c09bfa6da34afe948ef21ae0a11284` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:25.303244 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a4d30-49d1-4541-8ec8-b96b48e2b144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c09bfa6da34afe948ef21ae0a11284)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:25.305281 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a4d30-49d1-4541-8ec8-b96b48e2b144 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:25.355156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7b5a4d30-49d1-4541-8ec8-b96b48e2b144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c09bfa6da34afe948ef21ae0a11284'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:29:25.367004 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7b5a4d30-49d1-4541-8ec8-b96b48e2b144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c09bfa6da34afe948ef21ae0a11284'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:29:25.367736 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7b5a4d30-49d1-4541-8ec8-b96b48e2b144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c09bfa6da34afe948ef21ae0a11284'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:29:25.375691 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7b5a4d30-49d1-4541-8ec8-b96b48e2b144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c09bfa6da34afe948ef21ae0a11284'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:29:25.376389 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-7b5a4d30-49d1-4541-8ec8-b96b48e2b144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c09bfa6da34afe948ef21ae0a11284'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:29:25.389801 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1423/2832] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:29:25 2022] DELETE /identity/v3/users/b9c09bfa6da34afe948ef21ae0a11284 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:29:25.573636 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d8510-2c9a-4a12-831a-c12694a5edb6 service placement] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:25.584646 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d8510-2c9a-4a12-831a-c12694a5edb6 service placement] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:25.639372 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58332d-32ad-4bea-a822-b8b51d09cb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:25.640504 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58332d-32ad-4bea-a822-b8b51d09cb79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:25.640637 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58332d-32ad-4bea-a822-b8b51d09cb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:25.640801 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58332d-32ad-4bea-a822-b8b51d09cb79 admin admin] PATH_INFO: `/v3/projects/3a36bafa36314310bf05b87a89c55dd4` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:25.641969 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58332d-32ad-4bea-a822-b8b51d09cb79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a36bafa36314310bf05b87a89c55dd4)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:25.643884 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58332d-32ad-4bea-a822-b8b51d09cb79 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:25.688516 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-2b58332d-32ad-4bea-a822-b8b51d09cb79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a36bafa36314310bf05b87a89c55dd4', 'request_id': 'req-2b58332d-32ad-4bea-a822-b8b51d09cb79'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:29:25.695978 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-2b58332d-32ad-4bea-a822-b8b51d09cb79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a36bafa36314310bf05b87a89c55dd4', 'request_id': 'req-2b58332d-32ad-4bea-a822-b8b51d09cb79'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:29:25.701195 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-2b58332d-32ad-4bea-a822-b8b51d09cb79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a36bafa36314310bf05b87a89c55dd4', 'request_id': 'req-2b58332d-32ad-4bea-a822-b8b51d09cb79'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:29:25.723187 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-2b58332d-32ad-4bea-a822-b8b51d09cb79 admin admin] The token cache is being invalidate because project 3a36bafa36314310bf05b87a89c55dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:29:25.723471 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-2b58332d-32ad-4bea-a822-b8b51d09cb79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:29:25.724147 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-2b58332d-32ad-4bea-a822-b8b51d09cb79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:29:25.725636 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1410/2833] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:29:25 2022] DELETE /identity/v3/projects/3a36bafa36314310bf05b87a89c55dd4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:29:25.730766 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e319f-40c7-467a-ba01-ba666c306d54 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:25.731087 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e319f-40c7-467a-ba01-ba666c306d54 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:25.731362 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e319f-40c7-467a-ba01-ba666c306d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:25.788645 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-725e319f-40c7-467a-ba01-ba666c306d54 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:29:25.789849 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-725e319f-40c7-467a-ba01-ba666c306d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:29:25.845078 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1424/2834] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:29:25.853367 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ef59f-8fb9-4228-9d2d-b5e1389366bf None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:25.853653 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ef59f-8fb9-4228-9d2d-b5e1389366bf None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:25.853928 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ef59f-8fb9-4228-9d2d-b5e1389366bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:25.871955 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-733ef59f-8fb9-4228-9d2d-b5e1389366bf None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:29:25.873164 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-733ef59f-8fb9-4228-9d2d-b5e1389366bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:29:25.881797 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1411/2835] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:29:25.885829 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e319f-40c7-467a-ba01-ba666c306d54 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:25.895251 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e319f-40c7-467a-ba01-ba666c306d54 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:25.899694 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecab0e-ea38-434d-a6e5-3a737fa2196a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:25.900354 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecab0e-ea38-434d-a6e5-3a737fa2196a admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:25.900633 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecab0e-ea38-434d-a6e5-3a737fa2196a admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:25.900904 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecab0e-ea38-434d-a6e5-3a737fa2196a admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:25.901694 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecab0e-ea38-434d-a6e5-3a737fa2196a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:29:25.901993 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecab0e-ea38-434d-a6e5-3a737fa2196a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:25.903542 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecab0e-ea38-434d-a6e5-3a737fa2196a admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:25.914869 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1425/2836] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:29:25.919098 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ef59f-8fb9-4228-9d2d-b5e1389366bf None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:25.928804 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ef59f-8fb9-4228-9d2d-b5e1389366bf None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:25.933447 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3a595-85cd-4db7-b8a3-4fe6174c0ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:25.934080 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3a595-85cd-4db7-b8a3-4fe6174c0ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:25.934362 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3a595-85cd-4db7-b8a3-4fe6174c0ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:25.934632 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3a595-85cd-4db7-b8a3-4fe6174c0ec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:25.935324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3a595-85cd-4db7-b8a3-4fe6174c0ec4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:25.937213 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3a595-85cd-4db7-b8a3-4fe6174c0ec4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:25.963641 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1412/2837] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:29:25 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:29:25.967694 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecab0e-ea38-434d-a6e5-3a737fa2196a admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:25.977340 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecab0e-ea38-434d-a6e5-3a737fa2196a admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:26.031200 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b4869-9e72-4793-a1c7-37f9b1b6a641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:26.031881 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b4869-9e72-4793-a1c7-37f9b1b6a641 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:26.032168 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b4869-9e72-4793-a1c7-37f9b1b6a641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:26.032448 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b4869-9e72-4793-a1c7-37f9b1b6a641 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:26.033156 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b4869-9e72-4793-a1c7-37f9b1b6a641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:26.035661 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b4869-9e72-4793-a1c7-37f9b1b6a641 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:26.056032 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1426/2838] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:29:25 2022] POST /identity/v3/users => generated 296 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:29:26.060164 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3a595-85cd-4db7-b8a3-4fe6174c0ec4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:26.070438 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3a595-85cd-4db7-b8a3-4fe6174c0ec4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:26.075045 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e067ed-6715-4e7e-ac49-fbc656ec05f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:26.075697 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e067ed-6715-4e7e-ac49-fbc656ec05f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:26.076013 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e067ed-6715-4e7e-ac49-fbc656ec05f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:26.076291 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e067ed-6715-4e7e-ac49-fbc656ec05f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:26.077023 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e067ed-6715-4e7e-ac49-fbc656ec05f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:26.078600 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e067ed-6715-4e7e-ac49-fbc656ec05f6 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:26.088813 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1413/2839] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:29:26.092750 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b4869-9e72-4793-a1c7-37f9b1b6a641 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:26.103228 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b4869-9e72-4793-a1c7-37f9b1b6a641 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:26.107765 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b63d16-89a8-49df-ab61-a77fa7e68071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:26.108549 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b63d16-89a8-49df-ab61-a77fa7e68071 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:26.108839 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b63d16-89a8-49df-ab61-a77fa7e68071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:26.109115 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b63d16-89a8-49df-ab61-a77fa7e68071 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:26.109851 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b63d16-89a8-49df-ab61-a77fa7e68071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:26.111429 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b63d16-89a8-49df-ab61-a77fa7e68071 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:26.121887 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1427/2840] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:29:26.125899 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e067ed-6715-4e7e-ac49-fbc656ec05f6 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:26.135578 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e067ed-6715-4e7e-ac49-fbc656ec05f6 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:26.140075 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546afb9-106e-4c2a-83f1-ff8ee0c6847e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:26.140933 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546afb9-106e-4c2a-83f1-ff8ee0c6847e admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:26.141211 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546afb9-106e-4c2a-83f1-ff8ee0c6847e admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:26.141482 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546afb9-106e-4c2a-83f1-ff8ee0c6847e admin admin] PATH_INFO: `/v3/projects/424ec434b12a434095a0220d7d1266fc/users/bf919cf3873d4ff3a960cb0bb21c7544/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:26.155671 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546afb9-106e-4c2a-83f1-ff8ee0c6847e admin admin] RBAC: Authorizing `identity:create_grant(project_id=424ec434b12a434095a0220d7d1266fc, user_id=bf919cf3873d4ff3a960cb0bb21c7544, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:26.158320 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546afb9-106e-4c2a-83f1-ff8ee0c6847e admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:26.170983 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1414/2841] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:29:26 2022] PUT /identity/v3/projects/424ec434b12a434095a0220d7d1266fc/users/bf919cf3873d4ff3a960cb0bb21c7544/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:29:26.182282 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a069c-b909-40a9-b86b-25231ff97517 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:26.182570 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a069c-b909-40a9-b86b-25231ff97517 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:26.182846 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a069c-b909-40a9-b86b-25231ff97517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:26.208469 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-567a069c-b909-40a9-b86b-25231ff97517 None None] MFA Rules not processed for user `bf919cf3873d4ff3a960cb0bb21c7544`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:29:26.209638 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-567a069c-b909-40a9-b86b-25231ff97517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:29:26.271556 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1428/2842] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:29:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:29:26.281058 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546afb9-106e-4c2a-83f1-ff8ee0c6847e admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:26.282750 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-7546afb9-106e-4c2a-83f1-ff8ee0c6847e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:29:26.357603 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546afb9-106e-4c2a-83f1-ff8ee0c6847e admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:26.361313 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e01a4-db51-45f4-a621-2e115fd94ad9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:26.361952 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e01a4-db51-45f4-a621-2e115fd94ad9 service cinder] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:26.362231 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e01a4-db51-45f4-a621-2e115fd94ad9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:26.362502 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e01a4-db51-45f4-a621-2e115fd94ad9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:26.371306 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e01a4-db51-45f4-a621-2e115fd94ad9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:26.372739 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e01a4-db51-45f4-a621-2e115fd94ad9 service cinder] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:26.381626 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1415/2843] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:29:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:29:47.473952 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a069c-b909-40a9-b86b-25231ff97517 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:47.534493 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a069c-b909-40a9-b86b-25231ff97517 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:47.538950 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8546da-4eac-4f1e-a77f-1396a1e41a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:47.539802 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8546da-4eac-4f1e-a77f-1396a1e41a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:47.540112 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8546da-4eac-4f1e-a77f-1396a1e41a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:47.540391 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8546da-4eac-4f1e-a77f-1396a1e41a8c admin admin] PATH_INFO: `/v3/users/bf919cf3873d4ff3a960cb0bb21c7544` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:47.541575 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8546da-4eac-4f1e-a77f-1396a1e41a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf919cf3873d4ff3a960cb0bb21c7544)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:47.543457 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8546da-4eac-4f1e-a77f-1396a1e41a8c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:47.588781 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-db8546da-4eac-4f1e-a77f-1396a1e41a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf919cf3873d4ff3a960cb0bb21c7544'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:29:47.600647 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-db8546da-4eac-4f1e-a77f-1396a1e41a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf919cf3873d4ff3a960cb0bb21c7544'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:29:47.601299 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-db8546da-4eac-4f1e-a77f-1396a1e41a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf919cf3873d4ff3a960cb0bb21c7544'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:29:47.608521 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-db8546da-4eac-4f1e-a77f-1396a1e41a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf919cf3873d4ff3a960cb0bb21c7544'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:29:47.609144 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-db8546da-4eac-4f1e-a77f-1396a1e41a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf919cf3873d4ff3a960cb0bb21c7544'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:29:47.621204 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1429/2844] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:29:47 2022] DELETE /identity/v3/users/bf919cf3873d4ff3a960cb0bb21c7544 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:29:47.625909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73aeb34-4b4a-4c7a-be44-c3ed61391c7b None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:47.626406 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73aeb34-4b4a-4c7a-be44-c3ed61391c7b None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:47.626509 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73aeb34-4b4a-4c7a-be44-c3ed61391c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:47.643532 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-b73aeb34-4b4a-4c7a-be44-c3ed61391c7b None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:29:47.644721 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-b73aeb34-4b4a-4c7a-be44-c3ed61391c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:29:47.703462 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1416/2845] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:29:47.713560 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8546da-4eac-4f1e-a77f-1396a1e41a8c admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:47.715006 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-db8546da-4eac-4f1e-a77f-1396a1e41a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:29:47.792676 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8546da-4eac-4f1e-a77f-1396a1e41a8c admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:47.796263 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675a54f-580a-41fd-84b3-e7f63d273ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:47.797531 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675a54f-580a-41fd-84b3-e7f63d273ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:47.797531 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675a54f-580a-41fd-84b3-e7f63d273ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:47.797531 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675a54f-580a-41fd-84b3-e7f63d273ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:47.807007 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675a54f-580a-41fd-84b3-e7f63d273ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:47.808465 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675a54f-580a-41fd-84b3-e7f63d273ee3 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:47.818359 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1430/2846] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:29:48.079319 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73aeb34-4b4a-4c7a-be44-c3ed61391c7b None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:48.079319 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-b73aeb34-4b4a-4c7a-be44-c3ed61391c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:29:48.090491 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73aeb34-4b4a-4c7a-be44-c3ed61391c7b None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:48.095107 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a28da-1da3-4c19-a44d-dec250ba2b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:48.096723 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a28da-1da3-4c19-a44d-dec250ba2b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:48.097009 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a28da-1da3-4c19-a44d-dec250ba2b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:48.097301 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a28da-1da3-4c19-a44d-dec250ba2b76 admin admin] PATH_INFO: `/v3/projects/424ec434b12a434095a0220d7d1266fc` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:48.098541 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a28da-1da3-4c19-a44d-dec250ba2b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=424ec434b12a434095a0220d7d1266fc)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:48.100465 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a28da-1da3-4c19-a44d-dec250ba2b76 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:48.147002 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-338a28da-1da3-4c19-a44d-dec250ba2b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '424ec434b12a434095a0220d7d1266fc', 'request_id': 'req-338a28da-1da3-4c19-a44d-dec250ba2b76'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:29:48.153924 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-338a28da-1da3-4c19-a44d-dec250ba2b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '424ec434b12a434095a0220d7d1266fc', 'request_id': 'req-338a28da-1da3-4c19-a44d-dec250ba2b76'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:29:48.160025 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-338a28da-1da3-4c19-a44d-dec250ba2b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '424ec434b12a434095a0220d7d1266fc', 'request_id': 'req-338a28da-1da3-4c19-a44d-dec250ba2b76'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:29:48.170643 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-338a28da-1da3-4c19-a44d-dec250ba2b76 admin admin] The token cache is being invalidate because project 424ec434b12a434095a0220d7d1266fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:29:48.170925 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-338a28da-1da3-4c19-a44d-dec250ba2b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:29:48.171541 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-338a28da-1da3-4c19-a44d-dec250ba2b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:29:48.173071 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1417/2847] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:29:48 2022] DELETE /identity/v3/projects/424ec434b12a434095a0220d7d1266fc => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:29:48.178946 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde6159-cb5f-407f-afb6-3a7cc1009cd6 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:48.179236 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde6159-cb5f-407f-afb6-3a7cc1009cd6 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:48.179510 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde6159-cb5f-407f-afb6-3a7cc1009cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:48.197136 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-3fde6159-cb5f-407f-afb6-3a7cc1009cd6 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:29:48.198303 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-3fde6159-cb5f-407f-afb6-3a7cc1009cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:29:48.254152 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1431/2848] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:29:48.261905 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413764f7-5c36-4c9f-b8a1-30a6fa5e5c6c None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:48.262190 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413764f7-5c36-4c9f-b8a1-30a6fa5e5c6c None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:48.262463 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413764f7-5c36-4c9f-b8a1-30a6fa5e5c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:48.280477 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-413764f7-5c36-4c9f-b8a1-30a6fa5e5c6c None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:29:48.281633 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-413764f7-5c36-4c9f-b8a1-30a6fa5e5c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:29:48.289853 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1418/2849] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:29:48.293923 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde6159-cb5f-407f-afb6-3a7cc1009cd6 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:48.303359 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde6159-cb5f-407f-afb6-3a7cc1009cd6 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:48.307856 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886239f-435b-4deb-990e-5b54e81ba2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:48.308499 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886239f-435b-4deb-990e-5b54e81ba2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:48.308780 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886239f-435b-4deb-990e-5b54e81ba2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:48.309052 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886239f-435b-4deb-990e-5b54e81ba2e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:48.309781 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886239f-435b-4deb-990e-5b54e81ba2e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 23:29:48.310087 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886239f-435b-4deb-990e-5b54e81ba2e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:48.311658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886239f-435b-4deb-990e-5b54e81ba2e8 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:48.322652 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1432/2850] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Feb 10 23:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 23:29:48.326798 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413764f7-5c36-4c9f-b8a1-30a6fa5e5c6c None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:48.336226 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413764f7-5c36-4c9f-b8a1-30a6fa5e5c6c None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:48.340699 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d1c2b-4a91-42f1-8e74-d2b6560f0587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:48.341336 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d1c2b-4a91-42f1-8e74-d2b6560f0587 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:48.341614 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d1c2b-4a91-42f1-8e74-d2b6560f0587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:48.341886 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d1c2b-4a91-42f1-8e74-d2b6560f0587 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:48.342568 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d1c2b-4a91-42f1-8e74-d2b6560f0587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:48.344449 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d1c2b-4a91-42f1-8e74-d2b6560f0587 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:48.369122 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1419/2851] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:29:48 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:29:48.373331 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886239f-435b-4deb-990e-5b54e81ba2e8 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:48.383000 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886239f-435b-4deb-990e-5b54e81ba2e8 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:48.437645 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece199c-681a-444b-bda5-b6410a489d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:48.438301 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece199c-681a-444b-bda5-b6410a489d5f admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:48.438585 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece199c-681a-444b-bda5-b6410a489d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:48.438861 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece199c-681a-444b-bda5-b6410a489d5f admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:48.439578 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece199c-681a-444b-bda5-b6410a489d5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:48.441569 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece199c-681a-444b-bda5-b6410a489d5f admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:48.461523 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1433/2852] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:29:48 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:29:48.465820 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d1c2b-4a91-42f1-8e74-d2b6560f0587 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:48.476754 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d1c2b-4a91-42f1-8e74-d2b6560f0587 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:48.481215 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e9c3c-2b6b-4ed1-8c88-b7e4ec522dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:48.481855 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e9c3c-2b6b-4ed1-8c88-b7e4ec522dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:48.482137 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e9c3c-2b6b-4ed1-8c88-b7e4ec522dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:48.482410 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e9c3c-2b6b-4ed1-8c88-b7e4ec522dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:48.483155 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e9c3c-2b6b-4ed1-8c88-b7e4ec522dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:48.484760 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e9c3c-2b6b-4ed1-8c88-b7e4ec522dd2 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:48.495436 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1420/2853] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:29:48.499285 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece199c-681a-444b-bda5-b6410a489d5f admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:48.509425 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece199c-681a-444b-bda5-b6410a489d5f admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:48.513970 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd50bb1-b7e5-4640-9a66-166f01548647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:48.514607 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd50bb1-b7e5-4640-9a66-166f01548647 admin admin] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:48.514897 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd50bb1-b7e5-4640-9a66-166f01548647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:48.515174 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd50bb1-b7e5-4640-9a66-166f01548647 admin admin] PATH_INFO: `/v3/roles` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:48.515934 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd50bb1-b7e5-4640-9a66-166f01548647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:48.517782 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd50bb1-b7e5-4640-9a66-166f01548647 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:48.527334 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1434/2854] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:29:48.531294 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e9c3c-2b6b-4ed1-8c88-b7e4ec522dd2 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:48.541555 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e9c3c-2b6b-4ed1-8c88-b7e4ec522dd2 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:48.546139 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644ebcd-5afc-4b7b-8fe9-092e47f8c912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:48.546997 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644ebcd-5afc-4b7b-8fe9-092e47f8c912 admin admin] REQUEST_METHOD: `PUT` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:48.547277 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644ebcd-5afc-4b7b-8fe9-092e47f8c912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:48.547551 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644ebcd-5afc-4b7b-8fe9-092e47f8c912 admin admin] PATH_INFO: `/v3/projects/42cc48a71496497b9adb74c8f5cf683f/users/a61061fb36904e87b071fbb32b021d88/roles/419ebcf5b1d8470394e463c9f01cb154` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:48.562020 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644ebcd-5afc-4b7b-8fe9-092e47f8c912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42cc48a71496497b9adb74c8f5cf683f, user_id=a61061fb36904e87b071fbb32b021d88, role_id=419ebcf5b1d8470394e463c9f01cb154)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:48.564963 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644ebcd-5afc-4b7b-8fe9-092e47f8c912 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:48.577318 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1421/2855] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:29:48 2022] PUT /identity/v3/projects/42cc48a71496497b9adb74c8f5cf683f/users/a61061fb36904e87b071fbb32b021d88/roles/419ebcf5b1d8470394e463c9f01cb154 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:29:48.582693 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155559f4-de8f-4df4-a9c0-57c940c5ee10 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:48.582988 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155559f4-de8f-4df4-a9c0-57c940c5ee10 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:48.583268 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155559f4-de8f-4df4-a9c0-57c940c5ee10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:48.601296 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-155559f4-de8f-4df4-a9c0-57c940c5ee10 None None] MFA Rules not processed for user `93804c035bb74a079b9cb29e5d154621`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:29:48.602723 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-155559f4-de8f-4df4-a9c0-57c940c5ee10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:29:48.659428 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1435/2856] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:29:48.669173 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644ebcd-5afc-4b7b-8fe9-092e47f8c912 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:48.670835 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-3644ebcd-5afc-4b7b-8fe9-092e47f8c912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:29:48.726336 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644ebcd-5afc-4b7b-8fe9-092e47f8c912 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:48.730261 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fe05a-83d1-4433-bf90-7c5fcd23dcc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:48.730898 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fe05a-83d1-4433-bf90-7c5fcd23dcc9 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:48.731185 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fe05a-83d1-4433-bf90-7c5fcd23dcc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:48.731468 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fe05a-83d1-4433-bf90-7c5fcd23dcc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:48.740437 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fe05a-83d1-4433-bf90-7c5fcd23dcc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:48.741851 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fe05a-83d1-4433-bf90-7c5fcd23dcc9 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:48.751020 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1422/2857] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:29:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:29:52.723731 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c07a72-61d5-47b9-ace2-7ad7da3c178e None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:52.724603 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c07a72-61d5-47b9-ace2-7ad7da3c178e None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:52.725071 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c07a72-61d5-47b9-ace2-7ad7da3c178e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:52.758594 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-41c07a72-61d5-47b9-ace2-7ad7da3c178e None None] MFA Rules not processed for user `a61061fb36904e87b071fbb32b021d88`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:29:52.759799 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-41c07a72-61d5-47b9-ace2-7ad7da3c178e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:29:52.834240 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1436/2858] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:29:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:29:52.838492 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fe05a-83d1-4433-bf90-7c5fcd23dcc9 service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:52.849079 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fe05a-83d1-4433-bf90-7c5fcd23dcc9 service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:52.854506 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ead1d-b49e-4686-a7fe-ba4ea6e1d8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:52.855152 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ead1d-b49e-4686-a7fe-ba4ea6e1d8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:52.855435 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ead1d-b49e-4686-a7fe-ba4ea6e1d8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:52.855707 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ead1d-b49e-4686-a7fe-ba4ea6e1d8c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:52.856509 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ead1d-b49e-4686-a7fe-ba4ea6e1d8c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:52.858382 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ead1d-b49e-4686-a7fe-ba4ea6e1d8c4 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:52.888888 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1423/2859] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Feb 10 23:29:52 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 23:29:52.893628 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c07a72-61d5-47b9-ace2-7ad7da3c178e None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:52.904700 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c07a72-61d5-47b9-ace2-7ad7da3c178e None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:52.976859 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5bd2f-c718-4771-a397-a24073c1f9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:52.977524 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5bd2f-c718-4771-a397-a24073c1f9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:52.977807 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5bd2f-c718-4771-a397-a24073c1f9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:52.978074 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5bd2f-c718-4771-a397-a24073c1f9c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:52.978781 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5bd2f-c718-4771-a397-a24073c1f9c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:52.980748 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5bd2f-c718-4771-a397-a24073c1f9c9 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:53.004399 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1437/2860] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Feb 10 23:29:52 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 23:29:53.008514 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ead1d-b49e-4686-a7fe-ba4ea6e1d8c4 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:53.019886 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ead1d-b49e-4686-a7fe-ba4ea6e1d8c4 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:53.024849 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a604d-b5aa-48ee-b967-33c72a9c212f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:53.025550 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a604d-b5aa-48ee-b967-33c72a9c212f admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:53.025833 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a604d-b5aa-48ee-b967-33c72a9c212f admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:53.026107 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a604d-b5aa-48ee-b967-33c72a9c212f admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:53.026848 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a604d-b5aa-48ee-b967-33c72a9c212f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:53.028518 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a604d-b5aa-48ee-b967-33c72a9c212f admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:53.040357 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1424/2861] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:29:53.044617 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5bd2f-c718-4771-a397-a24073c1f9c9 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:53.054852 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5bd2f-c718-4771-a397-a24073c1f9c9 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:53.059880 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087745bc-9168-4c54-bddc-ef3330654dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:53.060502 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087745bc-9168-4c54-bddc-ef3330654dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:53.061271 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087745bc-9168-4c54-bddc-ef3330654dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:53.061271 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087745bc-9168-4c54-bddc-ef3330654dc3 admin admin] PATH_INFO: `/v3/projects/44e9b574db284879b75c9ec6ecad8b5a/users/a3a20adb16584bfdaaba55908dcc10bc/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:53.077643 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087745bc-9168-4c54-bddc-ef3330654dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e9b574db284879b75c9ec6ecad8b5a, user_id=a3a20adb16584bfdaaba55908dcc10bc, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:53.081189 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087745bc-9168-4c54-bddc-ef3330654dc3 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:53.097058 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1438/2862] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:29:53 2022] PUT /identity/v3/projects/44e9b574db284879b75c9ec6ecad8b5a/users/a3a20adb16584bfdaaba55908dcc10bc/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:29:53.100983 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a604d-b5aa-48ee-b967-33c72a9c212f admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:53.111467 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a604d-b5aa-48ee-b967-33c72a9c212f admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:53.170093 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bf19f-bed1-4cb5-98bd-86b32cd07845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:53.170864 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bf19f-bed1-4cb5-98bd-86b32cd07845 admin admin] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:53.171067 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bf19f-bed1-4cb5-98bd-86b32cd07845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:53.171342 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bf19f-bed1-4cb5-98bd-86b32cd07845 admin admin] PATH_INFO: `/v3/roles` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:53.172121 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bf19f-bed1-4cb5-98bd-86b32cd07845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:53.173789 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bf19f-bed1-4cb5-98bd-86b32cd07845 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:53.184326 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1425/2863] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Feb 10 23:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 23:29:53.188510 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087745bc-9168-4c54-bddc-ef3330654dc3 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:53.199583 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087745bc-9168-4c54-bddc-ef3330654dc3 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:53.204324 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851ab19-0ebe-4667-bfe3-faa16298bb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:53.205827 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851ab19-0ebe-4667-bfe3-faa16298bb4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:53.206110 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851ab19-0ebe-4667-bfe3-faa16298bb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:53.206387 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851ab19-0ebe-4667-bfe3-faa16298bb4e admin admin] PATH_INFO: `/v3/projects/44e9b574db284879b75c9ec6ecad8b5a/users/a3a20adb16584bfdaaba55908dcc10bc/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:53.208466 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851ab19-0ebe-4667-bfe3-faa16298bb4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e9b574db284879b75c9ec6ecad8b5a, user_id=a3a20adb16584bfdaaba55908dcc10bc, role_id=c6b17d0da3644bfbad8cc4ed68ea8b9f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:53.211117 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851ab19-0ebe-4667-bfe3-faa16298bb4e admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:53.222218 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1439/2864] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Feb 10 23:29:53 2022] PUT /identity/v3/projects/44e9b574db284879b75c9ec6ecad8b5a/users/a3a20adb16584bfdaaba55908dcc10bc/roles/c6b17d0da3644bfbad8cc4ed68ea8b9f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:29:57.633211 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f58095-ef06-48b7-84fe-2e8a176e353a None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:57.633757 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f58095-ef06-48b7-84fe-2e8a176e353a None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:57.633757 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f58095-ef06-48b7-84fe-2e8a176e353a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:57.660647 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-03f58095-ef06-48b7-84fe-2e8a176e353a None None] MFA Rules not processed for user `a3a20adb16584bfdaaba55908dcc10bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:29:57.661887 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-03f58095-ef06-48b7-84fe-2e8a176e353a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:29:57.749586 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1426/2865] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:29:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:29:57.764040 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851ab19-0ebe-4667-bfe3-faa16298bb4e admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:57.765946 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-b851ab19-0ebe-4667-bfe3-faa16298bb4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:29:57.851772 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851ab19-0ebe-4667-bfe3-faa16298bb4e admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:57.855558 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa8ff9-eeb3-4930-966b-fc991f1bdf27 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd367d4b48c634351a427f2f1b468d4ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:57.856246 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa8ff9-eeb3-4930-966b-fc991f1bdf27 service glance] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:57.856531 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa8ff9-eeb3-4930-966b-fc991f1bdf27 service glance] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:57.856804 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa8ff9-eeb3-4930-966b-fc991f1bdf27 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:57.917045 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa8ff9-eeb3-4930-966b-fc991f1bdf27 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:57.918401 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa8ff9-eeb3-4930-966b-fc991f1bdf27 service glance] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:57.928592 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1440/2866] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:29:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:29:58.031222 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73942334-75f8-4581-8381-69ccba7eebff None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:58.031222 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73942334-75f8-4581-8381-69ccba7eebff None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:58.031591 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73942334-75f8-4581-8381-69ccba7eebff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:58.103307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-73942334-75f8-4581-8381-69ccba7eebff None None] MFA Rules not processed for user `9dca4ea4f2c8490e823a73dca6c303ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:29:58.104677 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-73942334-75f8-4581-8381-69ccba7eebff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:29:58.216234 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1427/2867] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Feb 10 23:29:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 23:29:58.275566 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa8ff9-eeb3-4930-966b-fc991f1bdf27 service glance] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:29:58.277017 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-31fa8ff9-eeb3-4930-966b-fc991f1bdf27 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:29:58.406081 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa8ff9-eeb3-4930-966b-fc991f1bdf27 service glance] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:29:58.417546 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbe2de-7ab1-41ef-be2b-ec8af368d432 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce55b64dc528447993e32b00ae4d3a2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:29:58.418218 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe2de-7ab1-41ef-be2b-ec8af368d432 service swift] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:29:58.418504 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe2de-7ab1-41ef-be2b-ec8af368d432 service swift] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:29:58.418889 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe2de-7ab1-41ef-be2b-ec8af368d432 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:29:58.429315 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbe2de-7ab1-41ef-be2b-ec8af368d432 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:29:58.430764 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbe2de-7ab1-41ef-be2b-ec8af368d432 service swift] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:29:58.443027 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1441/2868] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Feb 10 23:29:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:30:03.262060 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203da0a5-9b4d-473c-b37c-75dd3ef529fc None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:30:03.262617 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203da0a5-9b4d-473c-b37c-75dd3ef529fc None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:30:03.262617 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203da0a5-9b4d-473c-b37c-75dd3ef529fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:30:03.289259 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-203da0a5-9b4d-473c-b37c-75dd3ef529fc None None] MFA Rules not processed for user `90e38b215fc34b759e71c933c1a08eec`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:30:03.291028 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-203da0a5-9b4d-473c-b37c-75dd3ef529fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:30:03.369225 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1428/2869] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:30:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:30:03.874312 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbe2de-7ab1-41ef-be2b-ec8af368d432 service swift] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:30:03.958374 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbe2de-7ab1-41ef-be2b-ec8af368d432 service swift] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:30:03.962162 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d757e6-5081-4aa5-ace8-5460a902d8e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:30:03.962766 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d757e6-5081-4aa5-ace8-5460a902d8e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:30:03.963048 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d757e6-5081-4aa5-ace8-5460a902d8e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:30:03.963450 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d757e6-5081-4aa5-ace8-5460a902d8e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:30:03.970377 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d5d757e6-5081-4aa5-ace8-5460a902d8e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:30:03.984148 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d757e6-5081-4aa5-ace8-5460a902d8e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:30:03.986245 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d757e6-5081-4aa5-ace8-5460a902d8e9 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:30:03.996172 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1442/2870] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:30:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:30:09.168186 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db431dde-4f9c-4591-a58c-692cdd3725e1 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:30:09.168723 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db431dde-4f9c-4591-a58c-692cdd3725e1 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:30:09.168830 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db431dde-4f9c-4591-a58c-692cdd3725e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:30:09.186536 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-db431dde-4f9c-4591-a58c-692cdd3725e1 None None] MFA Rules not processed for user `a61061fb36904e87b071fbb32b021d88`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:30:09.188631 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-db431dde-4f9c-4591-a58c-692cdd3725e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:30:09.195348 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1429/2871] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:30:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:30:11.022199 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c68b8f-d25e-4422-ac0e-d52db5e785d3 None None] REQUEST_METHOD: `POST` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:30:11.022718 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c68b8f-d25e-4422-ac0e-d52db5e785d3 None None] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:30:11.022911 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c68b8f-d25e-4422-ac0e-d52db5e785d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:30:11.041107 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.auth.core [None req-a7c68b8f-d25e-4422-ac0e-d52db5e785d3 None None] MFA Rules not processed for user `9dca4ea4f2c8490e823a73dca6c303ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:30:11.042280 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a7c68b8f-d25e-4422-ac0e-d52db5e785d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:30:11.049993 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1443/2872] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Feb 10 23:30:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:30:11.063329 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db431dde-4f9c-4591-a58c-692cdd3725e1 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:30:11.075031 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db431dde-4f9c-4591-a58c-692cdd3725e1 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:30:11.085663 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534e790-49ca-4aeb-8814-5b991221c2b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce55b64dc528447993e32b00ae4d3a2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:30:11.086326 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534e790-49ca-4aeb-8814-5b991221c2b6 service swift] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:30:11.086606 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534e790-49ca-4aeb-8814-5b991221c2b6 service swift] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:30:11.087059 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534e790-49ca-4aeb-8814-5b991221c2b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:30:11.096316 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534e790-49ca-4aeb-8814-5b991221c2b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:30:11.097875 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534e790-49ca-4aeb-8814-5b991221c2b6 service swift] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:30:11.106133 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1430/2873] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Feb 10 23:30:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 23:30:40.666376 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c68b8f-d25e-4422-ac0e-d52db5e785d3 None None] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:30:40.667869 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-a7c68b8f-d25e-4422-ac0e-d52db5e785d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:30:40.679022 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c68b8f-d25e-4422-ac0e-d52db5e785d3 None None] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:30:40.682528 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea25fcf-4373-41d5-899b-ceb15d57f057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:30:40.683151 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea25fcf-4373-41d5-899b-ceb15d57f057 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:30:40.683433 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea25fcf-4373-41d5-899b-ceb15d57f057 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:30:40.683707 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea25fcf-4373-41d5-899b-ceb15d57f057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:30:40.685428 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-fea25fcf-4373-41d5-899b-ceb15d57f057 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:30:40.764726 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea25fcf-4373-41d5-899b-ceb15d57f057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:30:40.766064 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea25fcf-4373-41d5-899b-ceb15d57f057 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:30:40.785865 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1444/2874] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:30:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:30:40.914209 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534e790-49ca-4aeb-8814-5b991221c2b6 service swift] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:30:40.923949 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534e790-49ca-4aeb-8814-5b991221c2b6 service swift] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:30:40.927437 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db05c51-4274-4333-9f25-495d8730c933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:30:40.928125 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db05c51-4274-4333-9f25-495d8730c933 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:30:40.928413 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db05c51-4274-4333-9f25-495d8730c933 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:30:40.928691 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db05c51-4274-4333-9f25-495d8730c933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:30:40.938098 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db05c51-4274-4333-9f25-495d8730c933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:30:40.939501 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db05c51-4274-4333-9f25-495d8730c933 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:30:40.948716 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1431/2875] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:30:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:30:42.646461 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea25fcf-4373-41d5-899b-ceb15d57f057 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:30:42.655694 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea25fcf-4373-41d5-899b-ceb15d57f057 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:30:42.660012 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ddeff-c924-48fb-b2c0-29bb3dc92833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:30:42.660934 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ddeff-c924-48fb-b2c0-29bb3dc92833 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:30:42.661378 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ddeff-c924-48fb-b2c0-29bb3dc92833 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:30:42.661805 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ddeff-c924-48fb-b2c0-29bb3dc92833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:30:42.664545 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-348ddeff-c924-48fb-b2c0-29bb3dc92833 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:30:42.677631 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ddeff-c924-48fb-b2c0-29bb3dc92833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:30:42.679443 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ddeff-c924-48fb-b2c0-29bb3dc92833 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:30:42.689901 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1445/2876] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:30:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:30:44.241063 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db05c51-4274-4333-9f25-495d8730c933 service neutron] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:30:44.252141 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db05c51-4274-4333-9f25-495d8730c933 service neutron] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:30:44.255896 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e51716-ad70-4f26-9c5f-1c1c5698e605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:30:44.256545 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e51716-ad70-4f26-9c5f-1c1c5698e605 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:30:44.257028 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e51716-ad70-4f26-9c5f-1c1c5698e605 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:30:44.257307 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e51716-ad70-4f26-9c5f-1c1c5698e605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:30:44.259088 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-11e51716-ad70-4f26-9c5f-1c1c5698e605 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:30:44.273858 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e51716-ad70-4f26-9c5f-1c1c5698e605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:30:44.275977 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e51716-ad70-4f26-9c5f-1c1c5698e605 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:30:44.289045 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1432/2877] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:30:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:32:21.074614 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ddeff-c924-48fb-b2c0-29bb3dc92833 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:32:21.076030 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-348ddeff-c924-48fb-b2c0-29bb3dc92833 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:32:21.130602 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ddeff-c924-48fb-b2c0-29bb3dc92833 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:32:21.134456 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dd193-ef2e-4508-b827-4f8aecf5f0e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4899bdd65bb4cccae615cc5e8192388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:32:21.135092 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dd193-ef2e-4508-b827-4f8aecf5f0e7 service cinder] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:32:21.136065 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dd193-ef2e-4508-b827-4f8aecf5f0e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:32:21.136343 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dd193-ef2e-4508-b827-4f8aecf5f0e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:32:21.138204 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-af1dd193-ef2e-4508-b827-4f8aecf5f0e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:32:21.149057 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1dd193-ef2e-4508-b827-4f8aecf5f0e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:32:21.150529 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1dd193-ef2e-4508-b827-4f8aecf5f0e7 service cinder] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:32:21.159742 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1446/2878] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:32:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:32:32.063231 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74c2a4-f2c3-4d65-8c8e-26ea2d068590 None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:32:32.063730 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74c2a4-f2c3-4d65-8c8e-26ea2d068590 None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:32:32.063861 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74c2a4-f2c3-4d65-8c8e-26ea2d068590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:32:32.081559 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-9b74c2a4-f2c3-4d65-8c8e-26ea2d068590 None None] MFA Rules not processed for user `90e38b215fc34b759e71c933c1a08eec`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:32:32.082745 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-9b74c2a4-f2c3-4d65-8c8e-26ea2d068590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:32:32.090135 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1433/2879] 10.222.0.77 () {58 vars in 957 bytes} [Thu Feb 10 23:32:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:32:32.819195 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dd193-ef2e-4508-b827-4f8aecf5f0e7 service cinder] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:32:32.820797 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-af1dd193-ef2e-4508-b827-4f8aecf5f0e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:32:32.888879 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dd193-ef2e-4508-b827-4f8aecf5f0e7 service cinder] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:32:32.893781 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f0b7e-78bd-4807-a02f-fa198f5563dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f5243eef2a24a518b30526425c0b2c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:32:32.894424 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f0b7e-78bd-4807-a02f-fa198f5563dd service placement] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:32:32.894708 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f0b7e-78bd-4807-a02f-fa198f5563dd service placement] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:32:32.894976 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f0b7e-78bd-4807-a02f-fa198f5563dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:32:32.899438 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-828f0b7e-78bd-4807-a02f-fa198f5563dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:32:32.912627 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f0b7e-78bd-4807-a02f-fa198f5563dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:32:32.914189 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f0b7e-78bd-4807-a02f-fa198f5563dd service placement] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:32:32.924000 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1447/2880] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:32:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:32:35.288367 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74c2a4-f2c3-4d65-8c8e-26ea2d068590 None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:32:35.295378 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-9b74c2a4-f2c3-4d65-8c8e-26ea2d068590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:32:35.314453 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74c2a4-f2c3-4d65-8c8e-26ea2d068590 None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:32:35.320130 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d805ef-1784-468c-8e4f-eeb958eead4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:32:35.320710 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d805ef-1784-468c-8e4f-eeb958eead4f service nova] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:32:35.320985 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d805ef-1784-468c-8e4f-eeb958eead4f service nova] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:32:35.321393 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d805ef-1784-468c-8e4f-eeb958eead4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:32:35.323189 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-b7d805ef-1784-468c-8e4f-eeb958eead4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:32:35.342089 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d805ef-1784-468c-8e4f-eeb958eead4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:32:35.343772 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d805ef-1784-468c-8e4f-eeb958eead4f service nova] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:32:35.360172 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1434/2881] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:32:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:32:48.220459 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f0b7e-78bd-4807-a02f-fa198f5563dd service placement] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:32:48.235620 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f0b7e-78bd-4807-a02f-fa198f5563dd service placement] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:32:48.241158 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3959c00-622a-49a3-81cd-13e04517fb5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:32:48.241804 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3959c00-622a-49a3-81cd-13e04517fb5d service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:32:48.242087 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3959c00-622a-49a3-81cd-13e04517fb5d service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:32:48.242361 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3959c00-622a-49a3-81cd-13e04517fb5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:32:48.244192 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d3959c00-622a-49a3-81cd-13e04517fb5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:32:48.256778 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3959c00-622a-49a3-81cd-13e04517fb5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:32:48.258329 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3959c00-622a-49a3-81cd-13e04517fb5d service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:32:48.269809 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1448/2882] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:32:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:32:52.051710 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d805ef-1784-468c-8e4f-eeb958eead4f service nova] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:32:52.061668 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d805ef-1784-468c-8e4f-eeb958eead4f service nova] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:32:52.065229 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897693a-15c5-42e2-ae0c-1cd38649ee75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:32:52.065859 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897693a-15c5-42e2-ae0c-1cd38649ee75 service neutron] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:32:52.066144 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897693a-15c5-42e2-ae0c-1cd38649ee75 service neutron] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:32:52.066421 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897693a-15c5-42e2-ae0c-1cd38649ee75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:32:52.068192 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e897693a-15c5-42e2-ae0c-1cd38649ee75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:32:52.129324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897693a-15c5-42e2-ae0c-1cd38649ee75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:32:52.130733 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897693a-15c5-42e2-ae0c-1cd38649ee75 service neutron] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:32:52.140223 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1435/2883] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:32:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:33:05.578253 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3959c00-622a-49a3-81cd-13e04517fb5d service nova] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:33:05.580579 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-d3959c00-622a-49a3-81cd-13e04517fb5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:33:05.603440 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3959c00-622a-49a3-81cd-13e04517fb5d service nova] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:33:05.610080 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc50d5d-e36e-4938-b77d-c723b8099bec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '551da2c9fab74cb8b14287a5634adb25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:33:05.610811 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc50d5d-e36e-4938-b77d-c723b8099bec service nova] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:33:05.611140 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc50d5d-e36e-4938-b77d-c723b8099bec service nova] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:33:05.611414 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc50d5d-e36e-4938-b77d-c723b8099bec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:33:05.613649 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-8fc50d5d-e36e-4938-b77d-c723b8099bec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:33:05.626831 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc50d5d-e36e-4938-b77d-c723b8099bec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:33:05.628757 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc50d5d-e36e-4938-b77d-c723b8099bec service nova] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:33:05.641974 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1449/2884] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:33:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:33:12.907324 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a522816-9ca4-477a-b880-67c2282abb6a None None] REQUEST_METHOD: `POST` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:33:12.907885 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a522816-9ca4-477a-b880-67c2282abb6a None None] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:33:12.907885 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a522816-9ca4-477a-b880-67c2282abb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:33:12.925675 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.auth.core [None req-2a522816-9ca4-477a-b880-67c2282abb6a None None] MFA Rules not processed for user `9dca4ea4f2c8490e823a73dca6c303ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 23:33:12.926927 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-2a522816-9ca4-477a-b880-67c2282abb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:33:12.935800 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1436/2885] 10.222.0.77 () {58 vars in 967 bytes} [Thu Feb 10 23:33:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 23:33:12.976543 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc50d5d-e36e-4938-b77d-c723b8099bec service nova] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:33:12.988005 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc50d5d-e36e-4938-b77d-c723b8099bec service nova] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:33:12.993012 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf75ee-a6cb-43bc-9ee6-fa6c526eb6cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce55b64dc528447993e32b00ae4d3a2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:33:12.993648 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf75ee-a6cb-43bc-9ee6-fa6c526eb6cd service swift] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:33:12.993934 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf75ee-a6cb-43bc-9ee6-fa6c526eb6cd service swift] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:33:12.994261 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf75ee-a6cb-43bc-9ee6-fa6c526eb6cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:33:13.002594 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf75ee-a6cb-43bc-9ee6-fa6c526eb6cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:33:13.004214 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf75ee-a6cb-43bc-9ee6-fa6c526eb6cd service swift] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:33:13.013015 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1450/2886] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Feb 10 23:33:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 23:33:19.923220 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a522816-9ca4-477a-b880-67c2282abb6a None None] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:33:19.990302 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a522816-9ca4-477a-b880-67c2282abb6a None None] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:33:19.995343 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654603b-139b-4c87-a02f-ae1b9e0a98e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:33:19.996225 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654603b-139b-4c87-a02f-ae1b9e0a98e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:33:19.996509 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654603b-139b-4c87-a02f-ae1b9e0a98e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:33:19.996782 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654603b-139b-4c87-a02f-ae1b9e0a98e8 admin admin] PATH_INFO: `/v3/users/a61061fb36904e87b071fbb32b021d88` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:33:19.997968 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654603b-139b-4c87-a02f-ae1b9e0a98e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a61061fb36904e87b071fbb32b021d88)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:33:19.999940 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654603b-139b-4c87-a02f-ae1b9e0a98e8 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:33:20.042995 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a654603b-139b-4c87-a02f-ae1b9e0a98e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a61061fb36904e87b071fbb32b021d88'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:33:20.054291 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a654603b-139b-4c87-a02f-ae1b9e0a98e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a61061fb36904e87b071fbb32b021d88'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:33:20.054980 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a654603b-139b-4c87-a02f-ae1b9e0a98e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a61061fb36904e87b071fbb32b021d88'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:33:20.055610 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a654603b-139b-4c87-a02f-ae1b9e0a98e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a61061fb36904e87b071fbb32b021d88'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:33:20.063760 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-a654603b-139b-4c87-a02f-ae1b9e0a98e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a61061fb36904e87b071fbb32b021d88'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:33:20.076827 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1437/2887] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:33:19 2022] DELETE /identity/v3/users/a61061fb36904e87b071fbb32b021d88 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:33:20.248642 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf75ee-a6cb-43bc-9ee6-fa6c526eb6cd service swift] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:33:20.260821 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf75ee-a6cb-43bc-9ee6-fa6c526eb6cd service swift] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:33:20.316382 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26f539-0630-4275-ab97-16d34d2944af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:33:20.317226 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26f539-0630-4275-ab97-16d34d2944af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:33:20.317511 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26f539-0630-4275-ab97-16d34d2944af admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:33:20.317783 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26f539-0630-4275-ab97-16d34d2944af admin admin] PATH_INFO: `/v3/projects/42cc48a71496497b9adb74c8f5cf683f` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:33:20.318944 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26f539-0630-4275-ab97-16d34d2944af admin admin] RBAC: Authorizing `identity:delete_project(project_id=42cc48a71496497b9adb74c8f5cf683f)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:33:20.320870 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26f539-0630-4275-ab97-16d34d2944af admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:33:20.365228 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6f26f539-0630-4275-ab97-16d34d2944af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42cc48a71496497b9adb74c8f5cf683f', 'request_id': 'req-6f26f539-0630-4275-ab97-16d34d2944af'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:33:20.370648 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6f26f539-0630-4275-ab97-16d34d2944af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42cc48a71496497b9adb74c8f5cf683f', 'request_id': 'req-6f26f539-0630-4275-ab97-16d34d2944af'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:33:20.376523 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6f26f539-0630-4275-ab97-16d34d2944af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42cc48a71496497b9adb74c8f5cf683f', 'request_id': 'req-6f26f539-0630-4275-ab97-16d34d2944af'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:33:20.389655 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6f26f539-0630-4275-ab97-16d34d2944af admin admin] The token cache is being invalidate because project 42cc48a71496497b9adb74c8f5cf683f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:33:20.389940 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6f26f539-0630-4275-ab97-16d34d2944af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:33:20.390554 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-6f26f539-0630-4275-ab97-16d34d2944af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:33:20.392096 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1451/2888] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:33:20 2022] DELETE /identity/v3/projects/42cc48a71496497b9adb74c8f5cf683f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 23:33:20.396088 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654603b-139b-4c87-a02f-ae1b9e0a98e8 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:33:20.397654 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-a654603b-139b-4c87-a02f-ae1b9e0a98e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:33:20.410789 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654603b-139b-4c87-a02f-ae1b9e0a98e8 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:33:20.463871 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473510f-5782-456f-bc68-c74cfb750d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:33:20.464654 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473510f-5782-456f-bc68-c74cfb750d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:33:20.464937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473510f-5782-456f-bc68-c74cfb750d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:33:20.465205 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473510f-5782-456f-bc68-c74cfb750d89 admin admin] PATH_INFO: `/v3/users/a3a20adb16584bfdaaba55908dcc10bc` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:33:20.466378 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473510f-5782-456f-bc68-c74cfb750d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a20adb16584bfdaaba55908dcc10bc)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:33:20.468300 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473510f-5782-456f-bc68-c74cfb750d89 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:33:20.513808 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0473510f-5782-456f-bc68-c74cfb750d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a20adb16584bfdaaba55908dcc10bc'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:33:20.524893 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0473510f-5782-456f-bc68-c74cfb750d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a20adb16584bfdaaba55908dcc10bc'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:33:20.526179 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0473510f-5782-456f-bc68-c74cfb750d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a20adb16584bfdaaba55908dcc10bc'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:33:20.526940 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0473510f-5782-456f-bc68-c74cfb750d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a20adb16584bfdaaba55908dcc10bc'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:33:20.533875 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-0473510f-5782-456f-bc68-c74cfb750d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a20adb16584bfdaaba55908dcc10bc'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:33:20.545877 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1438/2889] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:33:20 2022] DELETE /identity/v3/users/a3a20adb16584bfdaaba55908dcc10bc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:33:20.717473 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26f539-0630-4275-ab97-16d34d2944af admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:33:20.718837 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-6f26f539-0630-4275-ab97-16d34d2944af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:33:20.732983 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26f539-0630-4275-ab97-16d34d2944af admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:33:20.788537 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbcdd9-df2a-4608-8ab4-5312a272f642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:33:20.789392 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbcdd9-df2a-4608-8ab4-5312a272f642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:33:20.789675 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbcdd9-df2a-4608-8ab4-5312a272f642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:33:20.789947 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbcdd9-df2a-4608-8ab4-5312a272f642 admin admin] PATH_INFO: `/v3/projects/44e9b574db284879b75c9ec6ecad8b5a` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:33:20.791838 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbcdd9-df2a-4608-8ab4-5312a272f642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44e9b574db284879b75c9ec6ecad8b5a)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:33:20.793753 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbcdd9-df2a-4608-8ab4-5312a272f642 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:33:20.837779 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-83bbcdd9-df2a-4608-8ab4-5312a272f642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e9b574db284879b75c9ec6ecad8b5a', 'request_id': 'req-83bbcdd9-df2a-4608-8ab4-5312a272f642'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:33:20.843498 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-83bbcdd9-df2a-4608-8ab4-5312a272f642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e9b574db284879b75c9ec6ecad8b5a', 'request_id': 'req-83bbcdd9-df2a-4608-8ab4-5312a272f642'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:33:20.849682 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-83bbcdd9-df2a-4608-8ab4-5312a272f642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e9b574db284879b75c9ec6ecad8b5a', 'request_id': 'req-83bbcdd9-df2a-4608-8ab4-5312a272f642'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:33:20.862449 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-83bbcdd9-df2a-4608-8ab4-5312a272f642 admin admin] The token cache is being invalidate because project 44e9b574db284879b75c9ec6ecad8b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:33:20.862728 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-83bbcdd9-df2a-4608-8ab4-5312a272f642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:33:20.863359 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-83bbcdd9-df2a-4608-8ab4-5312a272f642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:33:20.864904 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1452/2890] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:33:20 2022] DELETE /identity/v3/projects/44e9b574db284879b75c9ec6ecad8b5a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:34:46.496297 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473510f-5782-456f-bc68-c74cfb750d89 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:34:46.497662 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-0473510f-5782-456f-bc68-c74cfb750d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:34:46.562275 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473510f-5782-456f-bc68-c74cfb750d89 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:34:46.618901 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ddf76-ded2-46b1-bf58-272ae761f4d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f5243eef2a24a518b30526425c0b2c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:34:46.619472 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ddf76-ded2-46b1-bf58-272ae761f4d3 service placement] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:34:46.619757 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ddf76-ded2-46b1-bf58-272ae761f4d3 service placement] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:34:46.620064 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ddf76-ded2-46b1-bf58-272ae761f4d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:34:46.622248 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-7a2ddf76-ded2-46b1-bf58-272ae761f4d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:34:46.633151 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ddf76-ded2-46b1-bf58-272ae761f4d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:34:46.634703 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ddf76-ded2-46b1-bf58-272ae761f4d3 service placement] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:34:46.644925 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1439/2891] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:34:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:34:58.159257 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbcdd9-df2a-4608-8ab4-5312a272f642 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:34:58.160691 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-83bbcdd9-df2a-4608-8ab4-5312a272f642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:34:58.218663 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbcdd9-df2a-4608-8ab4-5312a272f642 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:34:58.222229 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede3495-544c-4198-a5f5-8ae100def8d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2af52f48dc435ca9a48cc0a32c31e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:34:58.222875 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede3495-544c-4198-a5f5-8ae100def8d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:34:58.223160 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede3495-544c-4198-a5f5-8ae100def8d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:34:58.223434 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede3495-544c-4198-a5f5-8ae100def8d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:34:58.225184 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-7ede3495-544c-4198-a5f5-8ae100def8d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:34:58.285216 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede3495-544c-4198-a5f5-8ae100def8d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:34:58.286651 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede3495-544c-4198-a5f5-8ae100def8d1 service neutron] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:34:58.296658 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1453/2892] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 23:35:04.787238 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ddf76-ded2-46b1-bf58-272ae761f4d3 service placement] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:35:04.789046 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-7a2ddf76-ded2-46b1-bf58-272ae761f4d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:35:04.805246 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ddf76-ded2-46b1-bf58-272ae761f4d3 service placement] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:35:04.811381 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b96d5-8a32-4aa4-b8fb-57a6581323f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:35:04.812328 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b96d5-8a32-4aa4-b8fb-57a6581323f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:35:04.812635 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b96d5-8a32-4aa4-b8fb-57a6581323f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:35:04.813127 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b96d5-8a32-4aa4-b8fb-57a6581323f9 admin admin] PATH_INFO: `/v3/users/90e38b215fc34b759e71c933c1a08eec` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:35:04.814358 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b96d5-8a32-4aa4-b8fb-57a6581323f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e38b215fc34b759e71c933c1a08eec)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:35:04.816405 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b96d5-8a32-4aa4-b8fb-57a6581323f9 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:35:04.868966 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-620b96d5-8a32-4aa4-b8fb-57a6581323f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e38b215fc34b759e71c933c1a08eec'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:35:04.881580 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-620b96d5-8a32-4aa4-b8fb-57a6581323f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e38b215fc34b759e71c933c1a08eec'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:35:04.882258 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-620b96d5-8a32-4aa4-b8fb-57a6581323f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e38b215fc34b759e71c933c1a08eec'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:35:04.882852 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-620b96d5-8a32-4aa4-b8fb-57a6581323f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e38b215fc34b759e71c933c1a08eec'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:35:04.890627 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-620b96d5-8a32-4aa4-b8fb-57a6581323f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e38b215fc34b759e71c933c1a08eec'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:35:04.903542 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1440/2893] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:35:04 2022] DELETE /identity/v3/users/90e38b215fc34b759e71c933c1a08eec => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:35:05.068915 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede3495-544c-4198-a5f5-8ae100def8d1 service neutron] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:35:05.088159 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede3495-544c-4198-a5f5-8ae100def8d1 service neutron] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:35:05.144532 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7995c2-ce6f-4473-88b9-5c5b4bac8b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:35:05.145314 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7995c2-ce6f-4473-88b9-5c5b4bac8b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:35:05.145591 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7995c2-ce6f-4473-88b9-5c5b4bac8b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:35:05.145856 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7995c2-ce6f-4473-88b9-5c5b4bac8b31 admin admin] PATH_INFO: `/v3/projects/b55b4d0e04bf46e18d0f7a1d3851b603` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:35:05.147010 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7995c2-ce6f-4473-88b9-5c5b4bac8b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b55b4d0e04bf46e18d0f7a1d3851b603)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:35:05.148919 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7995c2-ce6f-4473-88b9-5c5b4bac8b31 admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:35:05.192602 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ef7995c2-ce6f-4473-88b9-5c5b4bac8b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b55b4d0e04bf46e18d0f7a1d3851b603', 'request_id': 'req-ef7995c2-ce6f-4473-88b9-5c5b4bac8b31'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:35:05.197970 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ef7995c2-ce6f-4473-88b9-5c5b4bac8b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b55b4d0e04bf46e18d0f7a1d3851b603', 'request_id': 'req-ef7995c2-ce6f-4473-88b9-5c5b4bac8b31'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:35:05.204768 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ef7995c2-ce6f-4473-88b9-5c5b4bac8b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b55b4d0e04bf46e18d0f7a1d3851b603', 'request_id': 'req-ef7995c2-ce6f-4473-88b9-5c5b4bac8b31'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:35:05.216513 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ef7995c2-ce6f-4473-88b9-5c5b4bac8b31 admin admin] The token cache is being invalidate because project b55b4d0e04bf46e18d0f7a1d3851b603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:35:05.216802 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ef7995c2-ce6f-4473-88b9-5c5b4bac8b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:35:05.217427 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-ef7995c2-ce6f-4473-88b9-5c5b4bac8b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:35:05.218941 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1454/2894] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:35:05 2022] DELETE /identity/v3/projects/b55b4d0e04bf46e18d0f7a1d3851b603 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:35:05.224114 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b96d5-8a32-4aa4-b8fb-57a6581323f9 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:35:05.224845 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-620b96d5-8a32-4aa4-b8fb-57a6581323f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:35:05.238074 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b96d5-8a32-4aa4-b8fb-57a6581323f9 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:35:05.292166 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fc7a6-34a6-49ce-bc79-da62bf5c3883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:35:05.292937 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fc7a6-34a6-49ce-bc79-da62bf5c3883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:35:05.293789 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fc7a6-34a6-49ce-bc79-da62bf5c3883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:35:05.294070 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fc7a6-34a6-49ce-bc79-da62bf5c3883 admin admin] PATH_INFO: `/v3/users/bc16754667b24ee7aa43debd6565ced5` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:35:05.295259 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fc7a6-34a6-49ce-bc79-da62bf5c3883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc16754667b24ee7aa43debd6565ced5)` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:35:05.297198 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fc7a6-34a6-49ce-bc79-da62bf5c3883 admin admin] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:35:05.341765 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e26fc7a6-34a6-49ce-bc79-da62bf5c3883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc16754667b24ee7aa43debd6565ced5'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:35:05.353113 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e26fc7a6-34a6-49ce-bc79-da62bf5c3883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc16754667b24ee7aa43debd6565ced5'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:35:05.353769 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e26fc7a6-34a6-49ce-bc79-da62bf5c3883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc16754667b24ee7aa43debd6565ced5'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:35:05.354364 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e26fc7a6-34a6-49ce-bc79-da62bf5c3883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc16754667b24ee7aa43debd6565ced5'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:35:05.362017 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.notifications [None req-e26fc7a6-34a6-49ce-bc79-da62bf5c3883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc16754667b24ee7aa43debd6565ced5'} {{(pid=79312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:35:05.373909 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1441/2895] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Feb 10 23:35:05 2022] DELETE /identity/v3/users/bc16754667b24ee7aa43debd6565ced5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:35:05.545273 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7995c2-ce6f-4473-88b9-5c5b4bac8b31 admin admin] Authenticating user token {{(pid=79313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:35:05.546631 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.fernet_utils [None req-ef7995c2-ce6f-4473-88b9-5c5b4bac8b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:35:05.559515 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7995c2-ce6f-4473-88b9-5c5b4bac8b31 admin admin] Validating token access rules against request {{(pid=79313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:35:05.618721 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ea3af-e5db-4c20-bf48-6ef3de4c298c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93804c035bb74a079b9cb29e5d154621', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a8319582f7d4e2b90ad1c11263c01da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:35:05.619575 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ea3af-e5db-4c20-bf48-6ef3de4c298c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:35:05.619885 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ea3af-e5db-4c20-bf48-6ef3de4c298c admin admin] SCRIPT_NAME: `/identity` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:35:05.620161 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ea3af-e5db-4c20-bf48-6ef3de4c298c admin admin] PATH_INFO: `/v3/projects/038e7a50c141460eb8217c8b359b9456` {{(pid=79313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:35:05.621360 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ea3af-e5db-4c20-bf48-6ef3de4c298c admin admin] RBAC: Authorizing `identity:delete_project(project_id=038e7a50c141460eb8217c8b359b9456)` {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:35:05.623249 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ea3af-e5db-4c20-bf48-6ef3de4c298c admin admin] RBAC: Authorization granted {{(pid=79313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:35:05.668646 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-dd4ea3af-e5db-4c20-bf48-6ef3de4c298c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '038e7a50c141460eb8217c8b359b9456', 'request_id': 'req-dd4ea3af-e5db-4c20-bf48-6ef3de4c298c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:35:05.674016 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-dd4ea3af-e5db-4c20-bf48-6ef3de4c298c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '038e7a50c141460eb8217c8b359b9456', 'request_id': 'req-dd4ea3af-e5db-4c20-bf48-6ef3de4c298c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:35:05.679885 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-dd4ea3af-e5db-4c20-bf48-6ef3de4c298c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '038e7a50c141460eb8217c8b359b9456', 'request_id': 'req-dd4ea3af-e5db-4c20-bf48-6ef3de4c298c'} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:35:05.692410 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-dd4ea3af-e5db-4c20-bf48-6ef3de4c298c admin admin] The token cache is being invalidate because project 038e7a50c141460eb8217c8b359b9456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 23:35:05.692695 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-dd4ea3af-e5db-4c20-bf48-6ef3de4c298c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:35:05.693301 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: DEBUG keystone.notifications [None req-dd4ea3af-e5db-4c20-bf48-6ef3de4c298c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 23:35:05.694866 dv-cinder-828805-1-iscsi devstack@keystone.service[79313]: [pid: 79313|app: 0|req: 1455/2896] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Feb 10 23:35:05 2022] DELETE /identity/v3/projects/038e7a50c141460eb8217c8b359b9456 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 23:39:53.269276 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fc7a6-34a6-49ce-bc79-da62bf5c3883 admin admin] Authenticating user token {{(pid=79312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 23:39:53.270667 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-e26fc7a6-34a6-49ce-bc79-da62bf5c3883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:39:53.404911 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fc7a6-34a6-49ce-bc79-da62bf5c3883 admin admin] Validating token access rules against request {{(pid=79312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 23:39:53.460980 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae0ee6-2070-468d-9d68-25bf65335dd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f5243eef2a24a518b30526425c0b2c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29ab195cc240497c9ac12843d738c4b9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 23:39:53.461618 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae0ee6-2070-468d-9d68-25bf65335dd4 service placement] REQUEST_METHOD: `GET` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 23:39:53.461896 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae0ee6-2070-468d-9d68-25bf65335dd4 service placement] SCRIPT_NAME: `/identity` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 23:39:53.462168 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae0ee6-2070-468d-9d68-25bf65335dd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 23:39:53.463903 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.fernet_utils [None req-7cae0ee6-2070-468d-9d68-25bf65335dd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 23:39:53.475229 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae0ee6-2070-468d-9d68-25bf65335dd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 23:39:53.476826 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae0ee6-2070-468d-9d68-25bf65335dd4 service placement] RBAC: Authorization granted {{(pid=79312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 23:39:53.487081 dv-cinder-828805-1-iscsi devstack@keystone.service[79312]: [pid: 79312|app: 0|req: 1442/2897] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Feb 10 23:39:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)